-- Logs begin at Mon 2022-09-26 00:56:52 UTC, end at Mon 2022-09-26 01:58:15 UTC. -- Sep 26 01:21:33.973813 dv-cinder-859203-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 26 01:21:33.984216 dv-cinder-859203-2-smb devstack@keystone.service[81407]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 26 01:21:33.986897 dv-cinder-859203-2-smb devstack@keystone.service[81407]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 26 01:21:33 2022] *** Sep 26 01:21:33.987042 dv-cinder-859203-2-smb devstack@keystone.service[81407]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 26 01:21:33.987160 dv-cinder-859203-2-smb devstack@keystone.service[81407]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 26 01:21:33.987266 dv-cinder-859203-2-smb devstack@keystone.service[81407]: nodename: dv-cinder-859203-2-smb Sep 26 01:21:33.987371 dv-cinder-859203-2-smb devstack@keystone.service[81407]: machine: x86_64 Sep 26 01:21:33.987476 dv-cinder-859203-2-smb devstack@keystone.service[81407]: clock source: unix Sep 26 01:21:33.987578 dv-cinder-859203-2-smb devstack@keystone.service[81407]: pcre jit disabled Sep 26 01:21:33.987680 dv-cinder-859203-2-smb devstack@keystone.service[81407]: detected number of CPU cores: 4 Sep 26 01:21:33.987787 dv-cinder-859203-2-smb devstack@keystone.service[81407]: current working directory: / Sep 26 01:21:33.987891 dv-cinder-859203-2-smb devstack@keystone.service[81407]: detected binary path: /usr/bin/uwsgi-core Sep 26 01:21:33.988000 dv-cinder-859203-2-smb devstack@keystone.service[81407]: your processes number limit is 47680 Sep 26 01:21:33.988105 dv-cinder-859203-2-smb devstack@keystone.service[81407]: your memory page size is 4096 bytes Sep 26 01:21:33.988212 dv-cinder-859203-2-smb devstack@keystone.service[81407]: detected max file descriptor number: 2048 Sep 26 01:21:33.988326 dv-cinder-859203-2-smb devstack@keystone.service[81407]: lock engine: pthread robust mutexes Sep 26 01:21:33.988585 dv-cinder-859203-2-smb devstack@keystone.service[81407]: thunder lock: enabled Sep 26 01:21:33.988881 dv-cinder-859203-2-smb devstack@keystone.service[81407]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 26 01:21:33.989072 dv-cinder-859203-2-smb devstack@keystone.service[81407]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 26 01:21:34.028454 dv-cinder-859203-2-smb devstack@keystone.service[81407]: Python main interpreter initialized at 0x55d25e9959c0 Sep 26 01:21:34.028454 dv-cinder-859203-2-smb devstack@keystone.service[81407]: python threads support enabled Sep 26 01:21:34.028454 dv-cinder-859203-2-smb devstack@keystone.service[81407]: your server socket listen backlog is limited to 100 connections Sep 26 01:21:34.028454 dv-cinder-859203-2-smb devstack@keystone.service[81407]: your mercy for graceful operations on workers is 90 seconds Sep 26 01:21:34.028828 dv-cinder-859203-2-smb devstack@keystone.service[81407]: mapped 403077 bytes (393 KB) for 2 cores Sep 26 01:21:34.028909 dv-cinder-859203-2-smb devstack@keystone.service[81407]: *** Operational MODE: preforking *** Sep 26 01:21:34.029138 dv-cinder-859203-2-smb devstack@keystone.service[81407]: *** uWSGI is running in multiple interpreter mode *** Sep 26 01:21:34.029138 dv-cinder-859203-2-smb devstack@keystone.service[81407]: spawned uWSGI master process (pid: 81407) Sep 26 01:21:34.029340 dv-cinder-859203-2-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 26 01:21:34.030109 dv-cinder-859203-2-smb devstack@keystone.service[81407]: spawned uWSGI worker 1 (pid: 81421, cores: 1) Sep 26 01:21:34.030230 dv-cinder-859203-2-smb devstack@keystone.service[81407]: spawned uWSGI worker 2 (pid: 81422, cores: 1) Sep 26 01:21:34.030381 dv-cinder-859203-2-smb devstack@keystone.service[81407]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 26 01:21:38.305824 dv-cinder-859203-2-smb devstack@keystone.service[81421]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 01:21:38.305824 dv-cinder-859203-2-smb devstack@keystone.service[81421]: from cryptography.utils import int_from_bytes Sep 26 01:21:38.306621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 01:21:38.306621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: from cryptography.utils import int_from_bytes Sep 26 01:21:38.306742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 01:21:38.306742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: from cryptography.utils import int_from_bytes Sep 26 01:21:38.307215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 01:21:38.307215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: from cryptography.utils import int_from_bytes Sep 26 01:21:38.357388 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 01:21:38.357569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 01:21:38.357664 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 01:21:38.357753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 01:21:38.357831 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] command line args: [] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 01:21:38.357905 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] command line args: [] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 01:21:38.358009 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 01:21:38.358211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 01:21:38.358316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ================================================================================ {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 01:21:38.358395 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ================================================================================ {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 01:21:38.358474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] admin_token = **** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.358592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] admin_token = **** {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.358685 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] config_dir = [] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.358851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.358933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] config_dir = [] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.359033 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] config_source = [] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.359122 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.359196 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] config_source = [] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.359272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] debug = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.359380 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] debug = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.359466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.359650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.359749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.359817 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.359958 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.360050 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.360166 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.360245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.360413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.360492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.360642 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] list_limit = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.360727 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] list_limit = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.360830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] log_config_append = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.360911 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] log_config_append = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.360979 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.361044 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.361156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] log_dir = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.361228 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] log_dir = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.361320 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] log_file = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.361388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] log_file = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.361548 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.361633 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.361795 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.361872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.362042 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.362127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.362283 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.362363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.362469 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.362551 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.362613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.362682 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.362871 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.362965 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.363119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.363200 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.363350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.363467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.363565 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.363664 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.363795 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.363911 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.364639 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.364863 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.365003 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.365250 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.365362 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.365506 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.365778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.365922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.366288 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.366448 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.366448 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] publish_errors = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.366788 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] publish_errors = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.366983 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.367159 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.367337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.367515 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.367665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.367781 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.367894 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.368071 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.368198 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.368321 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.368437 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] standard_threads = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.368550 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] standard_threads = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.368664 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.368789 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.368913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.369041 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.369159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.369273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.369388 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] use_journal = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.369561 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] use_journal = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.369686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] use_json = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.369793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] use_json = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.369904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] use_stderr = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.370018 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] use_stderr = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.370138 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] use_syslog = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.370266 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] use_syslog = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.370390 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.370496 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:21:38.370608 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.370728 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.370864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.371062 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.371248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.371421 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.371597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.371776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.371959 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.372146 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.372331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.372512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.372689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.372883 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.373059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.373244 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.373443 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.373630 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.373809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.373994 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.374177 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.374373 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.374553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.374676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.374798 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.374941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.375069 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.375198 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.375320 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.375442 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.375558 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.375681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.375797 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.375925 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.376048 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.376164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.376279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.376392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.376507 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.376702 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.376828 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.376950 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.377072 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.377188 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.377311 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.377427 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.377427 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.377649 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.377764 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.377878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.378041 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.378161 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.378276 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.378276 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.378496 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.378612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.378734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.378734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.378991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.379105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.379218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.379332 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.379462 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.379589 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.379713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.379830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.379944 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.380064 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.380189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.380305 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.380425 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.380541 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.380654 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.380768 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.380891 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.381011 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.381126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.381239 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.381352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.381465 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.381587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.381703 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.381823 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.381940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.382053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.382166 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.382450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.382571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.382692 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.382806 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.382960 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.382960 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.382960 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.383287 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.383401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.383515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.383635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.383751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.383751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.383974 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.384095 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.384209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.384322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.384435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.384557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.384673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.384786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.384898 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.385012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.385126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.385255 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.385371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.385491 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.385627 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.385734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.385841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.385938 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.386046 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.386151 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.386248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.386350 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.386456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.386559 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.386666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.386770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.386901 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.387017 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.387219 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.387352 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.387471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.387586 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.387701 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.387815 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.387935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.388040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.388197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.388315 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.388436 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.388541 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.388659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.388782 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.388913 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.389031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.389150 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.389266 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.389387 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.389499 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.389632 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.389740 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.389854 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.389967 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.390080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.390194 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.390317 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.390424 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.390536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.390650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.390763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.391332 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.391459 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.391560 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.391657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.391752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.391849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.391944 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.392048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.392152 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.392251 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.392347 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.392442 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.392544 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.392650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.392748 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.392844 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.392939 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.393034 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.393129 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.393233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.393331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.393426 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.393522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.393628 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.393724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.393896 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.394012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.394110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.394205 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.394300 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.394409 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.394519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.394626 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.394724 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.394820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.394944 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.395061 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.395211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.395407 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.395521 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.395638 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.395754 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.395876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.395993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.396118 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.396242 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.396359 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.396475 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.396592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.396708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.396833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.396957 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.397075 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.397190 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.397304 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.397456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] auth.external = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.397588 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.397711 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.397835 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] auth.external = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.397954 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.398072 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.398227 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.398346 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.398463 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] auth.password = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.398588 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.398717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] auth.token = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.398864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] auth.password = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.398984 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.398984 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.399204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] auth.token = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.399334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.399453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.399576 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.399694 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.399811 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.399929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.400053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.400171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.400287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.400403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.400520 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] credential.caching = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.400635 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.400759 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.400878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.400999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.401116 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] credential.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.401232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.401348 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.401473 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.401592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.401708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.401831 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.401949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.402065 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.402189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.402307 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.402424 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.402540 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.402656 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.402771 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.402929 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.403049 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.403166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.403281 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.403399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.403515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.403639 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.403757 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.403880 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.403998 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.404114 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.404230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.404355 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] federation.caching = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.404473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.404598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.404715 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.404831 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.404948 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] federation.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.405073 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.405191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.405308 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.405424 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.405540 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.405656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.406179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.406293 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.406392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.406490 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.406588 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.406693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.406936 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.407042 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.407142 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.407239 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.407336 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.407451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.407563 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] identity.caching = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.407661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.407758 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.407855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.407952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.408123 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.408268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.408374 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.408472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.408570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.408678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.408795 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.408914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.409031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.409148 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.409264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.409379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.409504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.409622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.409738 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.409853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.409969 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.410085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.410209 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.410335 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.410452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.410569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.410685 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.411302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.411466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.411640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.411803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.411963 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.412828 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.412967 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.413089 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.413206 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.413206 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.413439 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.413556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.413682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.413801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.413801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.414019 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.414135 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.414135 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.414361 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.414481 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.414597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.414713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.414846 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.414965 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.415095 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.415214 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.415331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.415447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.415447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.415667 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.415792 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.415926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.416117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.416236 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.416353 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.416470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.416597 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.416715 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.416832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.416948 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.417064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.417064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.417290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.417408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.417525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.417642 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.417642 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.417860 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.417985 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.418104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.418220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.418373 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.418373 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.418595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.418595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.418879 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.419000 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.419117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.419233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.419233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.419467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.419583 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.419700 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.419816 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.419932 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.420055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.420173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.420289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.user = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.420405 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.420520 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.420643 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.420770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.420888 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.421004 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.421120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.421238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.421364 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.421491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.421609 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.421726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.421843 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.421958 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.422074 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.422197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.422316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.422433 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.422549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.422664 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.422779 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.422919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.423039 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.423155 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.423271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.423386 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.423502 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.423626 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.423744 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.423868 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.423986 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.424101 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.424217 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.424341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.424459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.424575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.424691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.424806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.424922 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.425047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.425165 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.425280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.425396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.425511 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.425626 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.425751 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.425869 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.425986 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.426108 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.426226 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.426342 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.427083 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.427210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.427328 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.427444 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.427560 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.427677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.427807 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.427926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.428043 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.428159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.428296 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.428478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.428641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.428761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.428877 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.429000 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.429119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.429235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.429364 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.429482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.429598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.429714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.429830 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] resource.caching = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.429946 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.430071 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.430190 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.430306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.430422 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.430538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.430654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.430778 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.430912 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.431030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.431145 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.431266 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.431383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.431531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.431651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.431768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.431884 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.432001 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.432117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] resource.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.432244 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] role.caching = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.432363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.432480 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] role.driver = sql {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.432596 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.432712 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.432828 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.433020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.433141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.433258 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.433377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.433377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.433604 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.433722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.433838 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.433954 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.434069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.434186 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.434310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.434429 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] role.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.434545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.434661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] role.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.434776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.434946 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.435076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.435196 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.435313 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.435430 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.435547 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.435663 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.435788 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.435906 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.436023 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.436139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.436139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.436357 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.436483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.436602 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.436718 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.436833 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.436950 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.437066 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.437194 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.437313 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.437429 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.437546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.437662 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.437777 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.437902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.438020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.438020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.438239 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.438355 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.438510 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.438640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.438759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.438887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.439005 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.439121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.439249 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.439369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.439485 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.439602 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.439718 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.439833 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.439957 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.440076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.440191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.440307 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.440423 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.440538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.440664 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.440782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] token.caching = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.440898 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.441014 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.441137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.441259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.441383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.441502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.441618 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.441735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.441851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.441967 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.442117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.442311 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.442525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.442689 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.442811 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.442986 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.443117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] token.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.443237 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.443354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.443470 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.443586 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.443702 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.443828 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.443947 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.444063 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.444179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.444295 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.444295 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.444521 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.444639 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.444755 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.444881 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.445007 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.445126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.445242 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.445366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.445484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.connection = **** {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.445600 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.445716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.446090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.446210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.446336 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.446454 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.446570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.446685 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.446801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.446952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.447081 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.447199 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.447324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.447442 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.447442 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.447660 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.connection = **** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.447776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.447892 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.448018 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.448137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.448137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.448355 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.448480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.448631 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.448760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.448878 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.448994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.449111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.449227 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.449343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.449467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.449586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.449701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.449817 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.449932 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.450047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.450047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 01:21:38.450277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.450277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.450277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.450277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.450277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.450277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.450277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.450277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:21:38.450277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 01:21:38.474266 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.474494 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.474719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.475153 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.475384 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.475603 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.483050 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.483828 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.511492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.511718 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.512040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.512273 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.565342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.565481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.614105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.614243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.614352 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.614457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.769817 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.770003 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.770085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.770737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.770864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.771005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.771130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.771212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.771428 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.771528 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.771650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.771867 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.795033 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.795267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.795403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.795501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.795637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.795719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.795864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.795947 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.796087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.796169 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.796304 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.796387 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.796519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.796734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.807400 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.807766 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.820217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.820329 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.820404 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.820588 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.820672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.821063 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.821151 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.821291 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.821381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.821504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.821585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.821717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.821812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.821929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 01:21:38.839061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.839273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 01:21:38.839356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.839563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 01:21:38.839644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.839806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 01:21:38.839887 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.840085 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 01:21:38.840166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.840348 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.840437 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.840606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.840687 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.840865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.840943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.841119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.850615 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.850717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.850953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.851038 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.851226 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.851326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.851508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.851590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.858365 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.858453 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.861243 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.861329 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.861531 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.861613 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.861816 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.861896 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.862102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.862184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.862387 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.862477 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.862648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.862738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.862939 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.863024 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.863215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.863297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.863487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.863568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.863758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.863837 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.864540 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.864620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.887448 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.887759 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.888889 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.889179 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.889260 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.889494 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.893774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.894059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.894140 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.894336 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.894431 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.894670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.900662 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.900949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.901147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.901438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.906470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.906770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.907013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.907097 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.907314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.907408 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.907611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.907694 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.907888 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.907970 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.908161 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.908245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.908431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.908512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.908699 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.908969 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.923588 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.923868 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.924387 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.924670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.928278 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.929010 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.931440 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.931736 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.932186 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.932486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.935842 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.936616 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.938989 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.939815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.942322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.942757 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.943072 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.943154 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.943358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.943439 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.943635 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.943718 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.943920 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.944001 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.944211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.944502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.960440 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.960726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.960902 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.960984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.961192 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.961287 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.961464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.961735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.967982 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.968541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.969507 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.970070 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.971063 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.971339 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.971621 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.971898 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.974764 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.975071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.975248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.975355 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.975535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.975630 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.975820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.976017 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.976108 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.976484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.987035 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.987321 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.987551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:38.987631 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.987836 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.987930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.988117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.988220 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.988405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.988487 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.988758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.988839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.989086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:38.989372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.004105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:39.004699 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:39.007347 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:39.007641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:39.010199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.010509 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.011655 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.011964 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.013099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:39.013382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.013468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:39.013678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.013772 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.014072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.020065 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.020914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.022058 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:39.022363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:39.024938 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.025251 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.025334 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.025601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.025681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.025880 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.025962 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.026188 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.033578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:39.033874 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.033968 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:39.034154 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.034236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.034483 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.041571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:39.041856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.041966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 01:21:39.042137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.042255 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.042414 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.042540 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.042699 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.042821 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.042998 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.043132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.043258 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.043426 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.043540 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.043688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.043812 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.043971 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.044098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.044245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.044379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.044532 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.044650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.044817 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.044899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.045091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.045172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.045360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.045673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 01:21:39.079420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d25e9959c0 pid: 81421 (default app) Sep 26 01:21:39.080055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d25e9959c0 pid: 81422 (default app) Sep 26 01:21:39.082787 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5eb1e6-d1a2-4721-a2f0-7f7e626254f7 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:39.083093 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5eb1e6-d1a2-4721-a2f0-7f7e626254f7 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:39.083461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5eb1e6-d1a2-4721-a2f0-7f7e626254f7 None None] PATH_INFO: `/v3` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:39.087596 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Mon Sep 26 01:21:39 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:21:45.800257 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f906a8c-f5f7-4b90-a760-6aa687132149 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:45.800776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f906a8c-f5f7-4b90-a760-6aa687132149 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:45.800776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f906a8c-f5f7-4b90-a760-6aa687132149 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:45.805102 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:21:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:21:45.810697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195da36-e8b6-4db1-bb30-ffb902cae4c9 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:45.811142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195da36-e8b6-4db1-bb30-ffb902cae4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:45.811279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195da36-e8b6-4db1-bb30-ffb902cae4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:45.881638 dv-cinder-859203-2-smb devstack@keystone.service[81421]: INFO dbcounter [None req-c195da36-e8b6-4db1-bb30-ffb902cae4c9 None None] Registered counter for database keystone Sep 26 01:21:45.901520 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG oslo_db.sqlalchemy.engines [None req-c195da36-e8b6-4db1-bb30-ffb902cae4c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 01:21:45.907590 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writer thread running {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 01:21:46.090374 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG passlib.handlers.bcrypt [None req-c195da36-e8b6-4db1-bb30-ffb902cae4c9 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81421) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 26 01:21:46.090746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG passlib.handlers.bcrypt [None req-c195da36-e8b6-4db1-bb30-ffb902cae4c9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81421) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 26 01:21:46.152716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-c195da36-e8b6-4db1-bb30-ffb902cae4c9 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:21:46.154557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c195da36-e8b6-4db1-bb30-ffb902cae4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:21:46.282504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:21:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 26 01:21:46.712061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f906a8c-f5f7-4b90-a760-6aa687132149 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:46.781332 dv-cinder-859203-2-smb devstack@keystone.service[81422]: INFO dbcounter [None req-4f906a8c-f5f7-4b90-a760-6aa687132149 None None] Registered counter for database keystone Sep 26 01:21:46.803464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG oslo_db.sqlalchemy.engines [None req-4f906a8c-f5f7-4b90-a760-6aa687132149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 01:21:46.809515 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writer thread running {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 01:21:46.925871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f906a8c-f5f7-4b90-a760-6aa687132149 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:46.930364 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400bb09-b47d-47d5-8020-4ed3804db714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:46.931011 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400bb09-b47d-47d5-8020-4ed3804db714 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:46.931288 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400bb09-b47d-47d5-8020-4ed3804db714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:46.931552 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400bb09-b47d-47d5-8020-4ed3804db714 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:46.939551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400bb09-b47d-47d5-8020-4ed3804db714 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:46.991562 dv-cinder-859203-2-smb devstack@keystone.service[81422]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1400bb09-b47d-47d5-8020-4ed3804db714 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 26 01:21:46.991906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400bb09-b47d-47d5-8020-4ed3804db714 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:47.001241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Mon Sep 26 01:21:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 01:21:47.008443 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195da36-e8b6-4db1-bb30-ffb902cae4c9 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:47.026320 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195da36-e8b6-4db1-bb30-ffb902cae4c9 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:47.030693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf40be0-0762-4a48-abff-456ba90bf546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:47.031835 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf40be0-0762-4a48-abff-456ba90bf546 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:47.032115 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf40be0-0762-4a48-abff-456ba90bf546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:47.032385 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf40be0-0762-4a48-abff-456ba90bf546 admin admin] PATH_INFO: `/v3/projects/4ba2dacdbbb943beb977f1070136e466` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:47.033948 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf40be0-0762-4a48-abff-456ba90bf546 admin admin] RBAC: Authorizing `identity:get_project(project_id=4ba2dacdbbb943beb977f1070136e466)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:47.087966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: WARNING keystone.common.rbac_enforcer.enforcer [None req-adf40be0-0762-4a48-abff-456ba90bf546 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 26 01:21:47.088311 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf40be0-0762-4a48-abff-456ba90bf546 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:47.092838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Mon Sep 26 01:21:47 2022] GET /identity/v3/projects/4ba2dacdbbb943beb977f1070136e466 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:21:49.222568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6f261-74ab-44ed-b2ff-8bd631cc7b74 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:49.223167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6f261-74ab-44ed-b2ff-8bd631cc7b74 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:49.223167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6f261-74ab-44ed-b2ff-8bd631cc7b74 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:49.227263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:21:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:21:49.232729 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c007012-393b-49cc-b69b-82f5c72283c5 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:49.233116 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c007012-393b-49cc-b69b-82f5c72283c5 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:49.233284 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c007012-393b-49cc-b69b-82f5c72283c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:49.253679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-4c007012-393b-49cc-b69b-82f5c72283c5 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:21:49.255922 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4c007012-393b-49cc-b69b-82f5c72283c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:21:49.263638 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:21:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 26 01:21:49.530625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6f261-74ab-44ed-b2ff-8bd631cc7b74 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:49.543333 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6f261-74ab-44ed-b2ff-8bd631cc7b74 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:49.547567 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d50caf-73c7-46f3-960c-65b09426cdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:49.548158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d50caf-73c7-46f3-960c-65b09426cdd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:49.548441 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d50caf-73c7-46f3-960c-65b09426cdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:49.548714 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d50caf-73c7-46f3-960c-65b09426cdd0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:49.556350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d50caf-73c7-46f3-960c-65b09426cdd0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:49.558101 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d50caf-73c7-46f3-960c-65b09426cdd0 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:49.567270 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Mon Sep 26 01:21:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 01:21:49.572898 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c007012-393b-49cc-b69b-82f5c72283c5 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:49.581773 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c007012-393b-49cc-b69b-82f5c72283c5 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:49.586699 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3b9a1-f889-4cef-a85d-96c6f0e830ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:49.587339 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3b9a1-f889-4cef-a85d-96c6f0e830ad admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:49.587617 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3b9a1-f889-4cef-a85d-96c6f0e830ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:49.587886 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3b9a1-f889-4cef-a85d-96c6f0e830ad admin admin] PATH_INFO: `/v3/users/025ba57ed41d495b9ce978e22dc2973b` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:49.589170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3b9a1-f889-4cef-a85d-96c6f0e830ad admin admin] RBAC: Authorizing `identity:get_user(user_id=025ba57ed41d495b9ce978e22dc2973b)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:49.590989 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3b9a1-f889-4cef-a85d-96c6f0e830ad admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:49.592482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Mon Sep 26 01:21:49 2022] GET /identity/v3/users/025ba57ed41d495b9ce978e22dc2973b => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:21:51.803097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970f1f3-62cf-4571-ba48-3f82bbb55918 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:51.803641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970f1f3-62cf-4571-ba48-3f82bbb55918 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:51.803641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970f1f3-62cf-4571-ba48-3f82bbb55918 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:51.804964 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:21:51.810053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b860a-b029-4ecd-9284-91e30eaedca4 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:51.810458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b860a-b029-4ecd-9284-91e30eaedca4 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:51.810603 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b860a-b029-4ecd-9284-91e30eaedca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:51.821746 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd553b96-6f55-4ded-8547-f5b8e376e9f9 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:51.822027 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd553b96-6f55-4ded-8547-f5b8e376e9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:51.822301 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd553b96-6f55-4ded-8547-f5b8e376e9f9 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:51.823603 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:21:51.828586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb7e24-fb0f-4ede-babe-4ee805ab2e71 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:51.828868 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb7e24-fb0f-4ede-babe-4ee805ab2e71 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:51.829141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb7e24-fb0f-4ede-babe-4ee805ab2e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:51.829370 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-400b860a-b029-4ecd-9284-91e30eaedca4 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:21:51.830550 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-400b860a-b029-4ecd-9284-91e30eaedca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:21:51.870763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG passlib.handlers.bcrypt [None req-91eb7e24-fb0f-4ede-babe-4ee805ab2e71 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81422) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 26 01:21:51.871172 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG passlib.handlers.bcrypt [None req-91eb7e24-fb0f-4ede-babe-4ee805ab2e71 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81422) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 26 01:21:51.912676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:21:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:21:51.920400 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-91eb7e24-fb0f-4ede-babe-4ee805ab2e71 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:21:51.921978 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-91eb7e24-fb0f-4ede-babe-4ee805ab2e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:21:52.021920 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:21:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:21:52.187112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b860a-b029-4ecd-9284-91e30eaedca4 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:52.212746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:21:52.294330 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b860a-b029-4ecd-9284-91e30eaedca4 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:52.307762 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb7e24-fb0f-4ede-babe-4ee805ab2e71 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:52.328407 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d695e96-f2fa-4183-b74b-a0d617632b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:52.329043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d695e96-f2fa-4183-b74b-a0d617632b40 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:52.329323 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d695e96-f2fa-4183-b74b-a0d617632b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:52.329600 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d695e96-f2fa-4183-b74b-a0d617632b40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:52.341195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d695e96-f2fa-4183-b74b-a0d617632b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:21:52.350712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-3d695e96-f2fa-4183-b74b-a0d617632b40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:21:52.350712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:21:52.350712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:21:52.350712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:21:52.350712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:21:52.350712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:21:52.350712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:21:52.350712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:21:52.350712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:21:52.350712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:21:52.350712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:21:52.350712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:21:52.350712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:21:52.350712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:21:52.350712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:21:52.350712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:21:52.351838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:21:52.351838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:21:52.351838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:21:52.351838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:21:52.351838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:21:52.351838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:21:52.351838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:21:52.351838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:21:52.351838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:21:52.351838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:21:52.351838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:21:52.351838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:21:52.351838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:21:52.351838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:21:52.351838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:21:52.351838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:21:52.352777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:21:52.352777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:21:52.352777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:21:52.352777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:21:52.352777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:21:52.352777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:21:52.352777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:21:52.352777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:21:52.352777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:21:52.352777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:21:52.352777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:21:52.352777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:21:52.352777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:21:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:21:52.357539 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d695e96-f2fa-4183-b74b-a0d617632b40 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:52.414570 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb7e24-fb0f-4ede-babe-4ee805ab2e71 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:52.416937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:21:52.440839 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:21:52.454502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84846e79-48e9-44e7-bbba-1bb4d779b1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:52.455481 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84846e79-48e9-44e7-bbba-1bb4d779b1ee None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:52.455832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84846e79-48e9-44e7-bbba-1bb4d779b1ee None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:52.456175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84846e79-48e9-44e7-bbba-1bb4d779b1ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:52.460304 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d695e96-f2fa-4183-b74b-a0d617632b40 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:52.494277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaee0ca-6280-4405-ab0e-70bba89775ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:52.494903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaee0ca-6280-4405-ab0e-70bba89775ee None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:52.495186 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaee0ca-6280-4405-ab0e-70bba89775ee None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:52.495459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaee0ca-6280-4405-ab0e-70bba89775ee None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:52.496117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaee0ca-6280-4405-ab0e-70bba89775ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:21:52.496420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaee0ca-6280-4405-ab0e-70bba89775ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:52.497805 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaee0ca-6280-4405-ab0e-70bba89775ee None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:52.509316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:21:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:21:52.515073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaee0ca-6280-4405-ab0e-70bba89775ee None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:52.523311 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84846e79-48e9-44e7-bbba-1bb4d779b1ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:52.524857 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84846e79-48e9-44e7-bbba-1bb4d779b1ee None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:52.612872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaee0ca-6280-4405-ab0e-70bba89775ee None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:52.621166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:21:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 01:21:52.626669 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84846e79-48e9-44e7-bbba-1bb4d779b1ee None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:52.629353 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:21:52.652273 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71774818-701b-43aa-8a59-98cba629c4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:52.652906 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71774818-701b-43aa-8a59-98cba629c4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:52.653197 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71774818-701b-43aa-8a59-98cba629c4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:52.653472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71774818-701b-43aa-8a59-98cba629c4e1 None admin] PATH_INFO: `/v3/users/025ba57ed41d495b9ce978e22dc2973b` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:52.654623 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71774818-701b-43aa-8a59-98cba629c4e1 None admin] RBAC: Authorizing `identity:get_user(user_id=025ba57ed41d495b9ce978e22dc2973b)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:52.656135 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71774818-701b-43aa-8a59-98cba629c4e1 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:52.657690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:21:52 2022] GET /identity/v3/users/025ba57ed41d495b9ce978e22dc2973b => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:21:52.663720 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71774818-701b-43aa-8a59-98cba629c4e1 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:52.678319 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:21:52.725332 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84846e79-48e9-44e7-bbba-1bb4d779b1ee None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:52.757885 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe87676-ff1c-4499-be13-a067c5354f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:52.758723 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe87676-ff1c-4499-be13-a067c5354f4c None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:52.759055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe87676-ff1c-4499-be13-a067c5354f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:52.759311 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe87676-ff1c-4499-be13-a067c5354f4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:52.761644 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71774818-701b-43aa-8a59-98cba629c4e1 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:52.777372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe87676-ff1c-4499-be13-a067c5354f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:52.778875 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe87676-ff1c-4499-be13-a067c5354f4c None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:52.795592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f4085-853e-4918-bc11-6d6ef3b215f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:52.796204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f4085-853e-4918-bc11-6d6ef3b215f8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:52.796480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f4085-853e-4918-bc11-6d6ef3b215f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:52.796746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f4085-853e-4918-bc11-6d6ef3b215f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:52.797535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-2fe87676-ff1c-4499-be13-a067c5354f4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:21:52.797535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:21:52.797535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:21:52.797535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:21:52.797535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:21:52.797535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:21:52.797535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:21:52.797535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:21:52.797535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:21:52.797535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:21:52.797535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:21:52.797535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:21:52.797535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:21:52.797535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:21:52.797535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:21:52.797535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:21:52.798450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:21:52.798450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:21:52.798450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:21:52.798450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:21:52.798450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:21:52.798450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:21:52.798450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:21:52.798450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:21:52.798450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:21:52.798450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:21:52.798450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:21:52.798450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:21:52.798450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:21:52.798450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:21:52.798450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:21:52.798450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:21:52.798450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:21:52.799292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:21:52.799292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:21:52.799292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:21:52.799446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f4085-853e-4918-bc11-6d6ef3b215f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:52.799516 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 9/18] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:21:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:21:52.799588 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f4085-853e-4918-bc11-6d6ef3b215f8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:52.801363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 10/19] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:21:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:21:52.805223 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe87676-ff1c-4499-be13-a067c5354f4c None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:52.807003 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f4085-853e-4918-bc11-6d6ef3b215f8 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:52.859037 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:21:52.886449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:21:52.904801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe87676-ff1c-4499-be13-a067c5354f4c None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:52.905348 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f4085-853e-4918-bc11-6d6ef3b215f8 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:52.937887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e771b-fba5-4dc8-9542-228b65bda9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:52.938288 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c17af-2641-4e0d-bbb6-e01a010560be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:52.938484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e771b-fba5-4dc8-9542-228b65bda9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:52.938767 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e771b-fba5-4dc8-9542-228b65bda9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:52.938917 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c17af-2641-4e0d-bbb6-e01a010560be None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:52.939071 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e771b-fba5-4dc8-9542-228b65bda9e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:52.939196 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c17af-2641-4e0d-bbb6-e01a010560be None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:52.939469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c17af-2641-4e0d-bbb6-e01a010560be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:52.939713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e771b-fba5-4dc8-9542-228b65bda9e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:21:52.940018 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e771b-fba5-4dc8-9542-228b65bda9e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:52.940177 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c17af-2641-4e0d-bbb6-e01a010560be None admin] RBAC: Adding query filter params (role.id=50adf18edc1a47b2bae0876828a88dbf, scope.domain.id=default, user.id=025ba57ed41d495b9ce978e22dc2973b) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:21:52.940482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c17af-2641-4e0d-bbb6-e01a010560be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:52.941487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e771b-fba5-4dc8-9542-228b65bda9e1 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:52.941933 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c17af-2641-4e0d-bbb6-e01a010560be None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:52.948653 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1322 bytes} [Mon Sep 26 01:21:52 2022] GET /identity/v3/role_assignments?user.id=025ba57ed41d495b9ce978e22dc2973b&scope.domain.id=default&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:21:52.959915 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:21:55.460203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585798c-4fdc-4167-b190-7a95248881ca None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:55.461170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585798c-4fdc-4167-b190-7a95248881ca None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:55.461701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585798c-4fdc-4167-b190-7a95248881ca None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:55.463271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:21:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:21:55.468739 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc06a5-0453-4351-a778-2abdab5707bb None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:55.469184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc06a5-0453-4351-a778-2abdab5707bb None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:55.469264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc06a5-0453-4351-a778-2abdab5707bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:55.496795 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-9ccc06a5-0453-4351-a778-2abdab5707bb None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:21:55.498004 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-9ccc06a5-0453-4351-a778-2abdab5707bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:21:55.506740 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676940e-2117-4bbf-87c6-69492af56d2a None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:55.507423 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676940e-2117-4bbf-87c6-69492af56d2a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:55.507908 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676940e-2117-4bbf-87c6-69492af56d2a None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:55.509745 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 13/23] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:21:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:21:55.515604 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392186bb-cdcc-49cc-8925-80e9f921467e None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:55.516136 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392186bb-cdcc-49cc-8925-80e9f921467e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:55.516628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392186bb-cdcc-49cc-8925-80e9f921467e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:55.551999 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-392186bb-cdcc-49cc-8925-80e9f921467e None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:21:55.553557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-392186bb-cdcc-49cc-8925-80e9f921467e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:21:55.602020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 11/24] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:21:55.697878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 14/25] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:21:55.813752 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c8b8e-86d4-4172-a6a9-be1ffe2b55af None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:55.814289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c8b8e-86d4-4172-a6a9-be1ffe2b55af None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:55.814714 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c8b8e-86d4-4172-a6a9-be1ffe2b55af None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:55.816927 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 12/26] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:21:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:21:55.822512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0171bd-c673-40a8-8b22-d99f43d35ded None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:55.823077 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0171bd-c673-40a8-8b22-d99f43d35ded None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:55.823572 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0171bd-c673-40a8-8b22-d99f43d35ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:55.846046 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-af0171bd-c673-40a8-8b22-d99f43d35ded None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:21:55.848094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-af0171bd-c673-40a8-8b22-d99f43d35ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:21:55.939162 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 15/27] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:21:56.083785 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fd486-d7d8-4cf7-b032-7014a63ca9ee None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:56.084533 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fd486-d7d8-4cf7-b032-7014a63ca9ee None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:56.085015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fd486-d7d8-4cf7-b032-7014a63ca9ee None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:56.086577 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 13/28] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:21:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:21:56.087805 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0171bd-c673-40a8-8b22-d99f43d35ded None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:56.091948 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef207cd-23ad-4306-a16c-03de8052507f None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:56.092474 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef207cd-23ad-4306-a16c-03de8052507f None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:56.092946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef207cd-23ad-4306-a16c-03de8052507f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:56.101224 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:21:56.125735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-4ef207cd-23ad-4306-a16c-03de8052507f None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:21:56.126946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4ef207cd-23ad-4306-a16c-03de8052507f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:21:56.198793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:21:56.237464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 14/29] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:21:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:21:56.239818 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef207cd-23ad-4306-a16c-03de8052507f None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:56.356881 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0171bd-c673-40a8-8b22-d99f43d35ded None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:56.394665 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef207cd-23ad-4306-a16c-03de8052507f None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:56.440850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c757c7-e051-4d60-83de-03eaafb7585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:56.442006 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c757c7-e051-4d60-83de-03eaafb7585e None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:56.442286 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c757c7-e051-4d60-83de-03eaafb7585e None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:56.442562 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c757c7-e051-4d60-83de-03eaafb7585e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:56.451348 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b00e67-5754-45a5-a10f-2f609ebedc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:56.451983 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b00e67-5754-45a5-a10f-2f609ebedc46 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:56.452261 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b00e67-5754-45a5-a10f-2f609ebedc46 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:56.452533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b00e67-5754-45a5-a10f-2f609ebedc46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:56.464086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c757c7-e051-4d60-83de-03eaafb7585e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:56.465576 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c757c7-e051-4d60-83de-03eaafb7585e None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:56.468807 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b00e67-5754-45a5-a10f-2f609ebedc46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:21:56.474263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-94b00e67-5754-45a5-a10f-2f609ebedc46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:21:56.474263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:21:56.474263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:21:56.474263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:21:56.474263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:21:56.474263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:21:56.474263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:21:56.474263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:21:56.474263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:21:56.474263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:21:56.474263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:21:56.474263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:21:56.474263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:21:56.474263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:21:56.474263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:21:56.474263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:21:56.475184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:21:56.475184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:21:56.475184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:21:56.475184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:21:56.475184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:21:56.475184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:21:56.475184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:21:56.475184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:21:56.475184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:21:56.475184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:21:56.475184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:21:56.475184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:21:56.475184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:21:56.475184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:21:56.475184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:21:56.475184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:21:56.476519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:21:56.476519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:21:56.476519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:21:56.476519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:21:56.476519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:21:56.476519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:21:56.476519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:21:56.476519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:21:56.476519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:21:56.476519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:21:56.476519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:21:56.476519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:21:56.476519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 16/30] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:21:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:21:56.476519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b00e67-5754-45a5-a10f-2f609ebedc46 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:56.508923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-f2c757c7-e051-4d60-83de-03eaafb7585e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:21:56.508923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:21:56.508923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:21:56.508923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:21:56.508923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:21:56.508923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:21:56.508923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:21:56.508923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:21:56.508923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:21:56.508923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:21:56.508923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:21:56.508923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:21:56.508923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:21:56.508923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:21:56.508923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:21:56.508923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:21:56.510175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:21:56.510175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:21:56.510175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:21:56.510175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:21:56.510175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:21:56.510175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:21:56.510175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:21:56.510175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:21:56.510175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:21:56.510175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:21:56.510175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:21:56.510175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:21:56.510175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:21:56.510175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:21:56.510175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:21:56.510175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:21:56.510175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:21:56.511586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:21:56.511586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:21:56.511586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:21:56.511586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 15/31] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:21:56.512820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c757c7-e051-4d60-83de-03eaafb7585e None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:56.569763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:21:56.586672 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:21:56.640767 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b00e67-5754-45a5-a10f-2f609ebedc46 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:56.668582 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c757c7-e051-4d60-83de-03eaafb7585e None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:56.679223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb44dbe-f728-4b85-93d3-f9748125f5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:56.680162 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb44dbe-f728-4b85-93d3-f9748125f5ba None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:56.680645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb44dbe-f728-4b85-93d3-f9748125f5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:56.681135 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb44dbe-f728-4b85-93d3-f9748125f5ba None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:56.682019 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb44dbe-f728-4b85-93d3-f9748125f5ba None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:56.683880 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb44dbe-f728-4b85-93d3-f9748125f5ba None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:56.710985 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a438e3-9bde-4870-8087-e10dec216560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:56.711604 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a438e3-9bde-4870-8087-e10dec216560 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:56.711889 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a438e3-9bde-4870-8087-e10dec216560 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:56.712165 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a438e3-9bde-4870-8087-e10dec216560 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:56.712837 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a438e3-9bde-4870-8087-e10dec216560 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:21:56.713144 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a438e3-9bde-4870-8087-e10dec216560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:56.714535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a438e3-9bde-4870-8087-e10dec216560 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:56.730383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 16/32] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:21:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:21:56.732338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a438e3-9bde-4870-8087-e10dec216560 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:56.830515 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:21:56.842645 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a438e3-9bde-4870-8087-e10dec216560 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:56.854016 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 17/33] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Sep 26 01:21:56 2022] POST /identity/v3/roles => generated 219 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:21:56.855508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb44dbe-f728-4b85-93d3-f9748125f5ba None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:56.890440 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aefcb8-e9dc-4c7c-a663-a950cf02590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:56.891202 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aefcb8-e9dc-4c7c-a663-a950cf02590d None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:56.891424 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aefcb8-e9dc-4c7c-a663-a950cf02590d None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:56.891703 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aefcb8-e9dc-4c7c-a663-a950cf02590d None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:56.892372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aefcb8-e9dc-4c7c-a663-a950cf02590d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:21:56.892677 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aefcb8-e9dc-4c7c-a663-a950cf02590d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:56.895057 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aefcb8-e9dc-4c7c-a663-a950cf02590d None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:56.910663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 17/34] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:21:56.911429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aefcb8-e9dc-4c7c-a663-a950cf02590d None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:56.987571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb44dbe-f728-4b85-93d3-f9748125f5ba None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:57.018499 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:21:57.051649 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4033d3e-2448-4eae-90bb-1c606864ccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:57.052958 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4033d3e-2448-4eae-90bb-1c606864ccb2 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:57.053449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4033d3e-2448-4eae-90bb-1c606864ccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:57.053966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4033d3e-2448-4eae-90bb-1c606864ccb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:57.054993 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4033d3e-2448-4eae-90bb-1c606864ccb2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:57.059301 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aefcb8-e9dc-4c7c-a663-a950cf02590d None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:57.059597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4033d3e-2448-4eae-90bb-1c606864ccb2 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:57.100484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 18/35] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Sep 26 01:21:56 2022] POST /identity/v3/roles => generated 225 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:21:57.101830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4033d3e-2448-4eae-90bb-1c606864ccb2 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:57.103811 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80106766-03c6-49d6-815b-53f14dad3388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:57.103811 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80106766-03c6-49d6-815b-53f14dad3388 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:57.103811 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80106766-03c6-49d6-815b-53f14dad3388 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:57.104089 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80106766-03c6-49d6-815b-53f14dad3388 None admin] PATH_INFO: `/v3/users/025ba57ed41d495b9ce978e22dc2973b` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:57.105600 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80106766-03c6-49d6-815b-53f14dad3388 None admin] RBAC: Authorizing `identity:get_user(user_id=025ba57ed41d495b9ce978e22dc2973b)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:57.107096 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80106766-03c6-49d6-815b-53f14dad3388 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:57.109025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 18/36] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:21:56 2022] GET /identity/v3/users/025ba57ed41d495b9ce978e22dc2973b => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:21:57.115859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80106766-03c6-49d6-815b-53f14dad3388 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:57.141483 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:21:57.252160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80106766-03c6-49d6-815b-53f14dad3388 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:57.309217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c80d4-923a-4f70-8094-5fef65087cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:57.310326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c80d4-923a-4f70-8094-5fef65087cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:57.310865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c80d4-923a-4f70-8094-5fef65087cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:57.311556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c80d4-923a-4f70-8094-5fef65087cd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:57.314661 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c80d4-923a-4f70-8094-5fef65087cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:57.316735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c80d4-923a-4f70-8094-5fef65087cd2 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:57.319060 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 19/37] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:21:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:21:57.320960 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d7b0f-28e3-4978-8b15-cb61397256ea None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:57.326435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d7b0f-28e3-4978-8b15-cb61397256ea None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:57.327349 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d7b0f-28e3-4978-8b15-cb61397256ea None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:57.327734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4033d3e-2448-4eae-90bb-1c606864ccb2 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:57.329302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 20/38] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:21:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:21:57.330414 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d7b0f-28e3-4978-8b15-cb61397256ea None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:57.382723 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09265ea-f98b-472c-9d94-4a523a06475d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:57.383455 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09265ea-f98b-472c-9d94-4a523a06475d None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:57.383858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09265ea-f98b-472c-9d94-4a523a06475d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:57.384339 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09265ea-f98b-472c-9d94-4a523a06475d None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:57.385803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09265ea-f98b-472c-9d94-4a523a06475d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:57.387134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09265ea-f98b-472c-9d94-4a523a06475d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:57.435613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 26 01:21:57 2022] POST /identity/v3/projects => generated 301 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:21:57.437868 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9d6ff-e6cb-415f-8345-9b23be7cd8e6 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:57.438555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9d6ff-e6cb-415f-8345-9b23be7cd8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:57.439043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9d6ff-e6cb-415f-8345-9b23be7cd8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:57.455936 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:21:57.468435 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-5ba9d6ff-e6cb-415f-8345-9b23be7cd8e6 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:21:57.470398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5ba9d6ff-e6cb-415f-8345-9b23be7cd8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:21:57.479112 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d7b0f-28e3-4978-8b15-cb61397256ea None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:57.523429 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:21:57.525339 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec5b84-07ae-4a47-a413-474dabcec36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:57.526056 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec5b84-07ae-4a47-a413-474dabcec36f None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:57.526761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec5b84-07ae-4a47-a413-474dabcec36f None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:57.527236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec5b84-07ae-4a47-a413-474dabcec36f None admin] PATH_INFO: `/v3/domains/default/users/025ba57ed41d495b9ce978e22dc2973b/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:57.532754 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec5b84-07ae-4a47-a413-474dabcec36f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=025ba57ed41d495b9ce978e22dc2973b, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:57.534237 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec5b84-07ae-4a47-a413-474dabcec36f None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:57.600450 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 20/40] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:21:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:21:57.688162 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 21/41] 10.222.0.26 () {58 vars in 1361 bytes} [Mon Sep 26 01:21:57 2022] PUT /identity/v3/domains/default/users/025ba57ed41d495b9ce978e22dc2973b/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:21:57.739621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580dabc-98f3-41e4-b296-5470615b19e3 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:57.740043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580dabc-98f3-41e4-b296-5470615b19e3 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:57.740453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580dabc-98f3-41e4-b296-5470615b19e3 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:57.742556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 21/42] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:21:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:21:57.751751 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad84c06-a6ab-418a-9110-0c217672e5a8 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:57.752238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad84c06-a6ab-418a-9110-0c217672e5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:57.752714 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad84c06-a6ab-418a-9110-0c217672e5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:57.777130 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-bad84c06-a6ab-418a-9110-0c217672e5a8 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:21:57.778699 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-bad84c06-a6ab-418a-9110-0c217672e5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:21:57.855337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 22/43] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:21:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:21:57.887760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580dabc-98f3-41e4-b296-5470615b19e3 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:57.994799 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580dabc-98f3-41e4-b296-5470615b19e3 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:58.031541 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e9118-c17f-41d6-8a27-d0a8a7fa68bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:58.032426 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e9118-c17f-41d6-8a27-d0a8a7fa68bf None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:58.032847 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e9118-c17f-41d6-8a27-d0a8a7fa68bf None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:58.033264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e9118-c17f-41d6-8a27-d0a8a7fa68bf None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:58.034092 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e9118-c17f-41d6-8a27-d0a8a7fa68bf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:58.036148 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e9118-c17f-41d6-8a27-d0a8a7fa68bf None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:58.053004 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 22/44] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Sep 26 01:21:57 2022] POST /identity/v3/roles => generated 223 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:21:58.135925 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad84c06-a6ab-418a-9110-0c217672e5a8 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:58.220816 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:21:58.249693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad84c06-a6ab-418a-9110-0c217672e5a8 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:58.286644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24088b7-6442-423b-b131-049ee3d8b603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:58.287334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24088b7-6442-423b-b131-049ee3d8b603 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:58.287614 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24088b7-6442-423b-b131-049ee3d8b603 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:58.287892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24088b7-6442-423b-b131-049ee3d8b603 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:58.288994 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24088b7-6442-423b-b131-049ee3d8b603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:58.290644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24088b7-6442-423b-b131-049ee3d8b603 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:58.295126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 23/45] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:21:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:21:58.301249 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e9118-c17f-41d6-8a27-d0a8a7fa68bf None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:21:58.434230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:21:58.510714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e9118-c17f-41d6-8a27-d0a8a7fa68bf None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:21:58.543613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553d1da-0d0d-4b3c-9ecf-6c32675e882e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:21:58.544212 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553d1da-0d0d-4b3c-9ecf-6c32675e882e None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:58.544492 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553d1da-0d0d-4b3c-9ecf-6c32675e882e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:58.544764 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553d1da-0d0d-4b3c-9ecf-6c32675e882e None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:58.545401 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553d1da-0d0d-4b3c-9ecf-6c32675e882e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:21:58.546864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553d1da-0d0d-4b3c-9ecf-6c32675e882e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:21:58.573338 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 26 01:21:58 2022] POST /identity/v3/projects => generated 312 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:21:59.862386 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71f67d-1ae1-41d8-a812-054d1cdbd621 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:59.863502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71f67d-1ae1-41d8-a812-054d1cdbd621 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:59.863502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71f67d-1ae1-41d8-a812-054d1cdbd621 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:59.864825 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 24/47] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:21:59.869919 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532aa44-2fc2-4e28-a5c1-398dd1b944e8 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:21:59.870334 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532aa44-2fc2-4e28-a5c1-398dd1b944e8 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:21:59.870450 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532aa44-2fc2-4e28-a5c1-398dd1b944e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:21:59.888805 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-f532aa44-2fc2-4e28-a5c1-398dd1b944e8 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:21:59.890337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f532aa44-2fc2-4e28-a5c1-398dd1b944e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:21:59.954530 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 24/48] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:00.231912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71f67d-1ae1-41d8-a812-054d1cdbd621 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:00.333534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71f67d-1ae1-41d8-a812-054d1cdbd621 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:00.366027 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9357c-f221-4642-92aa-fa7572232728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:00.366650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9357c-f221-4642-92aa-fa7572232728 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:00.366962 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9357c-f221-4642-92aa-fa7572232728 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:00.367235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9357c-f221-4642-92aa-fa7572232728 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:00.378979 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9357c-f221-4642-92aa-fa7572232728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:00.384982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-c3f9357c-f221-4642-92aa-fa7572232728 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:00.384982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:00.384982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:00.384982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:00.384982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:00.384982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:00.384982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:00.384982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:00.384982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:00.384982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:00.384982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:00.384982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:00.384982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:00.384982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:00.384982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:00.384982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:00.385794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:00.385794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:00.385794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:00.385794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:00.385794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:00.385794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:00.385794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:00.385794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:00.385794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:00.385794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:00.385794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:00.385794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:00.385794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:00.385794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:00.385794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:00.385794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:00.386534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:00.386534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:00.386534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:00.386534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:00.386534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:00.386534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:00.386534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:00.386534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:00.386534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:00.386534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:00.386534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:00.386534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:00.386534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 25/49] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:22:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:22:00.391869 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532aa44-2fc2-4e28-a5c1-398dd1b944e8 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:00.402784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:00.489945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532aa44-2fc2-4e28-a5c1-398dd1b944e8 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:00.522381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d952415-8397-42b8-b55d-90234fb03889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:00.523011 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d952415-8397-42b8-b55d-90234fb03889 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:00.523292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d952415-8397-42b8-b55d-90234fb03889 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:00.523564 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d952415-8397-42b8-b55d-90234fb03889 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:00.524221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d952415-8397-42b8-b55d-90234fb03889 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:00.524526 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d952415-8397-42b8-b55d-90234fb03889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:00.525886 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d952415-8397-42b8-b55d-90234fb03889 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:00.533845 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 25/50] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:00.539679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9357c-f221-4642-92aa-fa7572232728 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:00.543595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:00.641097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9357c-f221-4642-92aa-fa7572232728 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:00.674549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e9c8b-6d98-4ca2-921c-e54c61769c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:00.675197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e9c8b-6d98-4ca2-921c-e54c61769c9a None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:00.675515 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e9c8b-6d98-4ca2-921c-e54c61769c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:00.675789 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e9c8b-6d98-4ca2-921c-e54c61769c9a None admin] PATH_INFO: `/v3/users/025ba57ed41d495b9ce978e22dc2973b` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:00.676988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e9c8b-6d98-4ca2-921c-e54c61769c9a None admin] RBAC: Authorizing `identity:get_user(user_id=025ba57ed41d495b9ce978e22dc2973b)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:00.678418 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e9c8b-6d98-4ca2-921c-e54c61769c9a None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:00.680009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 26/51] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:00 2022] GET /identity/v3/users/025ba57ed41d495b9ce978e22dc2973b => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:00.685387 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d952415-8397-42b8-b55d-90234fb03889 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:00.726922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43735a1d-4fcf-4136-8934-1c90a3a7dda1 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:00.727204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43735a1d-4fcf-4136-8934-1c90a3a7dda1 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:00.727488 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43735a1d-4fcf-4136-8934-1c90a3a7dda1 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:00.728805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 27/52] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:22:00.733820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c369-9ab4-4ee4-9036-d5e349922f3f None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:00.734116 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c369-9ab4-4ee4-9036-d5e349922f3f None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:00.734401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c369-9ab4-4ee4-9036-d5e349922f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:00.752214 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-cb12c369-9ab4-4ee4-9036-d5e349922f3f None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:00.753337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-cb12c369-9ab4-4ee4-9036-d5e349922f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:00.754515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:00.786533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d952415-8397-42b8-b55d-90234fb03889 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:00.820130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2bde1-8ebe-4584-9466-f8fe2da1d793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:00.820840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 28/53] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:22:00.821083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2bde1-8ebe-4584-9466-f8fe2da1d793 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:00.821373 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2bde1-8ebe-4584-9466-f8fe2da1d793 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:00.821648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2bde1-8ebe-4584-9466-f8fe2da1d793 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:00.822851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2bde1-8ebe-4584-9466-f8fe2da1d793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:00.824302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2bde1-8ebe-4584-9466-f8fe2da1d793 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:00.825970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 26/54] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:22:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:00.831649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12c369-9ab4-4ee4-9036-d5e349922f3f None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:00.834031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:01.035721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12c369-9ab4-4ee4-9036-d5e349922f3f None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:01.070026 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cde455-4580-4aad-b9f0-4dd49584776e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:01.070904 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cde455-4580-4aad-b9f0-4dd49584776e None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:01.071184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cde455-4580-4aad-b9f0-4dd49584776e None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:01.071456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cde455-4580-4aad-b9f0-4dd49584776e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:01.072180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cde455-4580-4aad-b9f0-4dd49584776e None admin] RBAC: Adding query filter params (role.id=50adf18edc1a47b2bae0876828a88dbf, scope.domain.id=default, user.id=025ba57ed41d495b9ce978e22dc2973b) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:01.072487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cde455-4580-4aad-b9f0-4dd49584776e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:01.073908 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cde455-4580-4aad-b9f0-4dd49584776e None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:01.081676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 29/55] 10.222.0.26 () {56 vars in 1322 bytes} [Mon Sep 26 01:22:00 2022] GET /identity/v3/role_assignments?user.id=025ba57ed41d495b9ce978e22dc2973b&scope.domain.id=default&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 530 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:01.090761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2bde1-8ebe-4584-9466-f8fe2da1d793 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:01.201867 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2bde1-8ebe-4584-9466-f8fe2da1d793 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:01.238635 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fdda9-1e30-44e8-8a17-f93b3b1e05a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:01.239308 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fdda9-1e30-44e8-8a17-f93b3b1e05a1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:01.239592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fdda9-1e30-44e8-8a17-f93b3b1e05a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:01.239869 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fdda9-1e30-44e8-8a17-f93b3b1e05a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:01.241010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fdda9-1e30-44e8-8a17-f93b3b1e05a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:01.242490 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fdda9-1e30-44e8-8a17-f93b3b1e05a1 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:01.244103 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 27/56] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:22:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:01.249748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cde455-4580-4aad-b9f0-4dd49584776e None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:01.316731 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:01.352207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cde455-4580-4aad-b9f0-4dd49584776e None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:01.384222 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b140f-a116-4973-81c9-c1d23582c828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:01.384824 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b140f-a116-4973-81c9-c1d23582c828 None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:01.385110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b140f-a116-4973-81c9-c1d23582c828 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:01.385387 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b140f-a116-4973-81c9-c1d23582c828 None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:01.386025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b140f-a116-4973-81c9-c1d23582c828 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:01.387508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b140f-a116-4973-81c9-c1d23582c828 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:01.417863 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 30/57] 10.222.0.26 () {60 vars in 1140 bytes} [Mon Sep 26 01:22:01 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:22:03.553913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e10f64-2adb-4f0f-8ec9-1d5fc857718d None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:03.554422 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e10f64-2adb-4f0f-8ec9-1d5fc857718d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:03.554506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e10f64-2adb-4f0f-8ec9-1d5fc857718d None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:03.555810 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 28/58] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:03.560996 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4df60-7dc7-4eca-ae6d-8fc4e2b8facf None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:03.561386 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4df60-7dc7-4eca-ae6d-8fc4e2b8facf None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:03.561576 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4df60-7dc7-4eca-ae6d-8fc4e2b8facf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:03.580464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-3bd4df60-7dc7-4eca-ae6d-8fc4e2b8facf None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:03.581679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-3bd4df60-7dc7-4eca-ae6d-8fc4e2b8facf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:03.645531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 31/59] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:03.914391 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e10f64-2adb-4f0f-8ec9-1d5fc857718d None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:03.924333 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:04.014576 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e10f64-2adb-4f0f-8ec9-1d5fc857718d None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:04.046849 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05cd36-ae2a-4456-81cd-1a694e39ef28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:04.047482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05cd36-ae2a-4456-81cd-1a694e39ef28 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:04.047763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05cd36-ae2a-4456-81cd-1a694e39ef28 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:04.048036 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05cd36-ae2a-4456-81cd-1a694e39ef28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:04.049139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05cd36-ae2a-4456-81cd-1a694e39ef28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:04.050569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05cd36-ae2a-4456-81cd-1a694e39ef28 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:04.052202 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 29/60] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:22:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:04.057655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4df60-7dc7-4eca-ae6d-8fc4e2b8facf None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:04.107062 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:04.156427 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4df60-7dc7-4eca-ae6d-8fc4e2b8facf None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:04.189178 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1baf5-d47e-4631-a28a-6732786ec124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:04.189742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1baf5-d47e-4631-a28a-6732786ec124 None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:04.190024 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1baf5-d47e-4631-a28a-6732786ec124 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:04.190297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1baf5-d47e-4631-a28a-6732786ec124 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:04.191630 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1baf5-d47e-4631-a28a-6732786ec124 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:04.193075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1baf5-d47e-4631-a28a-6732786ec124 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:04.219203 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 32/61] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 26 01:22:04 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:22:07.440503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a5247-fe38-454c-b510-2b8f3482bc7b None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:07.443724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a5247-fe38-454c-b510-2b8f3482bc7b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:07.443724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a5247-fe38-454c-b510-2b8f3482bc7b None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:07.444240 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 30/62] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:07.449122 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a64472-428f-4444-92d5-c4d51c22de8b None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:07.449919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a64472-428f-4444-92d5-c4d51c22de8b None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:07.450419 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a64472-428f-4444-92d5-c4d51c22de8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:07.476116 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-a6a64472-428f-4444-92d5-c4d51c22de8b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:07.477648 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a6a64472-428f-4444-92d5-c4d51c22de8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:07.547898 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 33/63] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:07.748023 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a72f04-151e-4237-bd2c-777afe66b1c1 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:07.748559 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a72f04-151e-4237-bd2c-777afe66b1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:07.748951 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a72f04-151e-4237-bd2c-777afe66b1c1 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:07.750654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 31/64] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:07.760721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe059c-fd77-42f0-b72e-3df895563e6a None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:07.761289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe059c-fd77-42f0-b72e-3df895563e6a None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:07.761765 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe059c-fd77-42f0-b72e-3df895563e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:07.781954 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd2df6-9c23-4526-af19-e306267b495a None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:07.782706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd2df6-9c23-4526-af19-e306267b495a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:07.783245 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd2df6-9c23-4526-af19-e306267b495a None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:07.785028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-01fe059c-fd77-42f0-b72e-3df895563e6a None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:07.785552 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 32/65] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:07.788743 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-01fe059c-fd77-42f0-b72e-3df895563e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:07.792203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259d89d-e23b-448a-b814-a4de88af153d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:07.792726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259d89d-e23b-448a-b814-a4de88af153d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:07.793200 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259d89d-e23b-448a-b814-a4de88af153d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:07.814222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-a259d89d-e23b-448a-b814-a4de88af153d None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:07.816310 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a259d89d-e23b-448a-b814-a4de88af153d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:07.834204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:07.913082 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 34/66] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:07.945125 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 33/67] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:22:07.964616 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe059c-fd77-42f0-b72e-3df895563e6a None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:08.136070 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a314e-e3bb-4cfe-99b9-dce90053fd62 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:08.136426 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a314e-e3bb-4cfe-99b9-dce90053fd62 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:08.136935 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a314e-e3bb-4cfe-99b9-dce90053fd62 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:08.138462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 34/68] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:08.143505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931ced0-6d49-4df9-bc30-8830ae4196c2 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:08.144166 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931ced0-6d49-4df9-bc30-8830ae4196c2 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:08.144664 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931ced0-6d49-4df9-bc30-8830ae4196c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:08.147028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe059c-fd77-42f0-b72e-3df895563e6a None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:08.179200 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:08.188364 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a9156-20c0-4c77-aac4-7089e85031d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:08.189412 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a9156-20c0-4c77-aac4-7089e85031d6 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:08.191240 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a9156-20c0-4c77-aac4-7089e85031d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:08.193271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-4931ced0-6d49-4df9-bc30-8830ae4196c2 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:08.194375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a9156-20c0-4c77-aac4-7089e85031d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:08.196750 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4931ced0-6d49-4df9-bc30-8830ae4196c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:08.220304 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a9156-20c0-4c77-aac4-7089e85031d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:08.234517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-488a9156-20c0-4c77-aac4-7089e85031d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:08.234517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:08.234517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:08.234517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:08.234517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:08.234517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:08.234517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:08.234517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:08.234517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:08.234517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:08.234517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:08.234517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:08.234517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:08.234517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:08.234517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:08.234517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:08.235507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:08.235507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:08.235507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:08.235507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:08.235507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:08.235507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:08.235507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:08.235507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:08.235507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:08.235507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:08.235507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:08.235507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:08.235507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:08.235507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:08.235507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:08.235507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:08.236280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:08.236280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:08.236280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:08.236280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:08.236280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:08.236280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:08.236280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:08.236280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:08.236280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:08.236280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:08.236280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:08.236280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:08.237342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 35/69] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:08.238400 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a9156-20c0-4c77-aac4-7089e85031d6 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:08.272132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:08.317143 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 35/70] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:08.320619 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931ced0-6d49-4df9-bc30-8830ae4196c2 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:08.385612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a9156-20c0-4c77-aac4-7089e85031d6 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:08.433950 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a8cab-79f6-4ffa-b4c0-42a5428e7b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:08.434802 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a8cab-79f6-4ffa-b4c0-42a5428e7b92 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:08.435142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931ced0-6d49-4df9-bc30-8830ae4196c2 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:08.435264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a8cab-79f6-4ffa-b4c0-42a5428e7b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:08.435540 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a8cab-79f6-4ffa-b4c0-42a5428e7b92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:08.453164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a8cab-79f6-4ffa-b4c0-42a5428e7b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:08.459429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-e76a8cab-79f6-4ffa-b4c0-42a5428e7b92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:08.459429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:08.459429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:08.459429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:08.459429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:08.459429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:08.459429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:08.459429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:08.459429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:08.459429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:08.459429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:08.459429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:08.459429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:08.459429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:08.459429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:08.459429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:08.460334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:08.460334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:08.460334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:08.460334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:08.460334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:08.460334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:08.460334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:08.460334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:08.460334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:08.460334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:08.460334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:08.460334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:08.460334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:08.460334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:08.460334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:08.460334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:08.461085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:08.461085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:08.461085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:08.461085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:08.461085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:08.461085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:08.461085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:08.461085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:08.461085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:08.461085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:08.461085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:08.461085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:08.461085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 36/71] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:22:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:08.462637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a8cab-79f6-4ffa-b4c0-42a5428e7b92 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:08.478633 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee0591-cca0-4908-9f68-e413e4bbca2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:08.479387 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee0591-cca0-4908-9f68-e413e4bbca2a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:08.479562 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee0591-cca0-4908-9f68-e413e4bbca2a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:08.479835 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee0591-cca0-4908-9f68-e413e4bbca2a None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:08.480500 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee0591-cca0-4908-9f68-e413e4bbca2a None admin] RBAC: Adding query filter params (name=member) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:08.480805 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee0591-cca0-4908-9f68-e413e4bbca2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:08.482171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee0591-cca0-4908-9f68-e413e4bbca2a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:08.483549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:08.492478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 36/72] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:08.493484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a192b9-3a4a-4fc5-b3ff-89a62c5690a3 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:08.493766 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a192b9-3a4a-4fc5-b3ff-89a62c5690a3 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:08.494037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a192b9-3a4a-4fc5-b3ff-89a62c5690a3 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:08.499081 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 37/73] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:08.499081 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a192b9-3a4a-4fc5-b3ff-89a62c5690a3 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:08.565012 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:08.584302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a8cab-79f6-4ffa-b4c0-42a5428e7b92 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:08.604242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a192b9-3a4a-4fc5-b3ff-89a62c5690a3 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:08.622009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae1dce-eb26-4faf-9eb8-49efcba9c0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:08.622641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae1dce-eb26-4faf-9eb8-49efcba9c0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:08.622960 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae1dce-eb26-4faf-9eb8-49efcba9c0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:08.623241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae1dce-eb26-4faf-9eb8-49efcba9c0e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:08.633853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae1dce-eb26-4faf-9eb8-49efcba9c0e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:08.637928 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971ecb4-dc5f-44fc-8724-1143b980ad00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:08.638527 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971ecb4-dc5f-44fc-8724-1143b980ad00 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:08.638653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-90ae1dce-eb26-4faf-9eb8-49efcba9c0e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:08.638653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:08.638653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:08.638653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:08.638653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:08.638653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:08.638653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:08.638653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:08.638653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:08.638653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:08.638653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:08.638653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:08.638653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:08.638653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:08.638653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:08.638653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:08.639491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:08.639491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:08.639491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:08.639491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:08.639491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:08.639491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:08.639491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:08.639491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:08.639491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:08.639491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:08.639491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:08.639491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:08.639491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:08.639491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:08.639491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:08.639491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:08.640238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:08.640238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:08.640238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:08.640238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:08.640238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:08.640238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:08.640238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:08.640238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:08.640238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:08.640238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:08.640238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:08.640238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:08.640803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971ecb4-dc5f-44fc-8724-1143b980ad00 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:08.640803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971ecb4-dc5f-44fc-8724-1143b980ad00 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:08.640803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971ecb4-dc5f-44fc-8724-1143b980ad00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:08.640983 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 37/74] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:22:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:08.641047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971ecb4-dc5f-44fc-8724-1143b980ad00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:08.641109 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae1dce-eb26-4faf-9eb8-49efcba9c0e5 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:08.641743 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971ecb4-dc5f-44fc-8724-1143b980ad00 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:08.650695 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 38/75] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:22:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:08.651766 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db19e2-cc88-42a2-9823-8677797c4902 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:08.652047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db19e2-cc88-42a2-9823-8677797c4902 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:08.652317 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db19e2-cc88-42a2-9823-8677797c4902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:08.670730 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-43db19e2-cc88-42a2-9823-8677797c4902 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:08.671861 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-43db19e2-cc88-42a2-9823-8677797c4902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:08.725673 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:08.740532 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 39/76] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:08.741359 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db19e2-cc88-42a2-9823-8677797c4902 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:08.741905 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae1dce-eb26-4faf-9eb8-49efcba9c0e5 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:08.777195 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c8309-f4ce-4819-a9f4-fd3be75567f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:08.777837 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c8309-f4ce-4819-a9f4-fd3be75567f8 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:08.778120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c8309-f4ce-4819-a9f4-fd3be75567f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:08.778397 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c8309-f4ce-4819-a9f4-fd3be75567f8 None admin] PATH_INFO: `/v3/users/b2f67764a6de42e7a7e7f61340796c3b` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:08.794021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c8309-f4ce-4819-a9f4-fd3be75567f8 None admin] RBAC: Authorizing `identity:get_user(user_id=b2f67764a6de42e7a7e7f61340796c3b)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:08.795511 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c8309-f4ce-4819-a9f4-fd3be75567f8 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:08.802272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 38/77] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:08 2022] GET /identity/v3/users/b2f67764a6de42e7a7e7f61340796c3b => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:08.802272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c8309-f4ce-4819-a9f4-fd3be75567f8 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:08.805499 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:08.861131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db19e2-cc88-42a2-9823-8677797c4902 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:08.899622 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95015b80-8b5e-4039-846b-7bf626f3d130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:08.900517 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95015b80-8b5e-4039-846b-7bf626f3d130 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:08.900801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95015b80-8b5e-4039-846b-7bf626f3d130 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:08.901324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95015b80-8b5e-4039-846b-7bf626f3d130 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:08.907619 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c8309-f4ce-4819-a9f4-fd3be75567f8 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:08.914643 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95015b80-8b5e-4039-846b-7bf626f3d130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:08.922142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-95015b80-8b5e-4039-846b-7bf626f3d130 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:08.922142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:08.922142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:08.922142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:08.922142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:08.922142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:08.922142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:08.922142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:08.922142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:08.922142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:08.922142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:08.922142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:08.922142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:08.922142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:08.922142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:08.922142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:08.923147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:08.923147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:08.923147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:08.923147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:08.923147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:08.923147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:08.923147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:08.923147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:08.923147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:08.923147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:08.923147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:08.923147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:08.923147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:08.923147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:08.923147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:08.923147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:08.923930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:08.923930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:08.923930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:08.923930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:08.923930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:08.923930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:08.923930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:08.923930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:08.923930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:08.923930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:08.923930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:08.923930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:08.924505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 40/78] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:08.925774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95015b80-8b5e-4039-846b-7bf626f3d130 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:08.950511 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53209f-d24d-4ef8-853d-d21a0bec2887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:08.951164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53209f-d24d-4ef8-853d-d21a0bec2887 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:08.951449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53209f-d24d-4ef8-853d-d21a0bec2887 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:08.951730 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53209f-d24d-4ef8-853d-d21a0bec2887 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:08.952391 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53209f-d24d-4ef8-853d-d21a0bec2887 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:08.952701 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53209f-d24d-4ef8-853d-d21a0bec2887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:08.954061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53209f-d24d-4ef8-853d-d21a0bec2887 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:08.962487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 39/79] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:08.967634 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53209f-d24d-4ef8-853d-d21a0bec2887 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:08.977923 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:09.030565 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:09.030890 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95015b80-8b5e-4039-846b-7bf626f3d130 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:09.065150 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949248ff-14b0-4edd-9f4f-d37496d9f29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:09.066743 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949248ff-14b0-4edd-9f4f-d37496d9f29e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:09.067047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949248ff-14b0-4edd-9f4f-d37496d9f29e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:09.067324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949248ff-14b0-4edd-9f4f-d37496d9f29e None admin] PATH_INFO: `/v3/users/b2f67764a6de42e7a7e7f61340796c3b` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:09.068472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949248ff-14b0-4edd-9f4f-d37496d9f29e None admin] RBAC: Authorizing `identity:get_user(user_id=b2f67764a6de42e7a7e7f61340796c3b)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:09.069925 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949248ff-14b0-4edd-9f4f-d37496d9f29e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:09.071073 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53209f-d24d-4ef8-853d-d21a0bec2887 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:09.071787 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 41/80] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:08 2022] GET /identity/v3/users/b2f67764a6de42e7a7e7f61340796c3b => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:09.076878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949248ff-14b0-4edd-9f4f-d37496d9f29e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:09.105519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9ac4d-044a-4b88-9c07-c5744a7a268c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:09.106127 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9ac4d-044a-4b88-9c07-c5744a7a268c None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:09.106411 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9ac4d-044a-4b88-9c07-c5744a7a268c None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:09.106686 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9ac4d-044a-4b88-9c07-c5744a7a268c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:09.172546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9ac4d-044a-4b88-9c07-c5744a7a268c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:09.173921 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9ac4d-044a-4b88-9c07-c5744a7a268c None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:09.174041 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949248ff-14b0-4edd-9f4f-d37496d9f29e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:09.190671 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:09.208438 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0d1f2-9913-42b5-b79b-2d5e21360886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:09.209038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0d1f2-9913-42b5-b79b-2d5e21360886 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:09.209321 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0d1f2-9913-42b5-b79b-2d5e21360886 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:09.209591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0d1f2-9913-42b5-b79b-2d5e21360886 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:09.210241 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0d1f2-9913-42b5-b79b-2d5e21360886 None admin] RBAC: Adding query filter params (name=member) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:09.210538 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0d1f2-9913-42b5-b79b-2d5e21360886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:09.211924 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0d1f2-9913-42b5-b79b-2d5e21360886 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:09.219650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 42/81] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:09.220423 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0d1f2-9913-42b5-b79b-2d5e21360886 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:09.236320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:09.276289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 40/82] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:22:09.281599 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9ac4d-044a-4b88-9c07-c5744a7a268c None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:09.319717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0d1f2-9913-42b5-b79b-2d5e21360886 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:09.352806 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a898f-6c55-489c-90e5-2c49aafea1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:09.353434 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a898f-6c55-489c-90e5-2c49aafea1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:09.353718 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a898f-6c55-489c-90e5-2c49aafea1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:09.353996 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a898f-6c55-489c-90e5-2c49aafea1e7 None admin] PATH_INFO: `/v3/users/025ba57ed41d495b9ce978e22dc2973b` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:09.355151 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a898f-6c55-489c-90e5-2c49aafea1e7 None admin] RBAC: Authorizing `identity:get_user(user_id=025ba57ed41d495b9ce978e22dc2973b)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:09.356598 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a898f-6c55-489c-90e5-2c49aafea1e7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:09.358167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 43/83] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:09 2022] GET /identity/v3/users/025ba57ed41d495b9ce978e22dc2973b => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:09.358951 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a898f-6c55-489c-90e5-2c49aafea1e7 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:09.381232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9ac4d-044a-4b88-9c07-c5744a7a268c None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:09.413568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:09.420679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cedca-54d0-4e69-8db4-522ce8cae547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:09.421309 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cedca-54d0-4e69-8db4-522ce8cae547 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:09.421590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cedca-54d0-4e69-8db4-522ce8cae547 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:09.421867 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cedca-54d0-4e69-8db4-522ce8cae547 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:09.423064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cedca-54d0-4e69-8db4-522ce8cae547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:09.424446 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cedca-54d0-4e69-8db4-522ce8cae547 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:09.426570 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 41/84] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:22:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:09.427362 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cedca-54d0-4e69-8db4-522ce8cae547 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:09.457545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:09.473402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a898f-6c55-489c-90e5-2c49aafea1e7 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:09.506994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb2760-cff8-4a98-8816-00313cfbac0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:09.507603 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb2760-cff8-4a98-8816-00313cfbac0f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:09.507882 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb2760-cff8-4a98-8816-00313cfbac0f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:09.508156 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb2760-cff8-4a98-8816-00313cfbac0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:09.524756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cedca-54d0-4e69-8db4-522ce8cae547 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:09.558045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078a5f5-b357-47fd-b114-1dabb20e4242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:09.558665 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078a5f5-b357-47fd-b114-1dabb20e4242 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:09.558979 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078a5f5-b357-47fd-b114-1dabb20e4242 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:09.559259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078a5f5-b357-47fd-b114-1dabb20e4242 None admin] PATH_INFO: `/v3/users/b2f67764a6de42e7a7e7f61340796c3b` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:09.560416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078a5f5-b357-47fd-b114-1dabb20e4242 None admin] RBAC: Authorizing `identity:get_user(user_id=b2f67764a6de42e7a7e7f61340796c3b)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:09.561820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078a5f5-b357-47fd-b114-1dabb20e4242 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:09.563641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 42/85] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:09 2022] GET /identity/v3/users/b2f67764a6de42e7a7e7f61340796c3b => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:09.564337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078a5f5-b357-47fd-b114-1dabb20e4242 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:09.579930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb2760-cff8-4a98-8816-00313cfbac0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:09.581383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb2760-cff8-4a98-8816-00313cfbac0f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:09.624868 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:09.661003 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:09.664398 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078a5f5-b357-47fd-b114-1dabb20e4242 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:09.678726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 44/86] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:22:09.679526 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb2760-cff8-4a98-8816-00313cfbac0f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:09.702360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1043d-eefd-4c2d-a695-c8e9ce4067dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:09.703035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1043d-eefd-4c2d-a695-c8e9ce4067dd None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:09.703320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1043d-eefd-4c2d-a695-c8e9ce4067dd None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:09.703604 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1043d-eefd-4c2d-a695-c8e9ce4067dd None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:09.704735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1043d-eefd-4c2d-a695-c8e9ce4067dd None admin] RBAC: Authorizing `identity:get_project(project_id=def6cb215c3c45f2a54435c338e667ab)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:09.706689 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1043d-eefd-4c2d-a695-c8e9ce4067dd None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:09.708633 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 43/87] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:09 2022] GET /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:09.709379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1043d-eefd-4c2d-a695-c8e9ce4067dd None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:09.778921 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb2760-cff8-4a98-8816-00313cfbac0f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:09.808388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1043d-eefd-4c2d-a695-c8e9ce4067dd None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:09.813337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cc257-1f8c-4195-a83d-45d64281878c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:09.813946 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cc257-1f8c-4195-a83d-45d64281878c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:09.814228 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cc257-1f8c-4195-a83d-45d64281878c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:09.814501 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cc257-1f8c-4195-a83d-45d64281878c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:09.830037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:09.842370 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a8bfa-ac16-4c99-980f-01fc32903b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:09.843000 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a8bfa-ac16-4c99-980f-01fc32903b63 None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:09.843284 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a8bfa-ac16-4c99-980f-01fc32903b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:09.843559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a8bfa-ac16-4c99-980f-01fc32903b63 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:09.844202 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a8bfa-ac16-4c99-980f-01fc32903b63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:09.845610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a8bfa-ac16-4c99-980f-01fc32903b63 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:09.866636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 44/88] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 26 01:22:09 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:22:09.867472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a8bfa-ac16-4c99-980f-01fc32903b63 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:09.890251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cc257-1f8c-4195-a83d-45d64281878c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:09.891934 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cc257-1f8c-4195-a83d-45d64281878c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:09.897558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:09.985982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a8bfa-ac16-4c99-980f-01fc32903b63 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:10.009389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 45/89] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:22:10.010141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cc257-1f8c-4195-a83d-45d64281878c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:10.031801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9d8a0-2146-4815-bb6b-1a90e66553a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:10.032422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9d8a0-2146-4815-bb6b-1a90e66553a1 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:10.032712 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9d8a0-2146-4815-bb6b-1a90e66553a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:10.033467 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9d8a0-2146-4815-bb6b-1a90e66553a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:10.066688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:10.119719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9d8a0-2146-4815-bb6b-1a90e66553a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:10.121207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9d8a0-2146-4815-bb6b-1a90e66553a1 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:10.136323 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cc257-1f8c-4195-a83d-45d64281878c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:10.164142 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:10.185731 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80ea13-712d-4ab5-80d8-60e0a12e8e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:10.186820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80ea13-712d-4ab5-80d8-60e0a12e8e4c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:10.187207 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80ea13-712d-4ab5-80d8-60e0a12e8e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:10.187758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80ea13-712d-4ab5-80d8-60e0a12e8e4c None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:10.189069 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80ea13-712d-4ab5-80d8-60e0a12e8e4c None admin] RBAC: Authorizing `identity:get_project(project_id=def6cb215c3c45f2a54435c338e667ab)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:10.192144 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80ea13-712d-4ab5-80d8-60e0a12e8e4c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:10.194189 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 46/90] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:10 2022] GET /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:10.195219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80ea13-712d-4ab5-80d8-60e0a12e8e4c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:10.252279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 45/91] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:22:10.253616 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9d8a0-2146-4815-bb6b-1a90e66553a1 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:10.303778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80ea13-712d-4ab5-80d8-60e0a12e8e4c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:10.319788 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:10.342260 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cb755-7358-4cd7-aa87-b6e77779f820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:10.345690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cb755-7358-4cd7-aa87-b6e77779f820 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:10.346199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cb755-7358-4cd7-aa87-b6e77779f820 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:10.346670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cb755-7358-4cd7-aa87-b6e77779f820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:10.347697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201cb755-7358-4cd7-aa87-b6e77779f820 None admin] RBAC: Adding query filter params (role.id=f4df3a7a4c0b4730abc0601e2b072ef4, scope.project.id=def6cb215c3c45f2a54435c338e667ab, user.id=b2f67764a6de42e7a7e7f61340796c3b) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:10.348210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201cb755-7358-4cd7-aa87-b6e77779f820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:10.349856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201cb755-7358-4cd7-aa87-b6e77779f820 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:10.356055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 47/92] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:22:10 2022] GET /identity/v3/role_assignments?user.id=b2f67764a6de42e7a7e7f61340796c3b&scope.project.id=def6cb215c3c45f2a54435c338e667ab&role.id=f4df3a7a4c0b4730abc0601e2b072ef4 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:10.357082 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cb755-7358-4cd7-aa87-b6e77779f820 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:10.401992 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9d8a0-2146-4815-bb6b-1a90e66553a1 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:10.459225 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:10.480993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef01e8-7bf2-467d-940a-bee8ba0523a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:10.481655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef01e8-7bf2-467d-940a-bee8ba0523a2 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:10.481940 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef01e8-7bf2-467d-940a-bee8ba0523a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:10.482222 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef01e8-7bf2-467d-940a-bee8ba0523a2 None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:10.483543 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef01e8-7bf2-467d-940a-bee8ba0523a2 None admin] RBAC: Authorizing `identity:get_project(project_id=def6cb215c3c45f2a54435c338e667ab)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:10.485024 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef01e8-7bf2-467d-940a-bee8ba0523a2 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:10.488541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 46/93] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:10 2022] GET /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:10.489382 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef01e8-7bf2-467d-940a-bee8ba0523a2 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:10.579530 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cb755-7358-4cd7-aa87-b6e77779f820 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:10.619742 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98cefb-cfd3-435e-9a7a-4d0ff8086e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:10.620493 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98cefb-cfd3-435e-9a7a-4d0ff8086e91 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:10.620776 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98cefb-cfd3-435e-9a7a-4d0ff8086e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:10.621048 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98cefb-cfd3-435e-9a7a-4d0ff8086e91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:10.621777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98cefb-cfd3-435e-9a7a-4d0ff8086e91 None admin] RBAC: Adding query filter params (role.id=e1504eb5f35c468086d3b269e2c72011, scope.project.id=def6cb215c3c45f2a54435c338e667ab, user.id=b2f67764a6de42e7a7e7f61340796c3b) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:10.622084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98cefb-cfd3-435e-9a7a-4d0ff8086e91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:10.624236 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98cefb-cfd3-435e-9a7a-4d0ff8086e91 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:10.632182 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 48/94] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:22:10 2022] GET /identity/v3/role_assignments?user.id=b2f67764a6de42e7a7e7f61340796c3b&scope.project.id=def6cb215c3c45f2a54435c338e667ab&role.id=e1504eb5f35c468086d3b269e2c72011 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:10.633265 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98cefb-cfd3-435e-9a7a-4d0ff8086e91 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:10.650407 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef01e8-7bf2-467d-940a-bee8ba0523a2 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:10.745642 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d9812-a6c4-47a7-b2d3-7fad5dc4d0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:10.746341 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:10.746902 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d9812-a6c4-47a7-b2d3-7fad5dc4d0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:10.747374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d9812-a6c4-47a7-b2d3-7fad5dc4d0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:10.747851 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d9812-a6c4-47a7-b2d3-7fad5dc4d0e7 None admin] PATH_INFO: `/v3/projects/c63165c4c8a14361b9bc9a57446cbe33` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:10.753605 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d9812-a6c4-47a7-b2d3-7fad5dc4d0e7 None admin] RBAC: Authorizing `identity:get_project(project_id=c63165c4c8a14361b9bc9a57446cbe33)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:10.755685 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d9812-a6c4-47a7-b2d3-7fad5dc4d0e7 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:10.760504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 47/95] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:10 2022] GET /identity/v3/projects/c63165c4c8a14361b9bc9a57446cbe33 => generated 312 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:10.768794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d9812-a6c4-47a7-b2d3-7fad5dc4d0e7 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:10.878703 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98cefb-cfd3-435e-9a7a-4d0ff8086e91 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:10.895777 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:10.959584 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e6dbb-8bcf-484f-8af9-6239511c4835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:10.960209 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e6dbb-8bcf-484f-8af9-6239511c4835 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:10.960492 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e6dbb-8bcf-484f-8af9-6239511c4835 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:10.960769 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e6dbb-8bcf-484f-8af9-6239511c4835 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:10.961508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e6dbb-8bcf-484f-8af9-6239511c4835 None admin] RBAC: Adding query filter params (role.id=50adf18edc1a47b2bae0876828a88dbf, scope.project.id=def6cb215c3c45f2a54435c338e667ab, user.id=025ba57ed41d495b9ce978e22dc2973b) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:10.961817 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e6dbb-8bcf-484f-8af9-6239511c4835 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:10.963290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e6dbb-8bcf-484f-8af9-6239511c4835 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:10.974366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d9812-a6c4-47a7-b2d3-7fad5dc4d0e7 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:10.980308 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 49/96] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:22:10 2022] GET /identity/v3/role_assignments?user.id=025ba57ed41d495b9ce978e22dc2973b&scope.project.id=def6cb215c3c45f2a54435c338e667ab&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 259 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:11.038055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5776d8-9042-457f-bf70-3d28a9e98070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:11.038697 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5776d8-9042-457f-bf70-3d28a9e98070 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:11.039021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5776d8-9042-457f-bf70-3d28a9e98070 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:11.039303 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5776d8-9042-457f-bf70-3d28a9e98070 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:11.040071 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5776d8-9042-457f-bf70-3d28a9e98070 None admin] RBAC: Adding query filter params (role.id=f4df3a7a4c0b4730abc0601e2b072ef4, scope.project.id=c63165c4c8a14361b9bc9a57446cbe33, user.id=b2f67764a6de42e7a7e7f61340796c3b) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:11.040388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5776d8-9042-457f-bf70-3d28a9e98070 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:11.041980 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5776d8-9042-457f-bf70-3d28a9e98070 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:11.049001 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 48/97] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:22:10 2022] GET /identity/v3/role_assignments?user.id=b2f67764a6de42e7a7e7f61340796c3b&scope.project.id=c63165c4c8a14361b9bc9a57446cbe33&role.id=f4df3a7a4c0b4730abc0601e2b072ef4 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:12.901825 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc99d15-cc98-4cc6-b01f-fe3aa0a03a55 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:12.902350 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc99d15-cc98-4cc6-b01f-fe3aa0a03a55 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:12.902350 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc99d15-cc98-4cc6-b01f-fe3aa0a03a55 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:12.903848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 50/98] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:12.909834 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bf5f0-5988-4364-a35e-c628fb0e61af None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:12.910253 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bf5f0-5988-4364-a35e-c628fb0e61af None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:12.910482 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bf5f0-5988-4364-a35e-c628fb0e61af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:12.933073 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-8f8bf5f0-5988-4364-a35e-c628fb0e61af None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:12.934345 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-8f8bf5f0-5988-4364-a35e-c628fb0e61af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:13.012923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 49/99] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:22:13.171233 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea5164-95c2-4a15-b2e6-6fe0140de52f None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:13.171414 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea5164-95c2-4a15-b2e6-6fe0140de52f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:13.171701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea5164-95c2-4a15-b2e6-6fe0140de52f None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:13.173042 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 51/100] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:13.179050 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27067b9e-6ffe-4b2c-9613-681916ec3cc5 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:13.179342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27067b9e-6ffe-4b2c-9613-681916ec3cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:13.179624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27067b9e-6ffe-4b2c-9613-681916ec3cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:13.198952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-27067b9e-6ffe-4b2c-9613-681916ec3cc5 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:13.200138 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-27067b9e-6ffe-4b2c-9613-681916ec3cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:13.261320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:13.282853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 50/101] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:13.468279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00461d45-275c-47d4-a141-3dbdeafc920a None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:13.468563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00461d45-275c-47d4-a141-3dbdeafc920a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:13.469084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00461d45-275c-47d4-a141-3dbdeafc920a None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:13.470649 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 52/102] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:13.476615 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ad104-bf65-453c-b44f-d0717d1d06cc None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:13.477217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ad104-bf65-453c-b44f-d0717d1d06cc None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:13.477714 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ad104-bf65-453c-b44f-d0717d1d06cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:13.499586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-8c2ad104-bf65-453c-b44f-d0717d1d06cc None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:13.501084 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-8c2ad104-bf65-453c-b44f-d0717d1d06cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:13.586533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00461d45-275c-47d4-a141-3dbdeafc920a None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:13.591218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 51/103] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:13.698980 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ad104-bf65-453c-b44f-d0717d1d06cc None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:13.760204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00461d45-275c-47d4-a141-3dbdeafc920a None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:13.774703 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:13.852881 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dc29e-813e-42c2-a381-a2c6fe9f85a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:13.853530 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dc29e-813e-42c2-a381-a2c6fe9f85a0 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:13.853809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dc29e-813e-42c2-a381-a2c6fe9f85a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:13.854080 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dc29e-813e-42c2-a381-a2c6fe9f85a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:13.887813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dc29e-813e-42c2-a381-a2c6fe9f85a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:13.892682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-e81dc29e-813e-42c2-a381-a2c6fe9f85a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 01:22:13.892682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:13.892682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:13.892682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:13.892682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:13.892682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:13.892682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:13.892682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:13.892682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:13.892682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:13.892682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:13.892682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:13.892682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:13.892682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:13.892682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:13.892682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:13.893749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:13.893749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:13.893749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:13.893749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:13.893749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:13.893749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:13.893749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:13.893749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:13.893749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:13.893749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:13.893749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:13.893749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:13.893749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:13.893749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:13.893749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:13.893749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:13.894973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:13.894973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:13.894973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:13.894973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:13.894973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:13.894973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:13.894973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:13.894973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:13.894973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:13.894973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:13.894973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 01:22:13.894973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:13.894973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 53/104] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:22:13.897339 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ad104-bf65-453c-b44f-d0717d1d06cc None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:13.902852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dc29e-813e-42c2-a381-a2c6fe9f85a0 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:13.935529 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:13.957133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a70414-eda4-4038-b1b0-4fb55d14cce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:13.957945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a70414-eda4-4038-b1b0-4fb55d14cce0 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:13.958235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a70414-eda4-4038-b1b0-4fb55d14cce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:13.958517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a70414-eda4-4038-b1b0-4fb55d14cce0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:13.959708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a70414-eda4-4038-b1b0-4fb55d14cce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:13.961275 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a70414-eda4-4038-b1b0-4fb55d14cce0 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:13.962791 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 52/105] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:22:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:13.968173 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a70414-eda4-4038-b1b0-4fb55d14cce0 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:14.135110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dc29e-813e-42c2-a381-a2c6fe9f85a0 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:14.172661 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a70414-eda4-4038-b1b0-4fb55d14cce0 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:14.176553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cefc1-6939-419d-9340-c4f829dd5162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:14.177164 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cefc1-6939-419d-9340-c4f829dd5162 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:14.177442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cefc1-6939-419d-9340-c4f829dd5162 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:14.177713 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cefc1-6939-419d-9340-c4f829dd5162 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:14.178375 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cefc1-6939-419d-9340-c4f829dd5162 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:14.178674 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cefc1-6939-419d-9340-c4f829dd5162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:14.180084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cefc1-6939-419d-9340-c4f829dd5162 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:14.189383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 54/106] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:14.190096 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cefc1-6939-419d-9340-c4f829dd5162 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:14.214655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33559dcf-4878-4714-ada6-e5d562c1f2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:14.215310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33559dcf-4878-4714-ada6-e5d562c1f2f6 None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:14.215592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33559dcf-4878-4714-ada6-e5d562c1f2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:14.215871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33559dcf-4878-4714-ada6-e5d562c1f2f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:14.216538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33559dcf-4878-4714-ada6-e5d562c1f2f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:14.218184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33559dcf-4878-4714-ada6-e5d562c1f2f6 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:14.227957 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:14.250995 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 53/107] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 26 01:22:13 2022] POST /identity/v3/projects => generated 302 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:22:14.252686 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e9161-3646-4629-b2df-8575c416270e None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:14.253689 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e9161-3646-4629-b2df-8575c416270e None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:14.254016 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e9161-3646-4629-b2df-8575c416270e None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:14.259034 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 54/108] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:14.259034 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e9161-3646-4629-b2df-8575c416270e None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:14.301340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:14.319004 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cefc1-6939-419d-9340-c4f829dd5162 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:14.357144 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef977b78-2017-4397-b8cc-2f2e3cbfc502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:14.357806 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef977b78-2017-4397-b8cc-2f2e3cbfc502 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:14.358085 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef977b78-2017-4397-b8cc-2f2e3cbfc502 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:14.358363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef977b78-2017-4397-b8cc-2f2e3cbfc502 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:14.372832 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef977b78-2017-4397-b8cc-2f2e3cbfc502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:14.379865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-ef977b78-2017-4397-b8cc-2f2e3cbfc502 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:14.379865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:14.379865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:14.379865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:14.379865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:14.379865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:14.379865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:14.379865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:14.379865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:14.379865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:14.379865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:14.379865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:14.379865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:14.379865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:14.379865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:14.379865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:14.380830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:14.380830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:14.380830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:14.380830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:14.380830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:14.380830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:14.380830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:14.380830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:14.380830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:14.380830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:14.380830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:14.380830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:14.380830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:14.380830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:14.380830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:14.380830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:14.381675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:14.381675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:14.381675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:14.381675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:14.381675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:14.381675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:14.381675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:14.381675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:14.381675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:14.381675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:14.381675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:14.381675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:14.381675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 55/109] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:14.382309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624c18b-6a5e-46e9-be86-12a7d74fc619 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:14.382712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624c18b-6a5e-46e9-be86-12a7d74fc619 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:14.382798 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624c18b-6a5e-46e9-be86-12a7d74fc619 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:14.387292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 56/110] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:14.387292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5a057-6917-4f2a-8f3b-3e46a4033e99 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:14.387292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5a057-6917-4f2a-8f3b-3e46a4033e99 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:14.387292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5a057-6917-4f2a-8f3b-3e46a4033e99 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:14.387292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 57/111] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:14.388313 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8516d2-2193-4432-b103-ca5e6ab5f8b6 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:14.388597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8516d2-2193-4432-b103-ca5e6ab5f8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:14.388869 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8516d2-2193-4432-b103-ca5e6ab5f8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:14.391691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e9161-3646-4629-b2df-8575c416270e None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:14.414844 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-fa8516d2-2193-4432-b103-ca5e6ab5f8b6 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:14.416866 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-fa8516d2-2193-4432-b103-ca5e6ab5f8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:14.435205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c8bab-4288-413d-8326-9c8752514518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:14.436065 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c8bab-4288-413d-8326-9c8752514518 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:14.436496 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c8bab-4288-413d-8326-9c8752514518 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:14.436936 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c8bab-4288-413d-8326-9c8752514518 None admin] PATH_INFO: `/v3/users/62228de4885a400186e53d6cca6a30e2` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:14.452606 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c8bab-4288-413d-8326-9c8752514518 None admin] RBAC: Authorizing `identity:get_user(user_id=62228de4885a400186e53d6cca6a30e2)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:14.454060 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c8bab-4288-413d-8326-9c8752514518 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:14.455767 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 55/112] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:14 2022] GET /identity/v3/users/62228de4885a400186e53d6cca6a30e2 => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:14.457391 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c8bab-4288-413d-8326-9c8752514518 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:14.497918 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 58/113] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:14.499412 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b72c4-06d0-4a29-b00f-e59522b5b78e None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:14.499858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b72c4-06d0-4a29-b00f-e59522b5b78e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:14.500266 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b72c4-06d0-4a29-b00f-e59522b5b78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:14.520545 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-b61b72c4-06d0-4a29-b00f-e59522b5b78e None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:14.522216 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b61b72c4-06d0-4a29-b00f-e59522b5b78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:14.548514 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:14.561808 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:14.575512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c8bab-4288-413d-8326-9c8752514518 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:14.612292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48482e0d-ce18-4985-9031-a463ae1dbef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:14.613348 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48482e0d-ce18-4985-9031-a463ae1dbef6 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:14.613684 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48482e0d-ce18-4985-9031-a463ae1dbef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:14.613977 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48482e0d-ce18-4985-9031-a463ae1dbef6 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:14.614655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48482e0d-ce18-4985-9031-a463ae1dbef6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:14.615011 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48482e0d-ce18-4985-9031-a463ae1dbef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:14.616391 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48482e0d-ce18-4985-9031-a463ae1dbef6 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:14.616793 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 59/114] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:14.618279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879efa25-f6d3-4439-9f2e-9794e01b7759 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:14.618773 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879efa25-f6d3-4439-9f2e-9794e01b7759 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:14.619259 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879efa25-f6d3-4439-9f2e-9794e01b7759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:14.638421 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 56/115] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:14.643082 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48482e0d-ce18-4985-9031-a463ae1dbef6 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:14.645031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-879efa25-f6d3-4439-9f2e-9794e01b7759 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:14.646444 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-879efa25-f6d3-4439-9f2e-9794e01b7759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:14.727964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 60/116] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:14.729135 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879efa25-f6d3-4439-9f2e-9794e01b7759 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:14.830235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48482e0d-ce18-4985-9031-a463ae1dbef6 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:14.836627 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:14.871622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf54bd-2672-4512-9cb0-a433bd746b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:14.873348 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf54bd-2672-4512-9cb0-a433bd746b11 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:14.873849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf54bd-2672-4512-9cb0-a433bd746b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:14.874427 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf54bd-2672-4512-9cb0-a433bd746b11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:14.900980 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879efa25-f6d3-4439-9f2e-9794e01b7759 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:14.904043 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:14.956633 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf54bd-2672-4512-9cb0-a433bd746b11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:14.958997 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf54bd-2672-4512-9cb0-a433bd746b11 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:14.975746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510d9d5-7734-4218-ae60-c26cd66e319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:14.976370 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510d9d5-7734-4218-ae60-c26cd66e319a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:14.976654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510d9d5-7734-4218-ae60-c26cd66e319a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:14.976931 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510d9d5-7734-4218-ae60-c26cd66e319a None admin] PATH_INFO: `/v3/users/b2f67764a6de42e7a7e7f61340796c3b` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:14.978368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510d9d5-7734-4218-ae60-c26cd66e319a None admin] RBAC: Authorizing `identity:get_user(user_id=b2f67764a6de42e7a7e7f61340796c3b)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:14.979917 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510d9d5-7734-4218-ae60-c26cd66e319a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:14.981498 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 61/117] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:14 2022] GET /identity/v3/users/b2f67764a6de42e7a7e7f61340796c3b => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:14.982257 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510d9d5-7734-4218-ae60-c26cd66e319a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:15.093162 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510d9d5-7734-4218-ae60-c26cd66e319a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:15.093491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 57/118] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:22:15.094513 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf54bd-2672-4512-9cb0-a433bd746b11 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:15.129696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa641787-9fcc-4930-ad1c-20eb6657c0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:15.130683 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa641787-9fcc-4930-ad1c-20eb6657c0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:15.131212 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa641787-9fcc-4930-ad1c-20eb6657c0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:15.131670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa641787-9fcc-4930-ad1c-20eb6657c0d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:15.143175 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa641787-9fcc-4930-ad1c-20eb6657c0d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:15.148087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-fa641787-9fcc-4930-ad1c-20eb6657c0d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:15.148087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:15.148087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:15.148087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:15.148087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:15.148087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:15.148087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:15.148087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:15.148087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:15.148087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:15.148087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:15.148087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:15.148087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:15.148087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:15.148087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:15.148087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:15.149137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:15.149137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:15.149137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:15.149137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:15.149137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:15.149137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:15.149137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:15.149137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:15.149137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:15.149137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:15.149137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:15.149137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:15.149137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:15.149137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:15.149137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:15.149137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:15.150068 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:15.150068 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:15.150068 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:15.150068 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:15.150068 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:15.150068 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:15.150068 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:15.150068 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:15.150068 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:15.150068 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:15.150068 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:15.150068 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:15.150068 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 62/119] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:22:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:15.150876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa641787-9fcc-4930-ad1c-20eb6657c0d0 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:15.157987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:15.162344 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:15.208790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf54bd-2672-4512-9cb0-a433bd746b11 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:15.248391 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcfb67-6db4-4c4d-8ae4-61731f737aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:15.249191 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcfb67-6db4-4c4d-8ae4-61731f737aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:15.249477 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcfb67-6db4-4c4d-8ae4-61731f737aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:15.250099 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcfb67-6db4-4c4d-8ae4-61731f737aa2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:15.259194 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa641787-9fcc-4930-ad1c-20eb6657c0d0 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:15.261368 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcfb67-6db4-4c4d-8ae4-61731f737aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:15.266209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-b1fcfb67-6db4-4c4d-8ae4-61731f737aa2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:15.266209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:15.266209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:15.266209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:15.266209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:15.266209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:15.266209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:15.266209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:15.266209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:15.266209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:15.266209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:15.266209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:15.266209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:15.266209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:15.266209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:15.266209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:15.267093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:15.267093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:15.267093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:15.267093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:15.267093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:15.267093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:15.267093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:15.267093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:15.267093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:15.267093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:15.267093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:15.267093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:15.267093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:15.267093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:15.267093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:15.267093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:15.267892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:15.267892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:15.267892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:15.267892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:15.267892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:15.267892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:15.267892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:15.267892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:15.267892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:15.267892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:15.267892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:15.267892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:15.267892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 58/120] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:15.268577 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcfb67-6db4-4c4d-8ae4-61731f737aa2 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:15.301501 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49723fc7-b9ac-41a2-b022-17955af42d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:15.302135 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49723fc7-b9ac-41a2-b022-17955af42d5c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:15.302416 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49723fc7-b9ac-41a2-b022-17955af42d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:15.302697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49723fc7-b9ac-41a2-b022-17955af42d5c None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:15.303832 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49723fc7-b9ac-41a2-b022-17955af42d5c None admin] RBAC: Authorizing `identity:get_project(project_id=def6cb215c3c45f2a54435c338e667ab)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:15.305277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49723fc7-b9ac-41a2-b022-17955af42d5c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:15.307180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 63/121] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:15 2022] GET /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:15.307858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49723fc7-b9ac-41a2-b022-17955af42d5c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:15.377540 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcfb67-6db4-4c4d-8ae4-61731f737aa2 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:15.397685 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:15.399801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:15.421035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55477278-cc18-478c-b058-52e719b6befd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:15.421666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55477278-cc18-478c-b058-52e719b6befd None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:15.421947 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55477278-cc18-478c-b058-52e719b6befd None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:15.422219 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55477278-cc18-478c-b058-52e719b6befd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:15.422312 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49723fc7-b9ac-41a2-b022-17955af42d5c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:15.433755 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55477278-cc18-478c-b058-52e719b6befd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:15.438564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-55477278-cc18-478c-b058-52e719b6befd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:15.438564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:15.438564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:15.438564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:15.438564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:15.438564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:15.438564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:15.438564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:15.438564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:15.438564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:15.438564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:15.438564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:15.438564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:15.438564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:15.438564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:15.438564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:15.439502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:15.439502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:15.439502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:15.439502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:15.439502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:15.439502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:15.439502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:15.439502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:15.439502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:15.439502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:15.439502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:15.439502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:15.439502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:15.439502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:15.439502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:15.439502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:15.440322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:15.440322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:15.440322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:15.440322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:15.440322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:15.440322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:15.440322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:15.440322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:15.440322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:15.440322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:15.440322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:15.440322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:15.440322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 59/122] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:22:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:15.440947 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55477278-cc18-478c-b058-52e719b6befd None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:15.464320 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad43294-2e69-4a51-b996-f50afbf45ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:15.465392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad43294-2e69-4a51-b996-f50afbf45ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:15.465685 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad43294-2e69-4a51-b996-f50afbf45ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:15.465993 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad43294-2e69-4a51-b996-f50afbf45ff1 None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:15.467315 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad43294-2e69-4a51-b996-f50afbf45ff1 None admin] RBAC: Authorizing `identity:get_project(project_id=def6cb215c3c45f2a54435c338e667ab)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:15.468756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad43294-2e69-4a51-b996-f50afbf45ff1 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:15.470376 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 64/123] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:15 2022] GET /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:15.475695 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad43294-2e69-4a51-b996-f50afbf45ff1 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:15.556343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55477278-cc18-478c-b058-52e719b6befd None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:15.577939 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad43294-2e69-4a51-b996-f50afbf45ff1 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:15.595450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdfeec-ba75-4931-92ee-97c699778d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:15.596335 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdfeec-ba75-4931-92ee-97c699778d63 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:15.596651 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdfeec-ba75-4931-92ee-97c699778d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:15.596929 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdfeec-ba75-4931-92ee-97c699778d63 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:15.597735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdfeec-ba75-4931-92ee-97c699778d63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:15.598333 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdfeec-ba75-4931-92ee-97c699778d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:15.599739 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdfeec-ba75-4931-92ee-97c699778d63 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:15.613716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 60/124] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:22:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:15.613716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdfeec-ba75-4931-92ee-97c699778d63 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:15.620791 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a98479-ab97-4974-a8ee-b78c7c1f381d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:15.621527 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a98479-ab97-4974-a8ee-b78c7c1f381d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:15.621808 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a98479-ab97-4974-a8ee-b78c7c1f381d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:15.622080 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a98479-ab97-4974-a8ee-b78c7c1f381d None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:15.622753 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a98479-ab97-4974-a8ee-b78c7c1f381d None admin] RBAC: Adding query filter params (name=member) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:15.623260 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a98479-ab97-4974-a8ee-b78c7c1f381d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:15.624556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a98479-ab97-4974-a8ee-b78c7c1f381d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:15.633733 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 65/125] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:15.634352 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a98479-ab97-4974-a8ee-b78c7c1f381d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:15.639258 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:15.653854 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:15.723281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdfeec-ba75-4931-92ee-97c699778d63 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:15.747912 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a98479-ab97-4974-a8ee-b78c7c1f381d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:15.759828 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25713c-42c7-42fa-a1ea-8697a0916589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:15.760482 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25713c-42c7-42fa-a1ea-8697a0916589 None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:15.760771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25713c-42c7-42fa-a1ea-8697a0916589 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:15.761048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25713c-42c7-42fa-a1ea-8697a0916589 None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab/users/b2f67764a6de42e7a7e7f61340796c3b/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:15.762977 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25713c-42c7-42fa-a1ea-8697a0916589 None admin] RBAC: Authorizing `identity:create_grant(project_id=def6cb215c3c45f2a54435c338e667ab, user_id=b2f67764a6de42e7a7e7f61340796c3b, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:15.764404 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25713c-42c7-42fa-a1ea-8697a0916589 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:15.778542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 61/126] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:22:15 2022] PUT /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab/users/b2f67764a6de42e7a7e7f61340796c3b/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:22:15.779241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25713c-42c7-42fa-a1ea-8697a0916589 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:15.793208 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3681f8-0b72-4f2d-847d-15c837ae8a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:15.794241 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3681f8-0b72-4f2d-847d-15c837ae8a14 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:15.795216 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3681f8-0b72-4f2d-847d-15c837ae8a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:15.795733 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3681f8-0b72-4f2d-847d-15c837ae8a14 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:15.796541 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3681f8-0b72-4f2d-847d-15c837ae8a14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:15.797027 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3681f8-0b72-4f2d-847d-15c837ae8a14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:15.798737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3681f8-0b72-4f2d-847d-15c837ae8a14 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:15.814007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 66/127] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:15.815116 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3681f8-0b72-4f2d-847d-15c837ae8a14 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:15.913033 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:15.919769 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:15.929695 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25713c-42c7-42fa-a1ea-8697a0916589 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:15.975380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3681f8-0b72-4f2d-847d-15c837ae8a14 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:15.978007 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577edd2-11db-484c-93c9-4c91ca859af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:15.979266 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577edd2-11db-484c-93c9-4c91ca859af2 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:15.979741 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577edd2-11db-484c-93c9-4c91ca859af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:15.980246 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577edd2-11db-484c-93c9-4c91ca859af2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:15.981171 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577edd2-11db-484c-93c9-4c91ca859af2 None admin] RBAC: Adding query filter params (role.id=4012481430d24230bf48f7a758321411, scope.project.id=def6cb215c3c45f2a54435c338e667ab, user.id=62228de4885a400186e53d6cca6a30e2) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:15.981692 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577edd2-11db-484c-93c9-4c91ca859af2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:15.983589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577edd2-11db-484c-93c9-4c91ca859af2 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:15.990762 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 62/128] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:22:15 2022] GET /identity/v3/role_assignments?user.id=62228de4885a400186e53d6cca6a30e2&scope.project.id=def6cb215c3c45f2a54435c338e667ab&role.id=4012481430d24230bf48f7a758321411 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:15.992026 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577edd2-11db-484c-93c9-4c91ca859af2 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:16.035635 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eddd30-976e-4f45-88a9-430fbfa1cc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:16.037136 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eddd30-976e-4f45-88a9-430fbfa1cc60 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:16.037615 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eddd30-976e-4f45-88a9-430fbfa1cc60 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:16.038079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eddd30-976e-4f45-88a9-430fbfa1cc60 None admin] PATH_INFO: `/v3/users/b2f67764a6de42e7a7e7f61340796c3b` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:16.039793 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eddd30-976e-4f45-88a9-430fbfa1cc60 None admin] RBAC: Authorizing `identity:get_user(user_id=b2f67764a6de42e7a7e7f61340796c3b)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:16.041999 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eddd30-976e-4f45-88a9-430fbfa1cc60 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:16.048797 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 67/129] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:15 2022] GET /identity/v3/users/b2f67764a6de42e7a7e7f61340796c3b => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:16.050226 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eddd30-976e-4f45-88a9-430fbfa1cc60 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:16.164159 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577edd2-11db-484c-93c9-4c91ca859af2 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:16.249031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb212a-75be-4d0d-a527-e782f01555ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:16.249587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb212a-75be-4d0d-a527-e782f01555ad None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:16.249868 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb212a-75be-4d0d-a527-e782f01555ad None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:16.250143 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb212a-75be-4d0d-a527-e782f01555ad None admin] PATH_INFO: `/v3/users/b2f67764a6de42e7a7e7f61340796c3b` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:16.254348 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb212a-75be-4d0d-a527-e782f01555ad None admin] RBAC: Authorizing `identity:get_user(user_id=b2f67764a6de42e7a7e7f61340796c3b)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:16.255824 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb212a-75be-4d0d-a527-e782f01555ad None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:16.257605 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 63/130] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:15 2022] GET /identity/v3/users/b2f67764a6de42e7a7e7f61340796c3b => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:16.258182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb212a-75be-4d0d-a527-e782f01555ad None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:16.260120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eddd30-976e-4f45-88a9-430fbfa1cc60 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:16.307520 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:16.325688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52b537-7579-487c-854e-393f6d5f4d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:16.326683 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52b537-7579-487c-854e-393f6d5f4d5a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:16.327238 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52b537-7579-487c-854e-393f6d5f4d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:16.327699 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52b537-7579-487c-854e-393f6d5f4d5a None admin] PATH_INFO: `/v3/users/025ba57ed41d495b9ce978e22dc2973b` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:16.329037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52b537-7579-487c-854e-393f6d5f4d5a None admin] RBAC: Authorizing `identity:get_user(user_id=025ba57ed41d495b9ce978e22dc2973b)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:16.330695 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52b537-7579-487c-854e-393f6d5f4d5a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:16.333997 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 68/131] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:16 2022] GET /identity/v3/users/025ba57ed41d495b9ce978e22dc2973b => generated 247 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:16.335246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52b537-7579-487c-854e-393f6d5f4d5a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:16.338763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:16.484906 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52b537-7579-487c-854e-393f6d5f4d5a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:16.490987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb212a-75be-4d0d-a527-e782f01555ad None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:16.545066 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a9bfa-ad6e-4583-98c1-61c723d3cb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:16.545644 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a9bfa-ad6e-4583-98c1-61c723d3cb9c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:16.545923 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a9bfa-ad6e-4583-98c1-61c723d3cb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:16.546197 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a9bfa-ad6e-4583-98c1-61c723d3cb9c None admin] PATH_INFO: `/v3/projects/c63165c4c8a14361b9bc9a57446cbe33` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:16.547761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a9bfa-ad6e-4583-98c1-61c723d3cb9c None admin] RBAC: Authorizing `identity:get_project(project_id=c63165c4c8a14361b9bc9a57446cbe33)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:16.549374 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a9bfa-ad6e-4583-98c1-61c723d3cb9c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:16.551518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 69/132] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:16 2022] GET /identity/v3/projects/c63165c4c8a14361b9bc9a57446cbe33 => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:16.552299 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a9bfa-ad6e-4583-98c1-61c723d3cb9c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:16.575592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6c141-b41e-4d56-bb7e-3a8864f65fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:16.576225 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6c141-b41e-4d56-bb7e-3a8864f65fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:16.576716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6c141-b41e-4d56-bb7e-3a8864f65fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:16.576994 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6c141-b41e-4d56-bb7e-3a8864f65fa1 None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:16.579227 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6c141-b41e-4d56-bb7e-3a8864f65fa1 None admin] RBAC: Authorizing `identity:get_project(project_id=def6cb215c3c45f2a54435c338e667ab)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:16.580684 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6c141-b41e-4d56-bb7e-3a8864f65fa1 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:16.582999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 64/133] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:16 2022] GET /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab => generated 298 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:16.583733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6c141-b41e-4d56-bb7e-3a8864f65fa1 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:16.685764 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:16.701483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a9bfa-ad6e-4583-98c1-61c723d3cb9c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:16.719835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:16.727316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6c141-b41e-4d56-bb7e-3a8864f65fa1 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:16.750169 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0d87d-58e2-4884-b892-59e82debb6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:16.750847 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0d87d-58e2-4884-b892-59e82debb6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:16.751141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0d87d-58e2-4884-b892-59e82debb6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:16.751937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0d87d-58e2-4884-b892-59e82debb6a5 None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:16.753893 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0d87d-58e2-4884-b892-59e82debb6a5 None admin] RBAC: Authorizing `identity:get_project(project_id=def6cb215c3c45f2a54435c338e667ab)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:16.755619 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0d87d-58e2-4884-b892-59e82debb6a5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:16.757269 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 70/134] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:16 2022] GET /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:16.759625 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0d87d-58e2-4884-b892-59e82debb6a5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:16.775599 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6127ff-a3c8-40eb-ac5d-03d754e7b6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:16.776365 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6127ff-a3c8-40eb-ac5d-03d754e7b6b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:16.776656 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6127ff-a3c8-40eb-ac5d-03d754e7b6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:16.776933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6127ff-a3c8-40eb-ac5d-03d754e7b6b2 None admin] PATH_INFO: `/v3/projects/c63165c4c8a14361b9bc9a57446cbe33/users/b2f67764a6de42e7a7e7f61340796c3b/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:16.779091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6127ff-a3c8-40eb-ac5d-03d754e7b6b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c63165c4c8a14361b9bc9a57446cbe33, user_id=b2f67764a6de42e7a7e7f61340796c3b, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:16.780628 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6127ff-a3c8-40eb-ac5d-03d754e7b6b2 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:16.801970 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 65/135] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:22:16 2022] PUT /identity/v3/projects/c63165c4c8a14361b9bc9a57446cbe33/users/b2f67764a6de42e7a7e7f61340796c3b/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:22:16.803920 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33211659-0e8b-4950-9562-7308ae3a8403 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:16.804211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33211659-0e8b-4950-9562-7308ae3a8403 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:16.804548 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33211659-0e8b-4950-9562-7308ae3a8403 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:16.806047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 66/136] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:16.806883 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33211659-0e8b-4950-9562-7308ae3a8403 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:16.937142 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33211659-0e8b-4950-9562-7308ae3a8403 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:16.938758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0d87d-58e2-4884-b892-59e82debb6a5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:16.976241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96945b2-cc0b-447c-9137-b16e19df8146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:16.976915 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96945b2-cc0b-447c-9137-b16e19df8146 None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:16.977201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96945b2-cc0b-447c-9137-b16e19df8146 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:16.977485 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96945b2-cc0b-447c-9137-b16e19df8146 None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab/users/025ba57ed41d495b9ce978e22dc2973b/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:16.979488 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96945b2-cc0b-447c-9137-b16e19df8146 None admin] RBAC: Authorizing `identity:create_grant(project_id=def6cb215c3c45f2a54435c338e667ab, user_id=025ba57ed41d495b9ce978e22dc2973b, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:16.981036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96945b2-cc0b-447c-9137-b16e19df8146 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:17.006360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 67/137] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:22:16 2022] PUT /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab/users/025ba57ed41d495b9ce978e22dc2973b/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:22:17.008171 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cef86-b449-42ae-a877-70bcc72dfb41 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:17.015083 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cef86-b449-42ae-a877-70bcc72dfb41 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:17.016011 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cef86-b449-42ae-a877-70bcc72dfb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:17.020114 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a893d1-e70e-43c9-9f1b-9b31f258f08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:17.020807 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a893d1-e70e-43c9-9f1b-9b31f258f08b None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:17.023203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a893d1-e70e-43c9-9f1b-9b31f258f08b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:17.023495 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a893d1-e70e-43c9-9f1b-9b31f258f08b None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab/users/b2f67764a6de42e7a7e7f61340796c3b/roles/e1504eb5f35c468086d3b269e2c72011` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:17.027919 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a893d1-e70e-43c9-9f1b-9b31f258f08b None admin] RBAC: Authorizing `identity:create_grant(project_id=def6cb215c3c45f2a54435c338e667ab, user_id=b2f67764a6de42e7a7e7f61340796c3b, role_id=e1504eb5f35c468086d3b269e2c72011)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:17.039442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a893d1-e70e-43c9-9f1b-9b31f258f08b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:17.057031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-864cef86-b449-42ae-a877-70bcc72dfb41 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:17.059163 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-864cef86-b449-42ae-a877-70bcc72dfb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:17.067367 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:17.083362 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:17.090156 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 71/138] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:22:16 2022] PUT /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab/users/b2f67764a6de42e7a7e7f61340796c3b/roles/e1504eb5f35c468086d3b269e2c72011 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:22:17.185576 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 68/139] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:17.483329 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a893d1-e70e-43c9-9f1b-9b31f258f08b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:17.591452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a893d1-e70e-43c9-9f1b-9b31f258f08b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:17.638878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65373d-716b-4777-8cba-0ee05f5c486e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:17.639878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65373d-716b-4777-8cba-0ee05f5c486e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:17.640358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65373d-716b-4777-8cba-0ee05f5c486e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:17.640860 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65373d-716b-4777-8cba-0ee05f5c486e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:17.643861 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65373d-716b-4777-8cba-0ee05f5c486e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:17.645622 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65373d-716b-4777-8cba-0ee05f5c486e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:17.647508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 72/140] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:22:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:17.653144 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cef86-b449-42ae-a877-70bcc72dfb41 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:17.765147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cef86-b449-42ae-a877-70bcc72dfb41 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:17.801863 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6dcee-aa7a-4775-9bbb-5530cb41b1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:17.802816 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6dcee-aa7a-4775-9bbb-5530cb41b1d9 None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:17.803323 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6dcee-aa7a-4775-9bbb-5530cb41b1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:17.803791 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6dcee-aa7a-4775-9bbb-5530cb41b1d9 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:17.804731 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6dcee-aa7a-4775-9bbb-5530cb41b1d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:17.806381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6dcee-aa7a-4775-9bbb-5530cb41b1d9 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:17.832631 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 69/141] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 26 01:22:17 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:22:18.436801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878269bb-fb54-45f8-b700-5d33c839e3b1 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:18.437756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878269bb-fb54-45f8-b700-5d33c839e3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:18.438240 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878269bb-fb54-45f8-b700-5d33c839e3b1 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:18.440060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 73/142] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:18.446320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ebe52-ef82-4ddd-a7e0-91bdc56d699e None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:18.447166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ebe52-ef82-4ddd-a7e0-91bdc56d699e None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:18.447646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ebe52-ef82-4ddd-a7e0-91bdc56d699e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:18.459531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:18.474195 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-650ebe52-ef82-4ddd-a7e0-91bdc56d699e None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:18.480663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-650ebe52-ef82-4ddd-a7e0-91bdc56d699e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:18.578047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 70/143] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:19.015741 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdf6e1-83f3-4135-8f01-2d25bf138944 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:19.016037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdf6e1-83f3-4135-8f01-2d25bf138944 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:19.016314 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdf6e1-83f3-4135-8f01-2d25bf138944 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:19.017767 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 74/144] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:19.023649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c2b43-b0ce-4560-a133-69645b85cf60 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:19.023937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c2b43-b0ce-4560-a133-69645b85cf60 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:19.024216 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c2b43-b0ce-4560-a133-69645b85cf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:19.045122 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-239c2b43-b0ce-4560-a133-69645b85cf60 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:19.046322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-239c2b43-b0ce-4560-a133-69645b85cf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:19.108332 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdf6e1-83f3-4135-8f01-2d25bf138944 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:19.138216 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 71/145] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:19.211024 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:19.250816 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdf6e1-83f3-4135-8f01-2d25bf138944 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:19.295182 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e0471-d09e-4fd5-a0c8-3cbeb42749ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:19.295778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e0471-d09e-4fd5-a0c8-3cbeb42749ee None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:19.296059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e0471-d09e-4fd5-a0c8-3cbeb42749ee None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:19.296331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e0471-d09e-4fd5-a0c8-3cbeb42749ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:19.309461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e0471-d09e-4fd5-a0c8-3cbeb42749ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:19.315256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-ef8e0471-d09e-4fd5-a0c8-3cbeb42749ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:19.315256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:19.315256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:19.315256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:19.315256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:19.315256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:19.315256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:19.315256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:19.315256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:19.315256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:19.315256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:19.315256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:19.315256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:19.315256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:19.315256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:19.315256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:19.316139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:19.316139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:19.316139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:19.316139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:19.316139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:19.316139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:19.316139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:19.316139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:19.316139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:19.316139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:19.316139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:19.316139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:19.316139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:19.316139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:19.316139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:19.316139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:19.316960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:19.316960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:19.316960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:19.316960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:19.316960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:19.316960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:19.316960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:19.316960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:19.316960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:19.316960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:19.316960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:19.316960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:19.316960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 75/146] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:19.323030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c2b43-b0ce-4560-a133-69645b85cf60 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:19.427455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:19.478244 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c2b43-b0ce-4560-a133-69645b85cf60 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:19.524953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7166eff-5a24-4ce4-9109-23506cd5bd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:19.525577 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7166eff-5a24-4ce4-9109-23506cd5bd57 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:19.525858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7166eff-5a24-4ce4-9109-23506cd5bd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:19.526135 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7166eff-5a24-4ce4-9109-23506cd5bd57 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:19.526807 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7166eff-5a24-4ce4-9109-23506cd5bd57 None admin] RBAC: Adding query filter params (name=member) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:19.527132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7166eff-5a24-4ce4-9109-23506cd5bd57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:19.528504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7166eff-5a24-4ce4-9109-23506cd5bd57 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:19.538444 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 72/147] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:19.544390 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e0471-d09e-4fd5-a0c8-3cbeb42749ee None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:19.675438 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e0471-d09e-4fd5-a0c8-3cbeb42749ee None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:19.675987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7166eff-5a24-4ce4-9109-23506cd5bd57 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:19.709901 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:19.720852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723b061-bcef-4e25-96ba-2dd4c62e9033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:19.721519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723b061-bcef-4e25-96ba-2dd4c62e9033 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:19.721859 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723b061-bcef-4e25-96ba-2dd4c62e9033 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:19.722304 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723b061-bcef-4e25-96ba-2dd4c62e9033 None admin] PATH_INFO: `/v3/users/b2f67764a6de42e7a7e7f61340796c3b` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:19.724553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723b061-bcef-4e25-96ba-2dd4c62e9033 None admin] RBAC: Authorizing `identity:get_user(user_id=b2f67764a6de42e7a7e7f61340796c3b)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:19.726015 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723b061-bcef-4e25-96ba-2dd4c62e9033 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:19.727634 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 76/148] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:19 2022] GET /identity/v3/users/b2f67764a6de42e7a7e7f61340796c3b => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:19.734767 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723b061-bcef-4e25-96ba-2dd4c62e9033 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:19.885516 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7166eff-5a24-4ce4-9109-23506cd5bd57 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:19.927816 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723b061-bcef-4e25-96ba-2dd4c62e9033 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:19.931979 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:19.951176 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa65374-9d43-4819-b425-746f441f3585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:19.952828 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa65374-9d43-4819-b425-746f441f3585 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:19.952944 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa65374-9d43-4819-b425-746f441f3585 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:19.953168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa65374-9d43-4819-b425-746f441f3585 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:19.975090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa65374-9d43-4819-b425-746f441f3585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:19.982704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-1aa65374-9d43-4819-b425-746f441f3585 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 01:22:19.982704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:19.982704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:19.982704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:19.982704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:19.982704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:19.982704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:19.982704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:19.982704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:19.982704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:19.982704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:19.982704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:19.982704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:19.982704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:19.982704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:19.982704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:19.983587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:19.983587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:19.983587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:19.983587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:19.983587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:19.983587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:19.983587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:19.983587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:19.983587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:19.983587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:19.983587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:19.983587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:19.983587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:19.983587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:19.983587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:19.983587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:19.984338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:19.984338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:19.984338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:19.984338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:19.984338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:19.984338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:19.984338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:19.984338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:19.984338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:19.984338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:19.984338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 01:22:19.984338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:19.985799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 73/149] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:22:19.989002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd035d96-ccd7-447c-a9f7-2c1a7048badd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:19.989665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd035d96-ccd7-447c-a9f7-2c1a7048badd None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:19.989948 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd035d96-ccd7-447c-a9f7-2c1a7048badd None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:19.990219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd035d96-ccd7-447c-a9f7-2c1a7048badd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:19.991676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa65374-9d43-4819-b425-746f441f3585 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:20.092796 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:20.107855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd035d96-ccd7-447c-a9f7-2c1a7048badd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:20.109351 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd035d96-ccd7-447c-a9f7-2c1a7048badd None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:20.139537 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa65374-9d43-4819-b425-746f441f3585 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:20.176089 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04097749-a75f-439f-8e29-393180f5251a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:20.176751 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04097749-a75f-439f-8e29-393180f5251a None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:20.177038 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04097749-a75f-439f-8e29-393180f5251a None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:20.177310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04097749-a75f-439f-8e29-393180f5251a None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:20.178031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04097749-a75f-439f-8e29-393180f5251a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:20.178278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04097749-a75f-439f-8e29-393180f5251a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:20.179665 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04097749-a75f-439f-8e29-393180f5251a None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:20.188703 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 74/150] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:20.204352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04097749-a75f-439f-8e29-393180f5251a None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:20.270674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:20.341175 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 77/151] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:22:20.342460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7edb97-8ad0-44e3-bdaf-d03c2faf6d78 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:20.342752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7edb97-8ad0-44e3-bdaf-d03c2faf6d78 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:20.343058 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7edb97-8ad0-44e3-bdaf-d03c2faf6d78 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:20.344422 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 78/152] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:20.349592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04097749-a75f-439f-8e29-393180f5251a None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:20.351776 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7edb97-8ad0-44e3-bdaf-d03c2faf6d78 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:20.384743 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a482e1-4eb2-49e3-9592-6139e8ad0332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:20.385375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a482e1-4eb2-49e3-9592-6139e8ad0332 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:20.385695 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a482e1-4eb2-49e3-9592-6139e8ad0332 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:20.385973 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a482e1-4eb2-49e3-9592-6139e8ad0332 None admin] PATH_INFO: `/v3/users/62228de4885a400186e53d6cca6a30e2` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:20.387221 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a482e1-4eb2-49e3-9592-6139e8ad0332 None admin] RBAC: Authorizing `identity:get_user(user_id=62228de4885a400186e53d6cca6a30e2)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:20.388688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a482e1-4eb2-49e3-9592-6139e8ad0332 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:20.390521 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 75/153] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:20 2022] GET /identity/v3/users/62228de4885a400186e53d6cca6a30e2 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:20.394852 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670828c-b87a-4b17-a088-5b8de1f407f6 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:20.394852 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670828c-b87a-4b17-a088-5b8de1f407f6 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:20.395075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670828c-b87a-4b17-a088-5b8de1f407f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:20.420356 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-9670828c-b87a-4b17-a088-5b8de1f407f6 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:20.421849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-9670828c-b87a-4b17-a088-5b8de1f407f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:20.496998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 76/154] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:20.498630 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670828c-b87a-4b17-a088-5b8de1f407f6 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:20.545596 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:20.551971 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:20.572144 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7edb97-8ad0-44e3-bdaf-d03c2faf6d78 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:20.609341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670828c-b87a-4b17-a088-5b8de1f407f6 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:20.639276 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf028e-2b0e-4e97-998b-7c10e4bf8e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:20.639916 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf028e-2b0e-4e97-998b-7c10e4bf8e3b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:20.640200 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf028e-2b0e-4e97-998b-7c10e4bf8e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:20.640469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf028e-2b0e-4e97-998b-7c10e4bf8e3b None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:20.647724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf028e-2b0e-4e97-998b-7c10e4bf8e3b None admin] RBAC: Authorizing `identity:get_project(project_id=def6cb215c3c45f2a54435c338e667ab)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:20.648237 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997052f1-a9db-4189-9903-83ff3e65ed4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:20.649213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997052f1-a9db-4189-9903-83ff3e65ed4f None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:20.649324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf028e-2b0e-4e97-998b-7c10e4bf8e3b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:20.649787 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997052f1-a9db-4189-9903-83ff3e65ed4f None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:20.650309 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997052f1-a9db-4189-9903-83ff3e65ed4f None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:20.651120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 79/155] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:20 2022] GET /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:20.652283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997052f1-a9db-4189-9903-83ff3e65ed4f None admin] RBAC: Authorizing `identity:get_project(project_id=def6cb215c3c45f2a54435c338e667ab)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:20.653970 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997052f1-a9db-4189-9903-83ff3e65ed4f None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:20.656181 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 77/156] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:20 2022] GET /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:20.656827 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf028e-2b0e-4e97-998b-7c10e4bf8e3b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:20.662754 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997052f1-a9db-4189-9903-83ff3e65ed4f None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:20.799319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997052f1-a9db-4189-9903-83ff3e65ed4f None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:20.826864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:20.846226 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf028e-2b0e-4e97-998b-7c10e4bf8e3b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:20.856596 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde53b4-b405-411b-9a97-0ec5818e807e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:20.857679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde53b4-b405-411b-9a97-0ec5818e807e None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:20.858173 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde53b4-b405-411b-9a97-0ec5818e807e None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:20.858788 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde53b4-b405-411b-9a97-0ec5818e807e None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab/users/62228de4885a400186e53d6cca6a30e2/roles/4012481430d24230bf48f7a758321411` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:20.861051 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde53b4-b405-411b-9a97-0ec5818e807e None admin] RBAC: Authorizing `identity:create_grant(project_id=def6cb215c3c45f2a54435c338e667ab, user_id=62228de4885a400186e53d6cca6a30e2, role_id=4012481430d24230bf48f7a758321411)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:20.863311 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde53b4-b405-411b-9a97-0ec5818e807e None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:20.886621 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 78/157] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:22:20 2022] PUT /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab/users/62228de4885a400186e53d6cca6a30e2/roles/4012481430d24230bf48f7a758321411 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:22:20.888376 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70d5a9-8ed4-464b-8809-79d2a2fb74b8 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:20.888907 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70d5a9-8ed4-464b-8809-79d2a2fb74b8 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:20.889385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70d5a9-8ed4-464b-8809-79d2a2fb74b8 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:20.891053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 79/158] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:20.897734 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248acb37-49f2-4a47-9171-e6f3a9273d42 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:20.898451 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248acb37-49f2-4a47-9171-e6f3a9273d42 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:20.898999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248acb37-49f2-4a47-9171-e6f3a9273d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:20.927095 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-248acb37-49f2-4a47-9171-e6f3a9273d42 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:20.929055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-248acb37-49f2-4a47-9171-e6f3a9273d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:20.930493 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dfdd7-9741-4b5e-a255-5363adc9b67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:20.931157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dfdd7-9741-4b5e-a255-5363adc9b67b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:20.931444 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dfdd7-9741-4b5e-a255-5363adc9b67b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:20.931715 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dfdd7-9741-4b5e-a255-5363adc9b67b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:20.932650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dfdd7-9741-4b5e-a255-5363adc9b67b None admin] RBAC: Adding query filter params (role.id=f4df3a7a4c0b4730abc0601e2b072ef4, scope.project.id=def6cb215c3c45f2a54435c338e667ab, user.id=b2f67764a6de42e7a7e7f61340796c3b) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:20.932768 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dfdd7-9741-4b5e-a255-5363adc9b67b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:20.934695 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dfdd7-9741-4b5e-a255-5363adc9b67b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:20.953422 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 80/159] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:22:20 2022] GET /identity/v3/role_assignments?user.id=b2f67764a6de42e7a7e7f61340796c3b&scope.project.id=def6cb215c3c45f2a54435c338e667ab&role.id=f4df3a7a4c0b4730abc0601e2b072ef4 => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:21.024454 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 80/160] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:22:21.260254 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cc261-6897-4317-ada4-9b14a449644d None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:21.260585 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cc261-6897-4317-ada4-9b14a449644d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:21.260798 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cc261-6897-4317-ada4-9b14a449644d None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:21.262138 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 81/161] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:21.267940 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d3846-1e00-4bbf-a1da-4ae6f896ebaa None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:21.268764 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d3846-1e00-4bbf-a1da-4ae6f896ebaa None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:21.269275 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d3846-1e00-4bbf-a1da-4ae6f896ebaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:21.296569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cc261-6897-4317-ada4-9b14a449644d None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:21.300775 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-0d3d3846-1e00-4bbf-a1da-4ae6f896ebaa None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:21.302347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0d3d3846-1e00-4bbf-a1da-4ae6f896ebaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:21.356650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:21.412998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 81/162] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:22:21.488415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cc261-6897-4317-ada4-9b14a449644d None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:21.525988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d3846-1e00-4bbf-a1da-4ae6f896ebaa None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:21.533210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a160a-b5ef-4a78-830d-cbe1353de6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:21.534172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a160a-b5ef-4a78-830d-cbe1353de6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:21.534653 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a160a-b5ef-4a78-830d-cbe1353de6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:21.535141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a160a-b5ef-4a78-830d-cbe1353de6e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:21.553959 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a160a-b5ef-4a78-830d-cbe1353de6e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:21.560012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-ca8a160a-b5ef-4a78-830d-cbe1353de6e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:21.560012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:21.560012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:21.560012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:21.560012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:21.560012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:21.560012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:21.560012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:21.560012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:21.560012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:21.560012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:21.560012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:21.560012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:21.560012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:21.560012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:21.560012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:21.560848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:21.560848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:21.560848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:21.560848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:21.560848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:21.560848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:21.560848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:21.560848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:21.560848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:21.560848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:21.560848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:21.560848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:21.560848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:21.560848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:21.560848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:21.560848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:21.561648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:21.561648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:21.561648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:21.561648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:21.561648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:21.561648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:21.561648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:21.561648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:21.561648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:21.561648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:21.561648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:21.561648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:21.563134 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:21.565838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 82/163] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:22:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:21.572564 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a160a-b5ef-4a78-830d-cbe1353de6e6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:21.735516 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d3846-1e00-4bbf-a1da-4ae6f896ebaa None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:21.774851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:21.802810 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a160a-b5ef-4a78-830d-cbe1353de6e6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:21.819821 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d92d7-45b0-46f3-ad4f-363a63770755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:21.821137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d92d7-45b0-46f3-ad4f-363a63770755 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:21.821628 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d92d7-45b0-46f3-ad4f-363a63770755 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:21.822096 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d92d7-45b0-46f3-ad4f-363a63770755 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:21.842658 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5128473-c582-4c3c-900e-f0dad854c6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:21.843473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5128473-c582-4c3c-900e-f0dad854c6ce None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:21.843754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5128473-c582-4c3c-900e-f0dad854c6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:21.844024 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5128473-c582-4c3c-900e-f0dad854c6ce None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:21.844694 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5128473-c582-4c3c-900e-f0dad854c6ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:21.844995 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5128473-c582-4c3c-900e-f0dad854c6ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:21.846940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5128473-c582-4c3c-900e-f0dad854c6ce None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:21.849416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d92d7-45b0-46f3-ad4f-363a63770755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:21.854316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-494d92d7-45b0-46f3-ad4f-363a63770755 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:21.854316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:21.854316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:21.854316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:21.854316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:21.854316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:21.854316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:21.854316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:21.854316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:21.854316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:21.854316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:21.854316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:21.854316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:21.854316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:21.854316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:21.854316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:21.855235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:21.855235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:21.855235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:21.855235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:21.855235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:21.855235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:21.855235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:21.855235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:21.855235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:21.855235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:21.855235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:21.855235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:21.855235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:21.855235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:21.855235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:21.855235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:21.855999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:21.855999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:21.855999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:21.855999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:21.855999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:21.855999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:21.855999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:21.855999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:21.855999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:21.855999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:21.855999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:21.855999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:21.856853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 82/164] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:22:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:22:21.859308 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d92d7-45b0-46f3-ad4f-363a63770755 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:21.867402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 83/165] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:22:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:21.868103 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5128473-c582-4c3c-900e-f0dad854c6ce None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:21.999134 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:22.010112 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d92d7-45b0-46f3-ad4f-363a63770755 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:22.048008 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bb7a9-309a-487f-9f42-ee90087296b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:22.048636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bb7a9-309a-487f-9f42-ee90087296b6 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:22.048915 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bb7a9-309a-487f-9f42-ee90087296b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:22.049184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bb7a9-309a-487f-9f42-ee90087296b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:22.061174 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bb7a9-309a-487f-9f42-ee90087296b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:22.067111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-0a8bb7a9-309a-487f-9f42-ee90087296b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:22.067111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:22.067111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:22.067111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:22.067111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:22.067111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:22.067111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:22.067111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:22.067111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:22.067111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:22.067111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:22.067111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:22.067111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:22.067111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:22.067111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:22.067111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:22.068076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:22.068076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:22.068076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:22.068076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:22.068076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:22.068076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:22.068076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:22.068076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:22.068076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:22.068076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:22.068076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:22.068076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:22.068076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:22.068076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:22.068076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:22.068076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:22.068846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:22.068846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:22.068846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:22.068846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:22.068846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:22.068846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:22.068846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:22.068846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:22.068846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:22.068846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:22.068846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:22.068846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:22.068846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 83/166] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:22.069483 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bb7a9-309a-487f-9f42-ee90087296b6 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:22.084633 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5128473-c582-4c3c-900e-f0dad854c6ce None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:22.158346 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde26f95-3b18-4e7e-b56e-757a27b3c37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:22.159072 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde26f95-3b18-4e7e-b56e-757a27b3c37b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:22.159375 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde26f95-3b18-4e7e-b56e-757a27b3c37b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:22.159653 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde26f95-3b18-4e7e-b56e-757a27b3c37b None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:22.160330 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde26f95-3b18-4e7e-b56e-757a27b3c37b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:22.160636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde26f95-3b18-4e7e-b56e-757a27b3c37b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:22.162028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde26f95-3b18-4e7e-b56e-757a27b3c37b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:22.170871 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 84/167] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:22.171982 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde26f95-3b18-4e7e-b56e-757a27b3c37b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:22.189022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bb7a9-309a-487f-9f42-ee90087296b6 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:22.199185 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:22.228616 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7477573-29d5-4c78-9d5e-bee6382e79d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:22.229252 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7477573-29d5-4c78-9d5e-bee6382e79d1 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:22.229589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7477573-29d5-4c78-9d5e-bee6382e79d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:22.229864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7477573-29d5-4c78-9d5e-bee6382e79d1 None admin] PATH_INFO: `/v3/users/b2f67764a6de42e7a7e7f61340796c3b` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:22.231039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7477573-29d5-4c78-9d5e-bee6382e79d1 None admin] RBAC: Authorizing `identity:get_user(user_id=b2f67764a6de42e7a7e7f61340796c3b)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:22.232738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7477573-29d5-4c78-9d5e-bee6382e79d1 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:22.234630 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 84/168] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:22 2022] GET /identity/v3/users/b2f67764a6de42e7a7e7f61340796c3b => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:22.235576 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7477573-29d5-4c78-9d5e-bee6382e79d1 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:22.260844 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:22.344491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7477573-29d5-4c78-9d5e-bee6382e79d1 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:22.345747 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde26f95-3b18-4e7e-b56e-757a27b3c37b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:22.379589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5efa4-f248-4b00-b277-836e18a30955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:22.380383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5efa4-f248-4b00-b277-836e18a30955 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:22.380793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5efa4-f248-4b00-b277-836e18a30955 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:22.381071 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5efa4-f248-4b00-b277-836e18a30955 None admin] PATH_INFO: `/v3/users/025ba57ed41d495b9ce978e22dc2973b` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:22.382229 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5efa4-f248-4b00-b277-836e18a30955 None admin] RBAC: Authorizing `identity:get_user(user_id=025ba57ed41d495b9ce978e22dc2973b)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:22.383883 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5efa4-f248-4b00-b277-836e18a30955 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:22.385638 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 85/169] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:22 2022] GET /identity/v3/users/025ba57ed41d495b9ce978e22dc2973b => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:22.386222 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5efa4-f248-4b00-b277-836e18a30955 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:22.418027 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a7abd-643e-4f9e-8feb-976187438d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:22.418654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a7abd-643e-4f9e-8feb-976187438d3e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:22.418966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a7abd-643e-4f9e-8feb-976187438d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:22.419241 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a7abd-643e-4f9e-8feb-976187438d3e None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:22.419919 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a7abd-643e-4f9e-8feb-976187438d3e None admin] RBAC: Adding query filter params (name=member) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:22.420224 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a7abd-643e-4f9e-8feb-976187438d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:22.421609 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a7abd-643e-4f9e-8feb-976187438d3e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:22.430439 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 85/170] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:22.435429 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a7abd-643e-4f9e-8feb-976187438d3e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:22.547225 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:22.550336 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:22.574522 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5efa4-f248-4b00-b277-836e18a30955 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:22.597169 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a7abd-643e-4f9e-8feb-976187438d3e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:22.645281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737da4eb-04ca-4560-8ca1-7eb170b27428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:22.645890 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737da4eb-04ca-4560-8ca1-7eb170b27428 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:22.646169 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737da4eb-04ca-4560-8ca1-7eb170b27428 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:22.646439 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737da4eb-04ca-4560-8ca1-7eb170b27428 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:22.670428 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5552b4-3b5b-48e1-84ac-000c68b1427b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:22.671075 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5552b4-3b5b-48e1-84ac-000c68b1427b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:22.671354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5552b4-3b5b-48e1-84ac-000c68b1427b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:22.671629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5552b4-3b5b-48e1-84ac-000c68b1427b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:22.744710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5552b4-3b5b-48e1-84ac-000c68b1427b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:22.746527 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5552b4-3b5b-48e1-84ac-000c68b1427b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:22.759313 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737da4eb-04ca-4560-8ca1-7eb170b27428 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:22.760826 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737da4eb-04ca-4560-8ca1-7eb170b27428 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:22.831580 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:22.854055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 86/171] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:22:22.854603 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5552b4-3b5b-48e1-84ac-000c68b1427b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:22.905752 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:22.934622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 86/172] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:22:22.935543 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737da4eb-04ca-4560-8ca1-7eb170b27428 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:22.969570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5552b4-3b5b-48e1-84ac-000c68b1427b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:23.052045 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920ec44-b392-4375-b7d7-ff56162bff85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:23.053077 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920ec44-b392-4375-b7d7-ff56162bff85 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:23.053568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920ec44-b392-4375-b7d7-ff56162bff85 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:23.054025 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920ec44-b392-4375-b7d7-ff56162bff85 None admin] PATH_INFO: `/v3/users/b2f67764a6de42e7a7e7f61340796c3b` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:23.059655 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920ec44-b392-4375-b7d7-ff56162bff85 None admin] RBAC: Authorizing `identity:get_user(user_id=b2f67764a6de42e7a7e7f61340796c3b)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:23.061464 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920ec44-b392-4375-b7d7-ff56162bff85 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:23.063427 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 87/173] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:22 2022] GET /identity/v3/users/b2f67764a6de42e7a7e7f61340796c3b => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:23.064510 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920ec44-b392-4375-b7d7-ff56162bff85 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:23.084779 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737da4eb-04ca-4560-8ca1-7eb170b27428 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:23.120322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8118214-4441-4345-b426-7418c2a2fdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:23.120869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8118214-4441-4345-b426-7418c2a2fdcd None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:23.121577 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8118214-4441-4345-b426-7418c2a2fdcd None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:23.121577 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8118214-4441-4345-b426-7418c2a2fdcd None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:23.122614 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8118214-4441-4345-b426-7418c2a2fdcd None admin] RBAC: Authorizing `identity:get_project(project_id=def6cb215c3c45f2a54435c338e667ab)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:23.124126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8118214-4441-4345-b426-7418c2a2fdcd None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:23.126336 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 87/174] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:22 2022] GET /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:23.130856 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8118214-4441-4345-b426-7418c2a2fdcd None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:23.171218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:23.207425 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:23.242145 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920ec44-b392-4375-b7d7-ff56162bff85 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:23.282279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0daae7-fa17-4bd6-8095-c13964257ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:23.283029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0daae7-fa17-4bd6-8095-c13964257ebd None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:23.283312 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0daae7-fa17-4bd6-8095-c13964257ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:23.283583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0daae7-fa17-4bd6-8095-c13964257ebd None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:23.284803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0daae7-fa17-4bd6-8095-c13964257ebd None admin] RBAC: Authorizing `identity:get_project(project_id=def6cb215c3c45f2a54435c338e667ab)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:23.285792 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8118214-4441-4345-b426-7418c2a2fdcd None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:23.286261 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0daae7-fa17-4bd6-8095-c13964257ebd None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:23.288254 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 88/175] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:23 2022] GET /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:23.289097 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0daae7-fa17-4bd6-8095-c13964257ebd None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:23.325664 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9448a2-05ea-417d-b536-8a895d616a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:23.326279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9448a2-05ea-417d-b536-8a895d616a8a None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:23.326556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9448a2-05ea-417d-b536-8a895d616a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:23.326849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9448a2-05ea-417d-b536-8a895d616a8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:23.402434 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0daae7-fa17-4bd6-8095-c13964257ebd None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:23.406171 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9448a2-05ea-417d-b536-8a895d616a8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:23.407840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9448a2-05ea-417d-b536-8a895d616a8a None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:23.417812 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:23.443944 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54badf-86c2-4241-b3cc-627b2933c1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:23.444783 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54badf-86c2-4241-b3cc-627b2933c1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:23.445459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54badf-86c2-4241-b3cc-627b2933c1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:23.445903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54badf-86c2-4241-b3cc-627b2933c1e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:23.446774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54badf-86c2-4241-b3cc-627b2933c1e3 None admin] RBAC: Adding query filter params (role.id=50adf18edc1a47b2bae0876828a88dbf, scope.project.id=def6cb215c3c45f2a54435c338e667ab, user.id=025ba57ed41d495b9ce978e22dc2973b) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:23.447261 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54badf-86c2-4241-b3cc-627b2933c1e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:23.448847 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54badf-86c2-4241-b3cc-627b2933c1e3 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:23.455322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 89/176] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:22:23 2022] GET /identity/v3/role_assignments?user.id=025ba57ed41d495b9ce978e22dc2973b&scope.project.id=def6cb215c3c45f2a54435c338e667ab&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:23.456894 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d224696-270d-4e1e-bb3d-bdfd998d852d None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:23.457334 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d224696-270d-4e1e-bb3d-bdfd998d852d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:23.457748 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d224696-270d-4e1e-bb3d-bdfd998d852d None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:23.459237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 90/177] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:23.460454 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c389d3-c30a-4742-a76c-d5a6f15cd3a2 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:23.460888 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c389d3-c30a-4742-a76c-d5a6f15cd3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:23.461327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c389d3-c30a-4742-a76c-d5a6f15cd3a2 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:23.462771 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 91/178] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:23.463953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c389d3-c30a-4742-a76c-d5a6f15cd3a2 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:23.487146 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:23.556061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 88/179] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:22:23.561652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c65fb2-cf70-42c6-bd14-407bacbfc8f5 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:23.561652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c65fb2-cf70-42c6-bd14-407bacbfc8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:23.561652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c65fb2-cf70-42c6-bd14-407bacbfc8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:23.584693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-83c65fb2-cf70-42c6-bd14-407bacbfc8f5 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:23.587220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-83c65fb2-cf70-42c6-bd14-407bacbfc8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:23.593356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c389d3-c30a-4742-a76c-d5a6f15cd3a2 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:23.631753 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b0a9d-2d29-4634-8e76-958dea2a517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:23.633083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b0a9d-2d29-4634-8e76-958dea2a517e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:23.633507 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b0a9d-2d29-4634-8e76-958dea2a517e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:23.633923 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b0a9d-2d29-4634-8e76-958dea2a517e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:23.634878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b0a9d-2d29-4634-8e76-958dea2a517e None admin] RBAC: Adding query filter params (role.id=e1504eb5f35c468086d3b269e2c72011, scope.project.id=def6cb215c3c45f2a54435c338e667ab, user.id=b2f67764a6de42e7a7e7f61340796c3b) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:23.635334 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b0a9d-2d29-4634-8e76-958dea2a517e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:23.636942 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b0a9d-2d29-4634-8e76-958dea2a517e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:23.644304 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 92/180] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:22:23 2022] GET /identity/v3/role_assignments?user.id=b2f67764a6de42e7a7e7f61340796c3b&scope.project.id=def6cb215c3c45f2a54435c338e667ab&role.id=e1504eb5f35c468086d3b269e2c72011 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:23.645973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a26c3-8fcf-4041-99c1-88cae667a20b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:23.646436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a26c3-8fcf-4041-99c1-88cae667a20b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:23.646873 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a26c3-8fcf-4041-99c1-88cae667a20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:23.667034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-579a26c3-8fcf-4041-99c1-88cae667a20b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:23.668540 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-579a26c3-8fcf-4041-99c1-88cae667a20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:23.678413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 89/181] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:23.688486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e925183-6225-4ade-8831-e2b72d43078a None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:23.689134 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e925183-6225-4ade-8831-e2b72d43078a None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:23.689628 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e925183-6225-4ade-8831-e2b72d43078a None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:23.691636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 90/182] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:23.692653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e925183-6225-4ade-8831-e2b72d43078a None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:23.745364 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:23.821708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 93/183] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:23.823521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4795c-f47b-46a3-a1d8-d454532f517a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:23.823871 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4795c-f47b-46a3-a1d8-d454532f517a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:23.824292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4795c-f47b-46a3-a1d8-d454532f517a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:23.842716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-5dc4795c-f47b-46a3-a1d8-d454532f517a None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:23.844292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5dc4795c-f47b-46a3-a1d8-d454532f517a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:23.851241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:23.901399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e925183-6225-4ade-8831-e2b72d43078a None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:23.928651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 94/184] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:23.954821 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ff66d-36d1-4968-a304-8cb56f60b5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:23.956449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ff66d-36d1-4968-a304-8cb56f60b5ee None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:23.957015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ff66d-36d1-4968-a304-8cb56f60b5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:23.957493 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ff66d-36d1-4968-a304-8cb56f60b5ee None admin] PATH_INFO: `/v3/projects/c63165c4c8a14361b9bc9a57446cbe33` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:23.958863 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ff66d-36d1-4968-a304-8cb56f60b5ee None admin] RBAC: Authorizing `identity:get_project(project_id=c63165c4c8a14361b9bc9a57446cbe33)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:23.960532 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ff66d-36d1-4968-a304-8cb56f60b5ee None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:23.962401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 91/185] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:23 2022] GET /identity/v3/projects/c63165c4c8a14361b9bc9a57446cbe33 => generated 312 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:23.968557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4795c-f47b-46a3-a1d8-d454532f517a None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:24.064542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ff66d-36d1-4968-a304-8cb56f60b5ee None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:24.123487 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:24.140479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4795c-f47b-46a3-a1d8-d454532f517a None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:24.217171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d33d7-58d8-4538-8686-d24662f290a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:24.217818 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d33d7-58d8-4538-8686-d24662f290a0 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:24.218063 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d33d7-58d8-4538-8686-d24662f290a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:24.218334 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d33d7-58d8-4538-8686-d24662f290a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:24.219391 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d33d7-58d8-4538-8686-d24662f290a0 None admin] RBAC: Adding query filter params (role.id=f4df3a7a4c0b4730abc0601e2b072ef4, scope.project.id=c63165c4c8a14361b9bc9a57446cbe33, user.id=b2f67764a6de42e7a7e7f61340796c3b) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:24.219697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d33d7-58d8-4538-8686-d24662f290a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:24.221176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d33d7-58d8-4538-8686-d24662f290a0 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:24.236473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 95/186] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:22:23 2022] GET /identity/v3/role_assignments?user.id=b2f67764a6de42e7a7e7f61340796c3b&scope.project.id=c63165c4c8a14361b9bc9a57446cbe33&role.id=f4df3a7a4c0b4730abc0601e2b072ef4 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:24.264726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ff66d-36d1-4968-a304-8cb56f60b5ee None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:24.269629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d33d7-58d8-4538-8686-d24662f290a0 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:24.335018 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdae76-b7e5-46ec-947c-589f8f6602e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:24.336027 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdae76-b7e5-46ec-947c-589f8f6602e2 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:24.336448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdae76-b7e5-46ec-947c-589f8f6602e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:24.336865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdae76-b7e5-46ec-947c-589f8f6602e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:24.352456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bdae76-b7e5-46ec-947c-589f8f6602e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:24.359061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-c2bdae76-b7e5-46ec-947c-589f8f6602e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:24.359061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:24.359061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:24.359061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:24.359061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:24.359061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:24.359061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:24.359061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:24.359061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:24.359061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:24.359061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:24.359061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:24.359061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:24.359061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:24.359061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:24.359061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:24.360182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:24.360182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:24.360182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:24.360182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:24.360182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:24.360182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:24.360182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:24.360182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:24.360182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:24.360182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:24.360182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:24.360182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:24.360182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:24.360182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:24.360182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:24.360182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:24.361183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:24.361183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:24.361183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:24.361183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:24.361183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:24.361183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:24.361183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:24.361183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:24.361183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:24.361183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:24.361183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:24.361183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:24.364669 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 92/187] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:22:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:22:24.365823 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdae76-b7e5-46ec-947c-589f8f6602e2 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:24.397336 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:24.430882 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d33d7-58d8-4538-8686-d24662f290a0 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:24.483128 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db98f01-7961-4542-ab3f-4df03427833e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:24.484163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db98f01-7961-4542-ab3f-4df03427833e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:24.484661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db98f01-7961-4542-ab3f-4df03427833e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:24.485151 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db98f01-7961-4542-ab3f-4df03427833e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:24.487776 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db98f01-7961-4542-ab3f-4df03427833e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:24.489557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db98f01-7961-4542-ab3f-4df03427833e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:24.491830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 96/188] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:22:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:24.492881 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db98f01-7961-4542-ab3f-4df03427833e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:24.517623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdae76-b7e5-46ec-947c-589f8f6602e2 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:24.528340 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:24.570992 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf62bb2-ae81-4813-8488-1dc0c2ffaac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:24.571655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf62bb2-ae81-4813-8488-1dc0c2ffaac8 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:24.572124 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf62bb2-ae81-4813-8488-1dc0c2ffaac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:24.572550 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf62bb2-ae81-4813-8488-1dc0c2ffaac8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:24.584766 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf62bb2-ae81-4813-8488-1dc0c2ffaac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:24.589873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-4cf62bb2-ae81-4813-8488-1dc0c2ffaac8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:24.589873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:24.589873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:24.589873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:24.589873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:24.589873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:24.589873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:24.589873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:24.589873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:24.589873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:24.589873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:24.589873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:24.589873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:24.589873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:24.589873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:24.589873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:24.590770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:24.590770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:24.590770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:24.590770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:24.590770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:24.590770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:24.590770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:24.590770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:24.590770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:24.590770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:24.590770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:24.590770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:24.590770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:24.590770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:24.590770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:24.590770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:24.593716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:24.593716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:24.593716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:24.593716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:24.593716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:24.593716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:24.593716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:24.593716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:24.593716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:24.593716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:24.593716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:24.593716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:24.593716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 93/189] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:22:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:24.593716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf62bb2-ae81-4813-8488-1dc0c2ffaac8 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:24.614781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db98f01-7961-4542-ab3f-4df03427833e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:24.648195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd95568-48c5-4f32-828c-a71c46fad966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:24.648778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd95568-48c5-4f32-828c-a71c46fad966 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:24.649062 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd95568-48c5-4f32-828c-a71c46fad966 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:24.649335 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd95568-48c5-4f32-828c-a71c46fad966 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:24.650043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd95568-48c5-4f32-828c-a71c46fad966 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:24.650350 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd95568-48c5-4f32-828c-a71c46fad966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:24.651754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd95568-48c5-4f32-828c-a71c46fad966 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:24.660097 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 97/190] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:24.661239 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41275ac8-2945-462f-9029-1972ce62152b None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:24.661523 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41275ac8-2945-462f-9029-1972ce62152b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:24.661799 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41275ac8-2945-462f-9029-1972ce62152b None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:24.663023 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 98/191] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:24.663709 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41275ac8-2945-462f-9029-1972ce62152b None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:24.671785 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:24.697323 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf62bb2-ae81-4813-8488-1dc0c2ffaac8 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:24.734006 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4623a-5100-4589-8de1-5a2c61283d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:24.734523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4623a-5100-4589-8de1-5a2c61283d6c None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:24.734799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4623a-5100-4589-8de1-5a2c61283d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:24.735098 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4623a-5100-4589-8de1-5a2c61283d6c None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:24.735743 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4623a-5100-4589-8de1-5a2c61283d6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:24.737223 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4623a-5100-4589-8de1-5a2c61283d6c None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:24.756787 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 94/192] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 26 01:22:24 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:22:24.757601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4623a-5100-4589-8de1-5a2c61283d6c None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:24.779979 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:24.793424 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41275ac8-2945-462f-9029-1972ce62152b None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:24.832258 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5480af6-fe6e-482a-bd5b-0d55dd4243a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:24.832889 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5480af6-fe6e-482a-bd5b-0d55dd4243a2 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:24.833170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5480af6-fe6e-482a-bd5b-0d55dd4243a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:24.833462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5480af6-fe6e-482a-bd5b-0d55dd4243a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:24.834130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5480af6-fe6e-482a-bd5b-0d55dd4243a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:24.834433 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5480af6-fe6e-482a-bd5b-0d55dd4243a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:24.835891 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5480af6-fe6e-482a-bd5b-0d55dd4243a2 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:24.850060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 99/193] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:22:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:24.850060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae9864-e195-421d-a75e-23c1f4eaaf98 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:24.850060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae9864-e195-421d-a75e-23c1f4eaaf98 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:24.850060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae9864-e195-421d-a75e-23c1f4eaaf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:24.866527 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-b4ae9864-e195-421d-a75e-23c1f4eaaf98 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:24.867799 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b4ae9864-e195-421d-a75e-23c1f4eaaf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:24.884703 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4623a-5100-4589-8de1-5a2c61283d6c None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:24.917726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:24.925625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebb3d0-0112-4aa7-aab3-fdf7bc107d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:24.926487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebb3d0-0112-4aa7-aab3-fdf7bc107d70 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:24.926968 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebb3d0-0112-4aa7-aab3-fdf7bc107d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:24.927255 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebb3d0-0112-4aa7-aab3-fdf7bc107d70 None admin] PATH_INFO: `/v3/users/eedcdf3be6834fe8a0aba836f9228c0c` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:24.946366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebb3d0-0112-4aa7-aab3-fdf7bc107d70 None admin] RBAC: Authorizing `identity:get_user(user_id=eedcdf3be6834fe8a0aba836f9228c0c)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:24.947859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebb3d0-0112-4aa7-aab3-fdf7bc107d70 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:24.950159 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 95/194] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:24 2022] GET /identity/v3/users/eedcdf3be6834fe8a0aba836f9228c0c => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:24.950272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 100/195] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:24.950360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebb3d0-0112-4aa7-aab3-fdf7bc107d70 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:24.957269 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae9864-e195-421d-a75e-23c1f4eaaf98 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:25.062009 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:25.081755 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebb3d0-0112-4aa7-aab3-fdf7bc107d70 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:25.085377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae9864-e195-421d-a75e-23c1f4eaaf98 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:25.130389 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffce31b-7152-430b-933c-8b8c21f64482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:25.131068 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffce31b-7152-430b-933c-8b8c21f64482 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:25.131354 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffce31b-7152-430b-933c-8b8c21f64482 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:25.131634 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffce31b-7152-430b-933c-8b8c21f64482 None admin] PATH_INFO: `/v3/users/eedcdf3be6834fe8a0aba836f9228c0c` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:25.132833 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffce31b-7152-430b-933c-8b8c21f64482 None admin] RBAC: Authorizing `identity:get_user(user_id=eedcdf3be6834fe8a0aba836f9228c0c)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:25.133060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac69123-7fc1-4623-8c67-9139057070f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:25.133821 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac69123-7fc1-4623-8c67-9139057070f6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:25.134238 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac69123-7fc1-4623-8c67-9139057070f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:25.134361 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffce31b-7152-430b-933c-8b8c21f64482 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:25.134756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac69123-7fc1-4623-8c67-9139057070f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:25.135914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 96/196] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:24 2022] GET /identity/v3/users/eedcdf3be6834fe8a0aba836f9228c0c => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:25.141370 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffce31b-7152-430b-933c-8b8c21f64482 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:25.209929 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:25.217647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac69123-7fc1-4623-8c67-9139057070f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:25.219271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac69123-7fc1-4623-8c67-9139057070f6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:25.257839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffce31b-7152-430b-933c-8b8c21f64482 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:25.303866 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c1ec9-06a8-489b-b035-843117276d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:25.304544 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c1ec9-06a8-489b-b035-843117276d78 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:25.304819 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c1ec9-06a8-489b-b035-843117276d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:25.305086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c1ec9-06a8-489b-b035-843117276d78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:25.330284 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:25.358145 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 101/197] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 01:22:25.359736 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac69123-7fc1-4623-8c67-9139057070f6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:25.392831 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c1ec9-06a8-489b-b035-843117276d78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:25.395017 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c1ec9-06a8-489b-b035-843117276d78 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:25.457791 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:25.503622 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac69123-7fc1-4623-8c67-9139057070f6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:25.532496 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 97/198] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 01:22:25.533551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c1ec9-06a8-489b-b035-843117276d78 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:25.546174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a902a1-00a0-4e79-af9f-778d48fa4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:25.547109 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a902a1-00a0-4e79-af9f-778d48fa4b05 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:25.547565 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a902a1-00a0-4e79-af9f-778d48fa4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:25.548061 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a902a1-00a0-4e79-af9f-778d48fa4b05 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:25.559537 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a902a1-00a0-4e79-af9f-778d48fa4b05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:25.564735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-e9a902a1-00a0-4e79-af9f-778d48fa4b05 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 01:22:25.564735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:25.564735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:25.564735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:25.564735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:25.564735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:25.564735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:25.564735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:25.564735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:25.564735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:25.564735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:25.564735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:25.564735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:25.564735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:25.564735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:25.564735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:25.566008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:25.566008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:25.566008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:25.566008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:25.566008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:25.566008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:25.566008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:25.566008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:25.566008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:25.566008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:25.566008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:25.566008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:25.566008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:25.566008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:25.566008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:25.566008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:25.566801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:25.566801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:25.566801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:25.566801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:25.566801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:25.566801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:25.566801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:25.566801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:25.566801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:25.566801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:25.566801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 01:22:25.566801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:25.569575 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 102/199] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:25.571037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a902a1-00a0-4e79-af9f-778d48fa4b05 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:25.625757 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:25.656491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c1ec9-06a8-489b-b035-843117276d78 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:25.692263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a902a1-00a0-4e79-af9f-778d48fa4b05 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:25.700464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f8443-d27f-4cda-aadb-beba87af1530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:25.701383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f8443-d27f-4cda-aadb-beba87af1530 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:25.701859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f8443-d27f-4cda-aadb-beba87af1530 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:25.702655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f8443-d27f-4cda-aadb-beba87af1530 None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:25.704299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f8443-d27f-4cda-aadb-beba87af1530 None admin] RBAC: Authorizing `identity:get_project(project_id=9739ea1321b14d2187985347ea1247dc)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:25.706278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f8443-d27f-4cda-aadb-beba87af1530 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:25.708225 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 98/200] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:25 2022] GET /identity/v3/projects/9739ea1321b14d2187985347ea1247dc => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:25.713333 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f8443-d27f-4cda-aadb-beba87af1530 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:25.732303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbca02-96c7-42c7-a503-162658c16aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:25.732941 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbca02-96c7-42c7-a503-162658c16aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:25.733221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbca02-96c7-42c7-a503-162658c16aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:25.733496 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbca02-96c7-42c7-a503-162658c16aa2 None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:25.734622 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbca02-96c7-42c7-a503-162658c16aa2 None admin] RBAC: Authorizing `identity:get_project(project_id=9739ea1321b14d2187985347ea1247dc)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:25.736165 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbca02-96c7-42c7-a503-162658c16aa2 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:25.738678 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 103/201] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:25 2022] GET /identity/v3/projects/9739ea1321b14d2187985347ea1247dc => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:25.739396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbca02-96c7-42c7-a503-162658c16aa2 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:25.746274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:25.834481 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f8443-d27f-4cda-aadb-beba87af1530 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:25.849440 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbca02-96c7-42c7-a503-162658c16aa2 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:25.861509 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:25.872973 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8dddc-2de4-4711-9fc1-27d233d5b236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:25.873893 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8dddc-2de4-4711-9fc1-27d233d5b236 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:25.874369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8dddc-2de4-4711-9fc1-27d233d5b236 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:25.874886 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8dddc-2de4-4711-9fc1-27d233d5b236 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:25.875820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8dddc-2de4-4711-9fc1-27d233d5b236 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:25.876493 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8dddc-2de4-4711-9fc1-27d233d5b236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:25.879279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8dddc-2de4-4711-9fc1-27d233d5b236 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:25.889080 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba0997-d55d-4baa-945c-c68f2f0ff486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:25.889696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba0997-d55d-4baa-945c-c68f2f0ff486 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:25.889971 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba0997-d55d-4baa-945c-c68f2f0ff486 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:25.890360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba0997-d55d-4baa-945c-c68f2f0ff486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:25.890789 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 99/202] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:25.891090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba0997-d55d-4baa-945c-c68f2f0ff486 None admin] RBAC: Adding query filter params (role.id=50adf18edc1a47b2bae0876828a88dbf, scope.project.id=9739ea1321b14d2187985347ea1247dc, user.id=eedcdf3be6834fe8a0aba836f9228c0c) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:25.891502 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba0997-d55d-4baa-945c-c68f2f0ff486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:25.892373 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8dddc-2de4-4711-9fc1-27d233d5b236 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:25.893585 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba0997-d55d-4baa-945c-c68f2f0ff486 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:25.900546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 104/203] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:22:25 2022] GET /identity/v3/role_assignments?user.id=eedcdf3be6834fe8a0aba836f9228c0c&scope.project.id=9739ea1321b14d2187985347ea1247dc&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:25.907116 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba0997-d55d-4baa-945c-c68f2f0ff486 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:26.070858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:26.097022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8dddc-2de4-4711-9fc1-27d233d5b236 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:26.118104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba0997-d55d-4baa-945c-c68f2f0ff486 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:26.169145 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34368f3-55c3-4c19-ad1b-8f0c9db33189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:26.170278 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34368f3-55c3-4c19-ad1b-8f0c9db33189 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:26.170783 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34368f3-55c3-4c19-ad1b-8f0c9db33189 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:26.171304 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34368f3-55c3-4c19-ad1b-8f0c9db33189 None admin] PATH_INFO: `/v3/users/62228de4885a400186e53d6cca6a30e2` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:26.172851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34368f3-55c3-4c19-ad1b-8f0c9db33189 None admin] RBAC: Authorizing `identity:get_user(user_id=62228de4885a400186e53d6cca6a30e2)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:26.174598 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34368f3-55c3-4c19-ad1b-8f0c9db33189 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:26.177087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 105/204] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:25 2022] GET /identity/v3/users/62228de4885a400186e53d6cca6a30e2 => generated 289 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:26.186703 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34368f3-55c3-4c19-ad1b-8f0c9db33189 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:26.208096 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac0020-0d8e-427a-bacb-e31a0a3871b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:26.208705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac0020-0d8e-427a-bacb-e31a0a3871b3 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:26.208982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac0020-0d8e-427a-bacb-e31a0a3871b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:26.209254 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac0020-0d8e-427a-bacb-e31a0a3871b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:26.209984 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac0020-0d8e-427a-bacb-e31a0a3871b3 None admin] RBAC: Adding query filter params (role.id=e1504eb5f35c468086d3b269e2c72011, scope.project.id=9739ea1321b14d2187985347ea1247dc, user.id=eedcdf3be6834fe8a0aba836f9228c0c) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:26.210289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac0020-0d8e-427a-bacb-e31a0a3871b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:26.211739 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac0020-0d8e-427a-bacb-e31a0a3871b3 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:26.224211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 100/205] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:22:25 2022] GET /identity/v3/role_assignments?user.id=eedcdf3be6834fe8a0aba836f9228c0c&scope.project.id=9739ea1321b14d2187985347ea1247dc&role.id=e1504eb5f35c468086d3b269e2c72011 => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:26.236982 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:26.304298 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34368f3-55c3-4c19-ad1b-8f0c9db33189 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:26.350586 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9f40b-01c5-4006-b560-9a250d50a9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:26.351481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9f40b-01c5-4006-b560-9a250d50a9ab None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:26.351902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9f40b-01c5-4006-b560-9a250d50a9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:26.352313 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9f40b-01c5-4006-b560-9a250d50a9ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:26.449692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9f40b-01c5-4006-b560-9a250d50a9ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:26.451489 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9f40b-01c5-4006-b560-9a250d50a9ab None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:26.498033 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:26.571784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 106/206] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:22:26.577722 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac0020-0d8e-427a-bacb-e31a0a3871b3 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:26.698859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac0020-0d8e-427a-bacb-e31a0a3871b3 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:26.738704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cb38d-8be6-497f-9028-b0255ac751e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:26.739373 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cb38d-8be6-497f-9028-b0255ac751e6 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:26.739650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cb38d-8be6-497f-9028-b0255ac751e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:26.739921 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cb38d-8be6-497f-9028-b0255ac751e6 None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:26.741049 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cb38d-8be6-497f-9028-b0255ac751e6 None admin] RBAC: Authorizing `identity:get_project(project_id=def6cb215c3c45f2a54435c338e667ab)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:26.742468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cb38d-8be6-497f-9028-b0255ac751e6 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:26.744119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 101/207] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:26 2022] GET /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:26.750139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9f40b-01c5-4006-b560-9a250d50a9ab None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:26.884711 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9f40b-01c5-4006-b560-9a250d50a9ab None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:26.939531 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dab758-2720-4063-9ff1-178aa3ee7c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:26.940181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dab758-2720-4063-9ff1-178aa3ee7c49 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:26.940470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dab758-2720-4063-9ff1-178aa3ee7c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:26.940744 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dab758-2720-4063-9ff1-178aa3ee7c49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:26.941481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dab758-2720-4063-9ff1-178aa3ee7c49 None admin] RBAC: Adding query filter params (role.id=4012481430d24230bf48f7a758321411, scope.project.id=def6cb215c3c45f2a54435c338e667ab, user.id=62228de4885a400186e53d6cca6a30e2) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:26.941791 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dab758-2720-4063-9ff1-178aa3ee7c49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:26.943260 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dab758-2720-4063-9ff1-178aa3ee7c49 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:26.949659 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 107/208] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:22:26 2022] GET /identity/v3/role_assignments?user.id=62228de4885a400186e53d6cca6a30e2&scope.project.id=def6cb215c3c45f2a54435c338e667ab&role.id=4012481430d24230bf48f7a758321411 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:27.560236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e125ea-e768-4446-b1dc-3e757131c64d None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:27.560932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e125ea-e768-4446-b1dc-3e757131c64d None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:27.561412 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e125ea-e768-4446-b1dc-3e757131c64d None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:27.563286 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 102/209] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:27.568760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cad2d3-7f32-49a3-8561-9f30958ff4c2 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:27.569052 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cad2d3-7f32-49a3-8561-9f30958ff4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:27.569327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cad2d3-7f32-49a3-8561-9f30958ff4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:27.583351 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:27.588828 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-90cad2d3-7f32-49a3-8561-9f30958ff4c2 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:27.590024 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-90cad2d3-7f32-49a3-8561-9f30958ff4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:27.616084 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e617f6d-df47-44a7-88b6-a2c7c21a1200 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:27.616384 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e617f6d-df47-44a7-88b6-a2c7c21a1200 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:27.616629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e617f6d-df47-44a7-88b6-a2c7c21a1200 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:27.618211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 103/210] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:27.623206 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bce8a-6c21-4e23-be19-f3955fbc9574 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:27.623489 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bce8a-6c21-4e23-be19-f3955fbc9574 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:27.623766 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bce8a-6c21-4e23-be19-f3955fbc9574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:27.642754 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-a72bce8a-6c21-4e23-be19-f3955fbc9574 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:27.644620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a72bce8a-6c21-4e23-be19-f3955fbc9574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:27.659824 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:27.670705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 108/211] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:27.719921 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 104/212] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:27.946468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cad2d3-7f32-49a3-8561-9f30958ff4c2 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:27.992813 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bce8a-6c21-4e23-be19-f3955fbc9574 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:28.056472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cad2d3-7f32-49a3-8561-9f30958ff4c2 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:28.104351 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d7b75-1f49-459e-9a99-f9c228e4e761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:28.105107 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7b75-1f49-459e-9a99-f9c228e4e761 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:28.105392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7b75-1f49-459e-9a99-f9c228e4e761 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:28.105666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7b75-1f49-459e-9a99-f9c228e4e761 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:28.109113 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:28.115135 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bce8a-6c21-4e23-be19-f3955fbc9574 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:28.120347 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d7b75-1f49-459e-9a99-f9c228e4e761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:28.125704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-609d7b75-1f49-459e-9a99-f9c228e4e761 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:28.125704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:28.125704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:28.125704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:28.125704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:28.125704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:28.125704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:28.125704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:28.125704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:28.125704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:28.125704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:28.125704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:28.125704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:28.125704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:28.125704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:28.125704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:28.126581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:28.126581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:28.126581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:28.126581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:28.126581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:28.126581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:28.126581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:28.126581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:28.126581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:28.126581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:28.126581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:28.126581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:28.126581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:28.126581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:28.126581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:28.126581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:28.127466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:28.127466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:28.127466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:28.127466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:28.127466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:28.127466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:28.127466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:28.127466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:28.127466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:28.127466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:28.127466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:28.127466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:28.128060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 109/213] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:28.134204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d7b75-1f49-459e-9a99-f9c228e4e761 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:28.162690 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96aae9-cc6b-4bb9-b344-e0977b717731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:28.163435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96aae9-cc6b-4bb9-b344-e0977b717731 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:28.163712 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96aae9-cc6b-4bb9-b344-e0977b717731 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:28.163991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96aae9-cc6b-4bb9-b344-e0977b717731 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:28.165125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96aae9-cc6b-4bb9-b344-e0977b717731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:28.167378 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96aae9-cc6b-4bb9-b344-e0977b717731 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:28.174077 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 105/214] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:22:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:28.175657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96aae9-cc6b-4bb9-b344-e0977b717731 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:28.197313 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:28.281446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d7b75-1f49-459e-9a99-f9c228e4e761 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:28.300165 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96aae9-cc6b-4bb9-b344-e0977b717731 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:28.328002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9108d-1eb7-4c26-9289-e711df25c493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:28.328614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9108d-1eb7-4c26-9289-e711df25c493 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:28.328894 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9108d-1eb7-4c26-9289-e711df25c493 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:28.329167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9108d-1eb7-4c26-9289-e711df25c493 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:28.329843 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9108d-1eb7-4c26-9289-e711df25c493 None admin] RBAC: Adding query filter params (name=member) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:28.330149 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9108d-1eb7-4c26-9289-e711df25c493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:28.332122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9108d-1eb7-4c26-9289-e711df25c493 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:28.340894 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 110/215] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:28.346045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c4946-0d32-451b-aebd-b0fa7be46a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:28.346937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9108d-1eb7-4c26-9289-e711df25c493 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:28.347760 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c4946-0d32-451b-aebd-b0fa7be46a7f None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:28.348333 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c4946-0d32-451b-aebd-b0fa7be46a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:28.348799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c4946-0d32-451b-aebd-b0fa7be46a7f None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:28.349752 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c4946-0d32-451b-aebd-b0fa7be46a7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:28.351527 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c4946-0d32-451b-aebd-b0fa7be46a7f None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:28.376170 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 106/216] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 26 01:22:28 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:22:28.377697 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eab6d-3cfd-4f79-bc7a-391de2a3e3ed None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:28.378014 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eab6d-3cfd-4f79-bc7a-391de2a3e3ed None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:28.378253 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eab6d-3cfd-4f79-bc7a-391de2a3e3ed None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:28.383827 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 107/217] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:28.385224 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460a86f-ecdf-430a-ac6a-34375cc62895 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:28.385506 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460a86f-ecdf-430a-ac6a-34375cc62895 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:28.385778 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460a86f-ecdf-430a-ac6a-34375cc62895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:28.410241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-c460a86f-ecdf-430a-ac6a-34375cc62895 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:28.411956 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c460a86f-ecdf-430a-ac6a-34375cc62895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:28.442006 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:28.494323 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9108d-1eb7-4c26-9289-e711df25c493 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:28.501255 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 108/218] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:28.538517 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db694744-8f4c-4460-81f9-745e66743cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:28.539474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db694744-8f4c-4460-81f9-745e66743cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:28.539907 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db694744-8f4c-4460-81f9-745e66743cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:28.540369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db694744-8f4c-4460-81f9-745e66743cd6 None admin] PATH_INFO: `/v3/users/b045c6452a5e455ea970a7b19e021824` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:28.557664 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db694744-8f4c-4460-81f9-745e66743cd6 None admin] RBAC: Authorizing `identity:get_user(user_id=b045c6452a5e455ea970a7b19e021824)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:28.559436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db694744-8f4c-4460-81f9-745e66743cd6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:28.561314 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 111/219] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:28 2022] GET /identity/v3/users/b045c6452a5e455ea970a7b19e021824 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:28.567788 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460a86f-ecdf-430a-ac6a-34375cc62895 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:28.571163 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:28.638381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc4f05-f415-4096-aa1f-d6a7cd12c948 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:28.638917 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc4f05-f415-4096-aa1f-d6a7cd12c948 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:28.639426 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc4f05-f415-4096-aa1f-d6a7cd12c948 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:28.641270 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 112/220] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:28.646523 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fe657-774c-4441-bec4-b881cd10f162 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:28.647223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fe657-774c-4441-bec4-b881cd10f162 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:28.647223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fe657-774c-4441-bec4-b881cd10f162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:28.668820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-ed1fe657-774c-4441-bec4-b881cd10f162 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:28.670453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ed1fe657-774c-4441-bec4-b881cd10f162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:28.686614 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460a86f-ecdf-430a-ac6a-34375cc62895 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:28.732218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0635c6a-981f-42d9-8d4f-477c8a4d0898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:28.732842 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0635c6a-981f-42d9-8d4f-477c8a4d0898 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:28.733090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0635c6a-981f-42d9-8d4f-477c8a4d0898 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:28.733361 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0635c6a-981f-42d9-8d4f-477c8a4d0898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:28.763698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 113/221] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:22:28.782982 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fe657-774c-4441-bec4-b881cd10f162 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:28.820538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0635c6a-981f-42d9-8d4f-477c8a4d0898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:28.821264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0635c6a-981f-42d9-8d4f-477c8a4d0898 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:28.824306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:28.847261 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:28.906646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fe657-774c-4441-bec4-b881cd10f162 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:28.948002 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 109/222] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:22:28.950042 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00896020-e4a1-446f-97b9-79f8d3613f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:28.951342 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896020-e4a1-446f-97b9-79f8d3613f8e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:28.951824 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896020-e4a1-446f-97b9-79f8d3613f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:28.952297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896020-e4a1-446f-97b9-79f8d3613f8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:28.956565 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0635c6a-981f-42d9-8d4f-477c8a4d0898 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:28.964814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00896020-e4a1-446f-97b9-79f8d3613f8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:28.970389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-00896020-e4a1-446f-97b9-79f8d3613f8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:28.970389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:28.970389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:28.970389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:28.970389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:28.970389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:28.970389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:28.970389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:28.970389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:28.970389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:28.970389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:28.970389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:28.970389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:28.970389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:28.970389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:28.970389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:28.971851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:28.971851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:28.971851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:28.971851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:28.971851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:28.971851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:28.971851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:28.971851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:28.971851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:28.971851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:28.971851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:28.971851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:28.971851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:28.971851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:28.971851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:28.971851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:28.972727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:28.972727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:28.972727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:28.972727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:28.972727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:28.972727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:28.972727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:28.972727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:28.972727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:28.972727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:28.972727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:28.972727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:28.974685 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 114/223] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:22:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:22:28.981329 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00896020-e4a1-446f-97b9-79f8d3613f8e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:29.088633 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0635c6a-981f-42d9-8d4f-477c8a4d0898 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:29.090470 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:29.114705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00896020-e4a1-446f-97b9-79f8d3613f8e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:29.126277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:29.149210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f4e38-3ea7-4841-9c47-d53a6ea43e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:29.149996 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f4e38-3ea7-4841-9c47-d53a6ea43e66 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:29.150271 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f4e38-3ea7-4841-9c47-d53a6ea43e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:29.150875 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f4e38-3ea7-4841-9c47-d53a6ea43e66 None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:29.152297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f4e38-3ea7-4841-9c47-d53a6ea43e66 None admin] RBAC: Authorizing `identity:get_project(project_id=9739ea1321b14d2187985347ea1247dc)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:29.153691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f4e38-3ea7-4841-9c47-d53a6ea43e66 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:29.155150 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e4d63-4b79-4eb6-8c53-70ac407e0bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:29.155360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 110/224] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:28 2022] GET /identity/v3/projects/9739ea1321b14d2187985347ea1247dc => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:29.156124 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f4e38-3ea7-4841-9c47-d53a6ea43e66 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:29.161389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e4d63-4b79-4eb6-8c53-70ac407e0bfb None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:29.161675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e4d63-4b79-4eb6-8c53-70ac407e0bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:29.161946 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e4d63-4b79-4eb6-8c53-70ac407e0bfb None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:29.162638 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e4d63-4b79-4eb6-8c53-70ac407e0bfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:29.162996 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e4d63-4b79-4eb6-8c53-70ac407e0bfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:29.164399 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e4d63-4b79-4eb6-8c53-70ac407e0bfb None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:29.173733 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 115/225] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:29.179244 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e4d63-4b79-4eb6-8c53-70ac407e0bfb None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:29.273917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f4e38-3ea7-4841-9c47-d53a6ea43e66 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:29.312830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e4d63-4b79-4eb6-8c53-70ac407e0bfb None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:29.319621 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235ee6a-b02a-4553-a6ad-b42117829d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:29.320542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235ee6a-b02a-4553-a6ad-b42117829d7f None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:29.320817 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235ee6a-b02a-4553-a6ad-b42117829d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:29.321085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235ee6a-b02a-4553-a6ad-b42117829d7f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:29.334545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235ee6a-b02a-4553-a6ad-b42117829d7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:29.341180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-b235ee6a-b02a-4553-a6ad-b42117829d7f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:29.341180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:29.341180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:29.341180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:29.341180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:29.341180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:29.341180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:29.341180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:29.341180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:29.341180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:29.341180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:29.341180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:29.341180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:29.341180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:29.341180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:29.341180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:29.342064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:29.342064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:29.342064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:29.342064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:29.342064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:29.342064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:29.342064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:29.342064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:29.342064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:29.342064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:29.342064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:29.342064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:29.342064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:29.342064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:29.342064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:29.342064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:29.343457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:29.343457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:29.343457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:29.343457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:29.343457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:29.343457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:29.343457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:29.343457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:29.343457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:29.343457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:29.343457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:29.343457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:29.343457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 111/226] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:22:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:29.347119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235ee6a-b02a-4553-a6ad-b42117829d7f None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:29.361038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3e288-f27e-4751-9433-24ef35a228f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:29.362529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3e288-f27e-4751-9433-24ef35a228f5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:29.363061 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3e288-f27e-4751-9433-24ef35a228f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:29.363647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3e288-f27e-4751-9433-24ef35a228f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:29.364506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3e288-f27e-4751-9433-24ef35a228f5 None admin] RBAC: Adding query filter params (role.id=f4df3a7a4c0b4730abc0601e2b072ef4, scope.project.id=9739ea1321b14d2187985347ea1247dc, user.id=b045c6452a5e455ea970a7b19e021824) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:29.364922 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3e288-f27e-4751-9433-24ef35a228f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:29.366451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3e288-f27e-4751-9433-24ef35a228f5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:29.372544 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 116/227] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:22:29 2022] GET /identity/v3/role_assignments?user.id=b045c6452a5e455ea970a7b19e021824&scope.project.id=9739ea1321b14d2187985347ea1247dc&role.id=f4df3a7a4c0b4730abc0601e2b072ef4 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:29.373525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3e288-f27e-4751-9433-24ef35a228f5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:29.389109 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:29.438624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:29.489007 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235ee6a-b02a-4553-a6ad-b42117829d7f None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:29.531017 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367055c8-3075-43fb-8fa4-097316065616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:29.532045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367055c8-3075-43fb-8fa4-097316065616 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:29.532516 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367055c8-3075-43fb-8fa4-097316065616 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:29.533196 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367055c8-3075-43fb-8fa4-097316065616 None admin] PATH_INFO: `/v3/users/eedcdf3be6834fe8a0aba836f9228c0c` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:29.539861 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367055c8-3075-43fb-8fa4-097316065616 None admin] RBAC: Authorizing `identity:get_user(user_id=eedcdf3be6834fe8a0aba836f9228c0c)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:29.542316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367055c8-3075-43fb-8fa4-097316065616 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:29.544326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 112/228] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:29 2022] GET /identity/v3/users/eedcdf3be6834fe8a0aba836f9228c0c => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:29.551851 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367055c8-3075-43fb-8fa4-097316065616 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:29.611282 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3e288-f27e-4751-9433-24ef35a228f5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:29.656442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305cf99-f6da-4f2f-bd54-c59e76bd2e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:29.659049 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305cf99-f6da-4f2f-bd54-c59e76bd2e37 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:29.659728 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305cf99-f6da-4f2f-bd54-c59e76bd2e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:29.660968 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305cf99-f6da-4f2f-bd54-c59e76bd2e37 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:29.661995 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305cf99-f6da-4f2f-bd54-c59e76bd2e37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:29.664072 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305cf99-f6da-4f2f-bd54-c59e76bd2e37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:29.666367 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305cf99-f6da-4f2f-bd54-c59e76bd2e37 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:29.684966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 117/229] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:22:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:29.690962 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305cf99-f6da-4f2f-bd54-c59e76bd2e37 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:29.774057 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:29.780067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367055c8-3075-43fb-8fa4-097316065616 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:29.852453 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecb0cb-10dc-4bf9-97f4-caae8b30afd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:29.853493 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecb0cb-10dc-4bf9-97f4-caae8b30afd2 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:29.853962 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecb0cb-10dc-4bf9-97f4-caae8b30afd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:29.854423 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecb0cb-10dc-4bf9-97f4-caae8b30afd2 None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:29.856921 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecb0cb-10dc-4bf9-97f4-caae8b30afd2 None admin] RBAC: Authorizing `identity:get_project(project_id=9739ea1321b14d2187985347ea1247dc)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:29.858543 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecb0cb-10dc-4bf9-97f4-caae8b30afd2 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:29.863791 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 113/230] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:29 2022] GET /identity/v3/projects/9739ea1321b14d2187985347ea1247dc => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:29.869474 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecb0cb-10dc-4bf9-97f4-caae8b30afd2 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:29.888680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:29.899221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305cf99-f6da-4f2f-bd54-c59e76bd2e37 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:29.965258 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90800eff-fe20-4c77-bb9f-eb4cd087d83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:29.965915 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90800eff-fe20-4c77-bb9f-eb4cd087d83c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:29.966157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90800eff-fe20-4c77-bb9f-eb4cd087d83c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:29.966430 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90800eff-fe20-4c77-bb9f-eb4cd087d83c None admin] PATH_INFO: `/v3/users/eedcdf3be6834fe8a0aba836f9228c0c` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:29.968459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90800eff-fe20-4c77-bb9f-eb4cd087d83c None admin] RBAC: Authorizing `identity:get_user(user_id=eedcdf3be6834fe8a0aba836f9228c0c)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:29.969897 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90800eff-fe20-4c77-bb9f-eb4cd087d83c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:29.972082 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 118/231] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:29 2022] GET /identity/v3/users/eedcdf3be6834fe8a0aba836f9228c0c => generated 283 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:29.977535 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90800eff-fe20-4c77-bb9f-eb4cd087d83c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:30.051897 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecb0cb-10dc-4bf9-97f4-caae8b30afd2 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:30.116755 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31513d03-4eeb-47eb-b7be-2779c90e6c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:30.117337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31513d03-4eeb-47eb-b7be-2779c90e6c85 None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:30.117614 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31513d03-4eeb-47eb-b7be-2779c90e6c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:30.117882 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31513d03-4eeb-47eb-b7be-2779c90e6c85 None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc/users/eedcdf3be6834fe8a0aba836f9228c0c/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:30.121249 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31513d03-4eeb-47eb-b7be-2779c90e6c85 None admin] RBAC: Authorizing `identity:create_grant(project_id=9739ea1321b14d2187985347ea1247dc, user_id=eedcdf3be6834fe8a0aba836f9228c0c, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:30.122743 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31513d03-4eeb-47eb-b7be-2779c90e6c85 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:30.143491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 114/232] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:22:29 2022] PUT /identity/v3/projects/9739ea1321b14d2187985347ea1247dc/users/eedcdf3be6834fe8a0aba836f9228c0c/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:22:30.149117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90800eff-fe20-4c77-bb9f-eb4cd087d83c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:30.186006 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2d9d3-e672-43fc-b48f-38e5a11cc8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:30.186645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2d9d3-e672-43fc-b48f-38e5a11cc8be None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:30.187005 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2d9d3-e672-43fc-b48f-38e5a11cc8be None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:30.187320 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2d9d3-e672-43fc-b48f-38e5a11cc8be None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:30.188533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2d9d3-e672-43fc-b48f-38e5a11cc8be None admin] RBAC: Authorizing `identity:get_project(project_id=9739ea1321b14d2187985347ea1247dc)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:30.190038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2d9d3-e672-43fc-b48f-38e5a11cc8be None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:30.192440 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 119/233] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:29 2022] GET /identity/v3/projects/9739ea1321b14d2187985347ea1247dc => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:30.200483 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31513d03-4eeb-47eb-b7be-2779c90e6c85 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:30.237836 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:30.324360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31513d03-4eeb-47eb-b7be-2779c90e6c85 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:30.359843 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc0a3c-5470-4baa-aa9b-12408e322afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:30.360505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc0a3c-5470-4baa-aa9b-12408e322afd None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:30.360778 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc0a3c-5470-4baa-aa9b-12408e322afd None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:30.361045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc0a3c-5470-4baa-aa9b-12408e322afd None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc/users/eedcdf3be6834fe8a0aba836f9228c0c/roles/e1504eb5f35c468086d3b269e2c72011` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:30.363964 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc0a3c-5470-4baa-aa9b-12408e322afd None admin] RBAC: Authorizing `identity:create_grant(project_id=9739ea1321b14d2187985347ea1247dc, user_id=eedcdf3be6834fe8a0aba836f9228c0c, role_id=e1504eb5f35c468086d3b269e2c72011)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:30.365413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc0a3c-5470-4baa-aa9b-12408e322afd None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:30.390007 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 115/234] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:22:30 2022] PUT /identity/v3/projects/9739ea1321b14d2187985347ea1247dc/users/eedcdf3be6834fe8a0aba836f9228c0c/roles/e1504eb5f35c468086d3b269e2c72011 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:22:31.120469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d620542-7fba-4e7a-a081-e7838ea3be15 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:31.121008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d620542-7fba-4e7a-a081-e7838ea3be15 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:31.121008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d620542-7fba-4e7a-a081-e7838ea3be15 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:31.122476 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 120/235] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:31.128007 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b5aab-eced-44d0-a62d-787558ee1dca None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:31.128397 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b5aab-eced-44d0-a62d-787558ee1dca None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:31.128604 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b5aab-eced-44d0-a62d-787558ee1dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:31.155805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-859b5aab-eced-44d0-a62d-787558ee1dca None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:31.157001 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-859b5aab-eced-44d0-a62d-787558ee1dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:31.246052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 116/236] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:31.419158 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b116d-236a-477f-86db-412d75b5baea None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:31.419468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b116d-236a-477f-86db-412d75b5baea None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:31.419705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b116d-236a-477f-86db-412d75b5baea None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:31.421394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 121/237] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:31.427570 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6726d-7b15-443f-889a-3f0c62318c45 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:31.427874 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6726d-7b15-443f-889a-3f0c62318c45 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:31.428121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6726d-7b15-443f-889a-3f0c62318c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:31.447826 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-92b6726d-7b15-443f-889a-3f0c62318c45 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:31.449022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-92b6726d-7b15-443f-889a-3f0c62318c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:31.461800 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:31.525272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 117/238] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:31.601767 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b116d-236a-477f-86db-412d75b5baea None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:31.642175 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:31.732459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b116d-236a-477f-86db-412d75b5baea None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:31.780691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345a4c8-633a-4c9f-aaa7-4bc2d795e8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:31.781319 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345a4c8-633a-4c9f-aaa7-4bc2d795e8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:31.781597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345a4c8-633a-4c9f-aaa7-4bc2d795e8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:31.781869 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345a4c8-633a-4c9f-aaa7-4bc2d795e8d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:31.805360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345a4c8-633a-4c9f-aaa7-4bc2d795e8d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:31.810613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-5345a4c8-633a-4c9f-aaa7-4bc2d795e8d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 01:22:31.810613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:31.810613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:31.810613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:31.810613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:31.810613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:31.810613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:31.810613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:31.810613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:31.810613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:31.810613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:31.810613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:31.810613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:31.810613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:31.810613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:31.810613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:31.811582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:31.811582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:31.811582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:31.811582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:31.811582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:31.811582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:31.811582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:31.811582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:31.811582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:31.811582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:31.811582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:31.811582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:31.811582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:31.811582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:31.811582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:31.811582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:31.812356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:31.812356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:31.812356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:31.812356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:31.812356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:31.812356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:31.812356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:31.812356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:31.812356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:31.812356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:31.812356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 01:22:31.812356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:31.812356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 122/239] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:31.820334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6726d-7b15-443f-889a-3f0c62318c45 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:31.925911 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2db06-de85-4cbe-b109-94170cb04d19 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:31.926260 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2db06-de85-4cbe-b109-94170cb04d19 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:31.926439 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2db06-de85-4cbe-b109-94170cb04d19 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:31.927802 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 123/240] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:22:31.932862 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34116067-9c81-442b-b463-b8c4a49d5407 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:31.933147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34116067-9c81-442b-b463-b8c4a49d5407 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:31.933417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34116067-9c81-442b-b463-b8c4a49d5407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:31.959100 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6726d-7b15-443f-889a-3f0c62318c45 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:31.960120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-34116067-9c81-442b-b463-b8c4a49d5407 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:31.962447 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-34116067-9c81-442b-b463-b8c4a49d5407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:31.995531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c0afb-182e-4c76-9ff6-f55d7af6761b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:31.996045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c0afb-182e-4c76-9ff6-f55d7af6761b None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:31.996319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c0afb-182e-4c76-9ff6-f55d7af6761b None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:31.996589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c0afb-182e-4c76-9ff6-f55d7af6761b None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:31.997241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c0afb-182e-4c76-9ff6-f55d7af6761b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:31.997592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c0afb-182e-4c76-9ff6-f55d7af6761b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:31.999014 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c0afb-182e-4c76-9ff6-f55d7af6761b None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:32.008257 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 118/241] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:32.009072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c0afb-182e-4c76-9ff6-f55d7af6761b None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:32.020625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:32.051455 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 124/242] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:22:32.056411 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34116067-9c81-442b-b463-b8c4a49d5407 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:32.097528 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:32.197860 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c0afb-182e-4c76-9ff6-f55d7af6761b None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:32.210452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34116067-9c81-442b-b463-b8c4a49d5407 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:32.252715 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68b143-3552-4541-ad01-831db517b1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:32.253707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68b143-3552-4541-ad01-831db517b1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:32.253988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68b143-3552-4541-ad01-831db517b1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:32.254256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68b143-3552-4541-ad01-831db517b1e8 None admin] PATH_INFO: `/v3/users/f44444633dbe483398fda3a142299222` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:32.269617 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68b143-3552-4541-ad01-831db517b1e8 None admin] RBAC: Authorizing `identity:get_user(user_id=f44444633dbe483398fda3a142299222)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:32.271127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68b143-3552-4541-ad01-831db517b1e8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:32.273548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 125/243] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:32 2022] GET /identity/v3/users/f44444633dbe483398fda3a142299222 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:32.278980 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68b143-3552-4541-ad01-831db517b1e8 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:32.289259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74e488-b481-4aef-a65e-f4bf5ba6c2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:32.289899 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74e488-b481-4aef-a65e-f4bf5ba6c2cd None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:32.290174 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74e488-b481-4aef-a65e-f4bf5ba6c2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:32.290445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74e488-b481-4aef-a65e-f4bf5ba6c2cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:32.291590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74e488-b481-4aef-a65e-f4bf5ba6c2cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:32.293022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74e488-b481-4aef-a65e-f4bf5ba6c2cd None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:32.294596 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 119/244] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:22:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:32.313955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74e488-b481-4aef-a65e-f4bf5ba6c2cd None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:32.375205 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:32.394488 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68b143-3552-4541-ad01-831db517b1e8 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:32.445565 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986d60d-ee47-4f1c-9623-c02378257eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:32.446560 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986d60d-ee47-4f1c-9623-c02378257eca None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:32.447071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986d60d-ee47-4f1c-9623-c02378257eca None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:32.447547 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986d60d-ee47-4f1c-9623-c02378257eca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:32.475236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:32.488180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74e488-b481-4aef-a65e-f4bf5ba6c2cd None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:32.521049 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986d60d-ee47-4f1c-9623-c02378257eca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:32.522724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986d60d-ee47-4f1c-9623-c02378257eca None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:32.527150 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4a6bd-3bc4-4d2b-8901-a988b63e7132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:32.527887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4a6bd-3bc4-4d2b-8901-a988b63e7132 None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:32.528267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4a6bd-3bc4-4d2b-8901-a988b63e7132 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:32.528644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4a6bd-3bc4-4d2b-8901-a988b63e7132 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:32.529400 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4a6bd-3bc4-4d2b-8901-a988b63e7132 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:32.530940 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4a6bd-3bc4-4d2b-8901-a988b63e7132 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:32.562900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 120/245] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 26 01:22:32 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:22:32.562900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4a6bd-3bc4-4d2b-8901-a988b63e7132 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:32.667060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:32.681673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4a6bd-3bc4-4d2b-8901-a988b63e7132 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:32.720858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a95b1-7c5a-443d-9814-e61f3612879a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:32.722322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a95b1-7c5a-443d-9814-e61f3612879a None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:32.722702 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a95b1-7c5a-443d-9814-e61f3612879a None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:32.723286 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a95b1-7c5a-443d-9814-e61f3612879a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:32.725814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 126/246] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 01:22:32.738979 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a95b1-7c5a-443d-9814-e61f3612879a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:32.746912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-4d7a95b1-7c5a-443d-9814-e61f3612879a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:32.746912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:32.746912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:32.746912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:32.746912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:32.746912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:32.746912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:32.746912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:32.746912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:32.746912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:32.746912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:32.746912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:32.746912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:32.746912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:32.746912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:32.746912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:32.747946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:32.747946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:32.747946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:32.747946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:32.747946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:32.747946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:32.747946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:32.747946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:32.747946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:32.747946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:32.747946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:32.747946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:32.747946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:32.747946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:32.747946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:32.747946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:32.748708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:32.748708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:32.748708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:32.748708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:32.748708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:32.748708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:32.748708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:32.748708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:32.748708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:32.748708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:32.748708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:32.748708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:32.748708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:32.748708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 121/247] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:32.749409 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a95b1-7c5a-443d-9814-e61f3612879a None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:32.750752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986d60d-ee47-4f1c-9623-c02378257eca None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:32.909635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a95b1-7c5a-443d-9814-e61f3612879a None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:32.947669 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986d60d-ee47-4f1c-9623-c02378257eca None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:32.957954 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114d12d-093f-470d-8d88-2723ed9c7607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:32.957954 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114d12d-093f-470d-8d88-2723ed9c7607 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:32.957954 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114d12d-093f-470d-8d88-2723ed9c7607 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:32.957954 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114d12d-093f-470d-8d88-2723ed9c7607 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:32.958348 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114d12d-093f-470d-8d88-2723ed9c7607 None admin] RBAC: Adding query filter params (name=member) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:32.958348 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114d12d-093f-470d-8d88-2723ed9c7607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:32.958348 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114d12d-093f-470d-8d88-2723ed9c7607 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:32.968530 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 122/248] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:32.972199 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd25f9c-3089-4886-8748-02023945c6a3 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:32.972696 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd25f9c-3089-4886-8748-02023945c6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:32.973688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd25f9c-3089-4886-8748-02023945c6a3 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:32.975749 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 123/249] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:32.976678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd25f9c-3089-4886-8748-02023945c6a3 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:32.994198 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a40765-d5e4-474f-8973-2cee0d977f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:32.995145 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a40765-d5e4-474f-8973-2cee0d977f50 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:32.995425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a40765-d5e4-474f-8973-2cee0d977f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:32.995761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a40765-d5e4-474f-8973-2cee0d977f50 None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:32.997172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a40765-d5e4-474f-8973-2cee0d977f50 None admin] RBAC: Authorizing `identity:get_project(project_id=9739ea1321b14d2187985347ea1247dc)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:32.998685 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a40765-d5e4-474f-8973-2cee0d977f50 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:33.000416 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 127/250] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:32 2022] GET /identity/v3/projects/9739ea1321b14d2187985347ea1247dc => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:33.003383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c7e05-1ee4-490f-bcc3-32fa9677573c None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:33.003846 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c7e05-1ee4-490f-bcc3-32fa9677573c None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:33.003949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c7e05-1ee4-490f-bcc3-32fa9677573c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:33.028876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-713c7e05-1ee4-490f-bcc3-32fa9677573c None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:33.030104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-713c7e05-1ee4-490f-bcc3-32fa9677573c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:33.052788 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:33.093630 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:33.115665 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd25f9c-3089-4886-8748-02023945c6a3 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:33.129051 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 128/251] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:33.134853 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c7e05-1ee4-490f-bcc3-32fa9677573c None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:33.169704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b9176-f09f-4610-bdeb-61a4489576af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:33.170257 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b9176-f09f-4610-bdeb-61a4489576af None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:33.170537 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b9176-f09f-4610-bdeb-61a4489576af None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:33.170813 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b9176-f09f-4610-bdeb-61a4489576af None admin] PATH_INFO: `/v3/users/b045c6452a5e455ea970a7b19e021824` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:33.172212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b9176-f09f-4610-bdeb-61a4489576af None admin] RBAC: Authorizing `identity:get_user(user_id=b045c6452a5e455ea970a7b19e021824)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:33.174951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b9176-f09f-4610-bdeb-61a4489576af None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:33.176813 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 124/252] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:32 2022] GET /identity/v3/users/b045c6452a5e455ea970a7b19e021824 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:33.183192 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b9176-f09f-4610-bdeb-61a4489576af None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:33.252681 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c7e05-1ee4-490f-bcc3-32fa9677573c None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:33.302773 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01338e-5c73-4453-b120-7f619c56475c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:33.303580 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01338e-5c73-4453-b120-7f619c56475c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:33.303856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01338e-5c73-4453-b120-7f619c56475c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:33.304478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01338e-5c73-4453-b120-7f619c56475c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:33.305478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01338e-5c73-4453-b120-7f619c56475c None admin] RBAC: Adding query filter params (role.id=4012481430d24230bf48f7a758321411, scope.project.id=9739ea1321b14d2187985347ea1247dc, user.id=f44444633dbe483398fda3a142299222) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:33.305789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01338e-5c73-4453-b120-7f619c56475c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:33.306871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b9176-f09f-4610-bdeb-61a4489576af None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:33.307308 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01338e-5c73-4453-b120-7f619c56475c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:33.315285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 129/253] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:22:33 2022] GET /identity/v3/role_assignments?user.id=f44444633dbe483398fda3a142299222&scope.project.id=9739ea1321b14d2187985347ea1247dc&role.id=4012481430d24230bf48f7a758321411 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:33.316331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feba07-9669-40ff-938c-e85026b8cef4 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:33.316607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feba07-9669-40ff-938c-e85026b8cef4 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:33.316876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feba07-9669-40ff-938c-e85026b8cef4 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:33.318896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 130/254] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:33.326100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699018b-2549-4034-adb3-cf2ec8ae0659 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:33.326414 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699018b-2549-4034-adb3-cf2ec8ae0659 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:33.326665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699018b-2549-4034-adb3-cf2ec8ae0659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:33.349255 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-6699018b-2549-4034-adb3-cf2ec8ae0659 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:33.350380 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:33.350492 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6699018b-2549-4034-adb3-cf2ec8ae0659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:33.381889 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f8963-2c2b-43f0-a1f1-bca03f5e2f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:33.382539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f8963-2c2b-43f0-a1f1-bca03f5e2f1b None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:33.382842 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f8963-2c2b-43f0-a1f1-bca03f5e2f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:33.383119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f8963-2c2b-43f0-a1f1-bca03f5e2f1b None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:33.386942 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f8963-2c2b-43f0-a1f1-bca03f5e2f1b None admin] RBAC: Authorizing `identity:get_project(project_id=9739ea1321b14d2187985347ea1247dc)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:33.388628 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f8963-2c2b-43f0-a1f1-bca03f5e2f1b None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:33.390457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 125/255] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:33 2022] GET /identity/v3/projects/9739ea1321b14d2187985347ea1247dc => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:33.396732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f8963-2c2b-43f0-a1f1-bca03f5e2f1b None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:33.399121 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:33.480656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 131/256] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:33.481511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699018b-2549-4034-adb3-cf2ec8ae0659 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:33.615043 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f8963-2c2b-43f0-a1f1-bca03f5e2f1b None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:33.670242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699018b-2549-4034-adb3-cf2ec8ae0659 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:33.679532 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d423fd2-3849-4afe-afae-ba5ac7cabff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:33.680207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d423fd2-3849-4afe-afae-ba5ac7cabff7 None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:33.680490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d423fd2-3849-4afe-afae-ba5ac7cabff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:33.680764 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d423fd2-3849-4afe-afae-ba5ac7cabff7 None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc/users/b045c6452a5e455ea970a7b19e021824/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:33.686480 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d423fd2-3849-4afe-afae-ba5ac7cabff7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9739ea1321b14d2187985347ea1247dc, user_id=b045c6452a5e455ea970a7b19e021824, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:33.686480 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d423fd2-3849-4afe-afae-ba5ac7cabff7 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:33.717096 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 126/257] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:22:33 2022] PUT /identity/v3/projects/9739ea1321b14d2187985347ea1247dc/users/b045c6452a5e455ea970a7b19e021824/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:22:33.735687 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef87a55-6fbe-4e8a-8005-62f9a4d25f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:33.737400 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef87a55-6fbe-4e8a-8005-62f9a4d25f6a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:33.737893 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef87a55-6fbe-4e8a-8005-62f9a4d25f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:33.738352 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef87a55-6fbe-4e8a-8005-62f9a4d25f6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:33.755890 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef87a55-6fbe-4e8a-8005-62f9a4d25f6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:33.761406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-cef87a55-6fbe-4e8a-8005-62f9a4d25f6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:33.761406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:33.761406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:33.761406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:33.761406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:33.761406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:33.761406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:33.761406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:33.761406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:33.761406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:33.761406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:33.761406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:33.761406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:33.761406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:33.761406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:33.761406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:33.762303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:33.762303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:33.762303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:33.762303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:33.762303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:33.762303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:33.762303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:33.762303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:33.762303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:33.762303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:33.762303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:33.762303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:33.762303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:33.762303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:33.762303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:33.762303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:33.763104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:33.763104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:33.763104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:33.763104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:33.763104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:33.763104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:33.763104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:33.763104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:33.763104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:33.763104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:33.763104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:33.763104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:33.765399 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 132/258] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:22:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:33.772436 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d423fd2-3849-4afe-afae-ba5ac7cabff7 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:33.842346 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef87a55-6fbe-4e8a-8005-62f9a4d25f6a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:33.845845 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:33.899468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:33.905032 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d423fd2-3849-4afe-afae-ba5ac7cabff7 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:33.944863 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aae6e5-a1d8-48bd-b64d-b755746d47e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:33.945773 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aae6e5-a1d8-48bd-b64d-b755746d47e7 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:33.946055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aae6e5-a1d8-48bd-b64d-b755746d47e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:33.946327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aae6e5-a1d8-48bd-b64d-b755746d47e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:33.947030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aae6e5-a1d8-48bd-b64d-b755746d47e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:33.947389 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aae6e5-a1d8-48bd-b64d-b755746d47e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:33.948769 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aae6e5-a1d8-48bd-b64d-b755746d47e7 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:33.958840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 127/259] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:33.964186 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aae6e5-a1d8-48bd-b64d-b755746d47e7 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:34.061263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef87a55-6fbe-4e8a-8005-62f9a4d25f6a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:34.133347 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b69c7a-4aaf-480d-9525-c079a1f4e649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:34.133982 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b69c7a-4aaf-480d-9525-c079a1f4e649 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:34.134255 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b69c7a-4aaf-480d-9525-c079a1f4e649 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:34.134524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b69c7a-4aaf-480d-9525-c079a1f4e649 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:34.155518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b69c7a-4aaf-480d-9525-c079a1f4e649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:34.160720 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aae6e5-a1d8-48bd-b64d-b755746d47e7 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:34.164647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-e5b69c7a-4aaf-480d-9525-c079a1f4e649 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:34.164647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:34.164647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:34.164647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:34.164647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:34.164647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:34.164647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:34.164647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:34.164647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:34.164647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:34.164647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:34.164647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:34.164647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:34.164647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:34.164647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:34.164647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:34.165542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:34.165542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:34.165542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:34.165542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:34.165542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:34.165542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:34.165542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:34.165542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:34.165542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:34.165542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:34.165542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:34.165542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:34.165542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:34.165542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:34.165542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:34.165542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:34.166415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:34.166415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:34.166415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:34.166415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:34.166415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:34.166415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:34.166415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:34.166415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:34.166415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:34.166415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:34.166415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:34.166415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:34.167405 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 133/260] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:22:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:34.172809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b69c7a-4aaf-480d-9525-c079a1f4e649 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:34.187558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:34.223697 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc600117-35e6-44e0-9be0-2258e3071045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:34.224331 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc600117-35e6-44e0-9be0-2258e3071045 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:34.224604 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc600117-35e6-44e0-9be0-2258e3071045 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:34.224873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc600117-35e6-44e0-9be0-2258e3071045 None admin] PATH_INFO: `/v3/users/eedcdf3be6834fe8a0aba836f9228c0c` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:34.226180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc600117-35e6-44e0-9be0-2258e3071045 None admin] RBAC: Authorizing `identity:get_user(user_id=eedcdf3be6834fe8a0aba836f9228c0c)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:34.228275 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc600117-35e6-44e0-9be0-2258e3071045 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:34.234729 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 128/261] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:33 2022] GET /identity/v3/users/eedcdf3be6834fe8a0aba836f9228c0c => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:34.240848 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc600117-35e6-44e0-9be0-2258e3071045 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:34.360147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:34.379998 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b69c7a-4aaf-480d-9525-c079a1f4e649 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:34.465262 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc600117-35e6-44e0-9be0-2258e3071045 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:34.483008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc023297-4826-4787-8061-a474b0bb3ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:34.483640 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc023297-4826-4787-8061-a474b0bb3ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:34.483919 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc023297-4826-4787-8061-a474b0bb3ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:34.484191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc023297-4826-4787-8061-a474b0bb3ec0 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:34.484872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc023297-4826-4787-8061-a474b0bb3ec0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:34.485173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc023297-4826-4787-8061-a474b0bb3ec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:34.487236 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc023297-4826-4787-8061-a474b0bb3ec0 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:34.506284 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 134/262] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:22:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:34.515927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc023297-4826-4787-8061-a474b0bb3ec0 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:34.530472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6141c2-0caa-47ff-b124-398fd181d587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:34.531993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6141c2-0caa-47ff-b124-398fd181d587 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:34.531993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6141c2-0caa-47ff-b124-398fd181d587 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:34.531993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6141c2-0caa-47ff-b124-398fd181d587 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:34.636571 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:34.674333 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6141c2-0caa-47ff-b124-398fd181d587 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:34.676190 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6141c2-0caa-47ff-b124-398fd181d587 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:34.731251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc023297-4826-4787-8061-a474b0bb3ec0 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:34.798144 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f43fe9-6a29-47ed-a2db-1dfbd6356be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:34.798777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f43fe9-6a29-47ed-a2db-1dfbd6356be1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:34.799177 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f43fe9-6a29-47ed-a2db-1dfbd6356be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:34.799450 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f43fe9-6a29-47ed-a2db-1dfbd6356be1 None admin] PATH_INFO: `/v3/users/eedcdf3be6834fe8a0aba836f9228c0c` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:34.803501 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f43fe9-6a29-47ed-a2db-1dfbd6356be1 None admin] RBAC: Authorizing `identity:get_user(user_id=eedcdf3be6834fe8a0aba836f9228c0c)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:34.805081 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f43fe9-6a29-47ed-a2db-1dfbd6356be1 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:34.806668 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 135/263] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:34 2022] GET /identity/v3/users/eedcdf3be6834fe8a0aba836f9228c0c => generated 283 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:34.812451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f43fe9-6a29-47ed-a2db-1dfbd6356be1 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:34.850640 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:34.879168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 129/264] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:22:34.885257 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6141c2-0caa-47ff-b124-398fd181d587 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:34.973563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f43fe9-6a29-47ed-a2db-1dfbd6356be1 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:35.045403 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:35.046625 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56573e3b-869d-4746-9074-880aac7db29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:35.047482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56573e3b-869d-4746-9074-880aac7db29d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:35.049802 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56573e3b-869d-4746-9074-880aac7db29d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:35.050949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56573e3b-869d-4746-9074-880aac7db29d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:35.084730 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6141c2-0caa-47ff-b124-398fd181d587 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:35.158452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87276b5-7209-4caf-b428-0614f215e439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:35.159381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87276b5-7209-4caf-b428-0614f215e439 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:35.159658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87276b5-7209-4caf-b428-0614f215e439 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:35.159925 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87276b5-7209-4caf-b428-0614f215e439 None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:35.161215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87276b5-7209-4caf-b428-0614f215e439 None admin] RBAC: Authorizing `identity:get_project(project_id=9739ea1321b14d2187985347ea1247dc)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:35.162636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87276b5-7209-4caf-b428-0614f215e439 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:35.164586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 130/265] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:34 2022] GET /identity/v3/projects/9739ea1321b14d2187985347ea1247dc => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:35.169947 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87276b5-7209-4caf-b428-0614f215e439 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:35.219865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56573e3b-869d-4746-9074-880aac7db29d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:35.221413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56573e3b-869d-4746-9074-880aac7db29d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:35.266924 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:35.290802 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87276b5-7209-4caf-b428-0614f215e439 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:35.331586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefc1e7-17bb-4246-914a-fc7865777c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:35.333564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefc1e7-17bb-4246-914a-fc7865777c67 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:35.334217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefc1e7-17bb-4246-914a-fc7865777c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:35.342723 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefc1e7-17bb-4246-914a-fc7865777c67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:35.342723 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefc1e7-17bb-4246-914a-fc7865777c67 None admin] RBAC: Adding query filter params (role.id=50adf18edc1a47b2bae0876828a88dbf, scope.project.id=9739ea1321b14d2187985347ea1247dc, user.id=eedcdf3be6834fe8a0aba836f9228c0c) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:35.342723 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefc1e7-17bb-4246-914a-fc7865777c67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:35.342723 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefc1e7-17bb-4246-914a-fc7865777c67 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:35.357450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 131/266] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:22:35 2022] GET /identity/v3/role_assignments?user.id=eedcdf3be6834fe8a0aba836f9228c0c&scope.project.id=9739ea1321b14d2187985347ea1247dc&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:35.439208 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 136/267] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 01:22:35.446397 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefc1e7-17bb-4246-914a-fc7865777c67 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:35.469784 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:35.601724 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefc1e7-17bb-4246-914a-fc7865777c67 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:35.642181 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87148078-1d9e-4447-baba-e92c1cc7543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:35.642952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87148078-1d9e-4447-baba-e92c1cc7543b None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:35.643237 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87148078-1d9e-4447-baba-e92c1cc7543b None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:35.643520 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87148078-1d9e-4447-baba-e92c1cc7543b None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:35.647622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87148078-1d9e-4447-baba-e92c1cc7543b None admin] RBAC: Authorizing `identity:get_project(project_id=9739ea1321b14d2187985347ea1247dc)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:35.649096 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87148078-1d9e-4447-baba-e92c1cc7543b None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:35.651067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 132/268] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:35 2022] GET /identity/v3/projects/9739ea1321b14d2187985347ea1247dc => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:35.657385 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56573e3b-869d-4746-9074-880aac7db29d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:35.830459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56573e3b-869d-4746-9074-880aac7db29d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:35.859141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:35.878424 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c43ee-3bc5-4318-9820-ef9657d33225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:35.879061 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c43ee-3bc5-4318-9820-ef9657d33225 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:35.879339 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c43ee-3bc5-4318-9820-ef9657d33225 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:35.879609 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c43ee-3bc5-4318-9820-ef9657d33225 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:35.880338 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c43ee-3bc5-4318-9820-ef9657d33225 None admin] RBAC: Adding query filter params (role.id=e1504eb5f35c468086d3b269e2c72011, scope.project.id=9739ea1321b14d2187985347ea1247dc, user.id=eedcdf3be6834fe8a0aba836f9228c0c) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:35.880639 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c43ee-3bc5-4318-9820-ef9657d33225 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:35.882075 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c43ee-3bc5-4318-9820-ef9657d33225 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:35.891596 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 137/269] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:22:35 2022] GET /identity/v3/role_assignments?user.id=eedcdf3be6834fe8a0aba836f9228c0c&scope.project.id=9739ea1321b14d2187985347ea1247dc&role.id=e1504eb5f35c468086d3b269e2c72011 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:35.976353 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a61ff-cb55-4b22-90e4-c9738e4916e3 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:35.976673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a61ff-cb55-4b22-90e4-c9738e4916e3 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:35.976916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a61ff-cb55-4b22-90e4-c9738e4916e3 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:35.978281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 133/270] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:35.984611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548130e4-6a60-4f67-82f9-6b3d7937f46b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:35.984892 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548130e4-6a60-4f67-82f9-6b3d7937f46b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:35.985170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548130e4-6a60-4f67-82f9-6b3d7937f46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:36.012091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-548130e4-6a60-4f67-82f9-6b3d7937f46b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:36.013331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-548130e4-6a60-4f67-82f9-6b3d7937f46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:36.116770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 138/271] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:36.344611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ad230-f23e-41df-baef-b2ae8aa95151 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:36.344994 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ad230-f23e-41df-baef-b2ae8aa95151 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:36.345167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ad230-f23e-41df-baef-b2ae8aa95151 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:36.347566 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 134/272] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:36.352676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4225ba-2a66-4a46-9634-9bc13280e1d4 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:36.352962 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4225ba-2a66-4a46-9634-9bc13280e1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:36.353236 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4225ba-2a66-4a46-9634-9bc13280e1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:36.375119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-5b4225ba-2a66-4a46-9634-9bc13280e1d4 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:36.376253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5b4225ba-2a66-4a46-9634-9bc13280e1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:36.420156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ca614-b917-4d8a-af23-b497d1d946bc None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:36.420458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ca614-b917-4d8a-af23-b497d1d946bc None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:36.420873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ca614-b917-4d8a-af23-b497d1d946bc None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:36.423917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 135/273] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:22:36.429694 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a10e61-83d0-40b6-984a-eb9804da4e38 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:36.429978 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a10e61-83d0-40b6-984a-eb9804da4e38 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:36.430262 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a10e61-83d0-40b6-984a-eb9804da4e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:36.452545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-10a10e61-83d0-40b6-984a-eb9804da4e38 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:36.453746 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-10a10e61-83d0-40b6-984a-eb9804da4e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:36.466231 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 139/274] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:36.468312 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4225ba-2a66-4a46-9634-9bc13280e1d4 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:36.523463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:36.533225 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 136/275] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:22:36.583661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4225ba-2a66-4a46-9634-9bc13280e1d4 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:36.618610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d92ce2-696e-46b2-a8fe-9f2617bd205d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:36.619261 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d92ce2-696e-46b2-a8fe-9f2617bd205d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:36.619535 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d92ce2-696e-46b2-a8fe-9f2617bd205d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:36.619806 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d92ce2-696e-46b2-a8fe-9f2617bd205d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:36.620906 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d92ce2-696e-46b2-a8fe-9f2617bd205d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:36.622451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d92ce2-696e-46b2-a8fe-9f2617bd205d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:36.624024 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 140/276] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:22:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:36.630170 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a10e61-83d0-40b6-984a-eb9804da4e38 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:36.655196 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:36.734116 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a10e61-83d0-40b6-984a-eb9804da4e38 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:36.751288 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d92ce2-696e-46b2-a8fe-9f2617bd205d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:36.771250 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a80e7-78f0-42f3-be0a-5ed3395ddb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:36.772156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a80e7-78f0-42f3-be0a-5ed3395ddb16 None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:36.772628 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a80e7-78f0-42f3-be0a-5ed3395ddb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:36.773091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a80e7-78f0-42f3-be0a-5ed3395ddb16 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:36.774097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a80e7-78f0-42f3-be0a-5ed3395ddb16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:36.775784 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a80e7-78f0-42f3-be0a-5ed3395ddb16 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:36.800626 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 137/277] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 26 01:22:36 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:22:36.811188 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a80e7-78f0-42f3-be0a-5ed3395ddb16 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:36.884220 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d92ce2-696e-46b2-a8fe-9f2617bd205d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:36.902556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:36.906665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:36.941630 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916fa9e-81f1-4014-a574-1112ca5169e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:36.942871 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916fa9e-81f1-4014-a574-1112ca5169e4 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:36.943304 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916fa9e-81f1-4014-a574-1112ca5169e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:36.943585 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916fa9e-81f1-4014-a574-1112ca5169e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:36.949211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a80e7-78f0-42f3-be0a-5ed3395ddb16 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:36.959316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916fa9e-81f1-4014-a574-1112ca5169e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:36.965137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-8916fa9e-81f1-4014-a574-1112ca5169e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:36.965137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:36.965137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:36.965137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:36.965137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:36.965137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:36.965137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:36.965137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:36.965137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:36.965137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:36.965137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:36.965137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:36.965137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:36.965137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:36.965137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:36.965137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:36.966100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:36.966100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:36.966100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:36.966100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:36.966100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:36.966100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:36.966100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:36.966100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:36.966100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:36.966100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:36.966100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:36.966100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:36.966100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:36.966100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:36.966100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:36.966100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:36.967393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:36.967393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:36.967393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:36.967393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:36.967393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:36.967393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:36.967393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:36.967393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:36.967393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:36.967393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:36.967393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:36.967393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:36.967393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 141/278] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:22:36.968063 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f9d6d-56d7-4e22-bfaa-187a3e20adea None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:36.968063 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f9d6d-56d7-4e22-bfaa-187a3e20adea None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:36.968179 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f9d6d-56d7-4e22-bfaa-187a3e20adea None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:36.970136 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 142/279] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:36.973134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f9d6d-56d7-4e22-bfaa-187a3e20adea None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:36.995539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ec2b7-6ff3-4bc5-bd0a-eb1e78aa96e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:36.996538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ec2b7-6ff3-4bc5-bd0a-eb1e78aa96e2 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:36.996538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ec2b7-6ff3-4bc5-bd0a-eb1e78aa96e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:36.996731 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ec2b7-6ff3-4bc5-bd0a-eb1e78aa96e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:37.011626 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ec2b7-6ff3-4bc5-bd0a-eb1e78aa96e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:37.016945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-988ec2b7-6ff3-4bc5-bd0a-eb1e78aa96e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 01:22:37.016945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:37.016945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:37.016945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:37.016945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:37.016945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:37.016945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:37.016945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:37.016945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:37.016945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:37.016945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:37.016945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:37.016945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:37.016945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:37.016945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:37.016945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:37.018573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:37.018573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:37.018573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:37.018573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:37.018573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:37.018573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:37.018573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:37.018573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:37.018573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:37.018573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:37.018573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:37.018573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:37.018573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:37.018573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:37.018573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:37.018573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:37.019559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:37.019559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:37.019559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:37.019559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:37.019559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:37.019559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:37.019559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:37.019559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:37.019559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:37.019559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:37.019559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 01:22:37.019559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:37.019559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 138/280] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:22:37.020191 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553b0c9-6dd8-4bcf-925a-fe17208206ad None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:37.020477 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553b0c9-6dd8-4bcf-925a-fe17208206ad None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:37.020750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553b0c9-6dd8-4bcf-925a-fe17208206ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:37.041352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-f553b0c9-6dd8-4bcf-925a-fe17208206ad None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:37.042556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f553b0c9-6dd8-4bcf-925a-fe17208206ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:37.108293 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f9d6d-56d7-4e22-bfaa-187a3e20adea None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:37.122977 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 139/281] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:37.123830 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553b0c9-6dd8-4bcf-925a-fe17208206ad None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:37.149129 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63ba62-1548-4a85-8560-9ebdd037bc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:37.150007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63ba62-1548-4a85-8560-9ebdd037bc34 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:37.150455 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63ba62-1548-4a85-8560-9ebdd037bc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:37.150923 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63ba62-1548-4a85-8560-9ebdd037bc34 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:37.151773 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63ba62-1548-4a85-8560-9ebdd037bc34 None admin] RBAC: Adding query filter params (name=member) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:37.152242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63ba62-1548-4a85-8560-9ebdd037bc34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:37.153773 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63ba62-1548-4a85-8560-9ebdd037bc34 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:37.164025 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 143/282] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:37.172565 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63ba62-1548-4a85-8560-9ebdd037bc34 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:37.199267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:37.213233 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:37.255906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553b0c9-6dd8-4bcf-925a-fe17208206ad None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:37.295939 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63ba62-1548-4a85-8560-9ebdd037bc34 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:37.311408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ab1c6-fed3-476d-898a-09fb09e2f924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:37.312360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ab1c6-fed3-476d-898a-09fb09e2f924 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:37.312855 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ab1c6-fed3-476d-898a-09fb09e2f924 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:37.313532 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ab1c6-fed3-476d-898a-09fb09e2f924 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:37.315015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ab1c6-fed3-476d-898a-09fb09e2f924 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:37.316060 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ab1c6-fed3-476d-898a-09fb09e2f924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:37.318140 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ab1c6-fed3-476d-898a-09fb09e2f924 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:37.329903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 140/283] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:37.335645 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ab1c6-fed3-476d-898a-09fb09e2f924 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:37.337140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb2e99-fcf4-47e2-958b-084520849d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:37.337827 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb2e99-fcf4-47e2-958b-084520849d1d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:37.338148 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb2e99-fcf4-47e2-958b-084520849d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:37.338451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb2e99-fcf4-47e2-958b-084520849d1d None admin] PATH_INFO: `/v3/users/6b1994a936144dd29acac10b034d0593` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:37.353796 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb2e99-fcf4-47e2-958b-084520849d1d None admin] RBAC: Authorizing `identity:get_user(user_id=6b1994a936144dd29acac10b034d0593)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:37.355391 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb2e99-fcf4-47e2-958b-084520849d1d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:37.357295 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 144/284] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:37 2022] GET /identity/v3/users/6b1994a936144dd29acac10b034d0593 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:37.366870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb2e99-fcf4-47e2-958b-084520849d1d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:37.506201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ab1c6-fed3-476d-898a-09fb09e2f924 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:37.524467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:37.535092 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb2e99-fcf4-47e2-958b-084520849d1d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:37.537489 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:37.545280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20aedde-3fd2-474a-b0ab-df03585a4617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:37.546171 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20aedde-3fd2-474a-b0ab-df03585a4617 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:37.546641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20aedde-3fd2-474a-b0ab-df03585a4617 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:37.547079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20aedde-3fd2-474a-b0ab-df03585a4617 None admin] PATH_INFO: `/v3/users/f44444633dbe483398fda3a142299222` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:37.548434 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20aedde-3fd2-474a-b0ab-df03585a4617 None admin] RBAC: Authorizing `identity:get_user(user_id=f44444633dbe483398fda3a142299222)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:37.550577 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20aedde-3fd2-474a-b0ab-df03585a4617 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:37.552832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 141/285] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:37 2022] GET /identity/v3/users/f44444633dbe483398fda3a142299222 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:37.553718 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20aedde-3fd2-474a-b0ab-df03585a4617 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:37.582436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f0d7b-07d6-4632-ac30-ddc89f7bd84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:37.583477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f0d7b-07d6-4632-ac30-ddc89f7bd84c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:37.583956 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f0d7b-07d6-4632-ac30-ddc89f7bd84c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:37.584428 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f0d7b-07d6-4632-ac30-ddc89f7bd84c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:37.585227 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f0d7b-07d6-4632-ac30-ddc89f7bd84c None admin] RBAC: Adding query filter params (role.id=f4df3a7a4c0b4730abc0601e2b072ef4, user.id=6b1994a936144dd29acac10b034d0593, scope.system=all) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:37.585590 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f0d7b-07d6-4632-ac30-ddc89f7bd84c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:37.587931 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f0d7b-07d6-4632-ac30-ddc89f7bd84c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:37.594622 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 145/286] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Sep 26 01:22:37 2022] GET /identity/v3/role_assignments?user.id=6b1994a936144dd29acac10b034d0593&scope.system=all&role.id=f4df3a7a4c0b4730abc0601e2b072ef4 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:37.602861 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f0d7b-07d6-4632-ac30-ddc89f7bd84c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:37.751382 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20aedde-3fd2-474a-b0ab-df03585a4617 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:37.806930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f0d7b-07d6-4632-ac30-ddc89f7bd84c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:37.811390 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fdd35-33d9-4f3f-bb5f-a1281fde2121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:37.812341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fdd35-33d9-4f3f-bb5f-a1281fde2121 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:37.812841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fdd35-33d9-4f3f-bb5f-a1281fde2121 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:37.813317 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fdd35-33d9-4f3f-bb5f-a1281fde2121 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:37.831177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fdd35-33d9-4f3f-bb5f-a1281fde2121 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:37.837168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-ba8fdd35-33d9-4f3f-bb5f-a1281fde2121 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:37.837168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:37.837168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:37.837168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:37.837168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:37.837168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:37.837168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:37.837168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:37.837168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:37.837168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:37.837168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:37.837168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:37.837168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:37.837168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:37.837168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:37.837168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:37.838035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:37.838035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:37.838035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:37.838035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:37.838035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:37.838035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:37.838035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:37.838035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:37.838035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:37.838035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:37.838035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:37.838035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:37.838035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:37.838035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:37.838035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:37.838035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:37.838806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:37.838806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:37.838806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:37.838806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:37.838806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:37.838806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:37.838806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:37.838806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:37.838806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:37.838806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:37.838806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:37.838806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:37.847837 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 142/287] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:37.850159 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fdd35-33d9-4f3f-bb5f-a1281fde2121 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:37.868563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4363f-7ff7-4af2-beab-e8e0e2127370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:37.869202 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4363f-7ff7-4af2-beab-e8e0e2127370 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:37.869479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4363f-7ff7-4af2-beab-e8e0e2127370 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:37.869750 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4363f-7ff7-4af2-beab-e8e0e2127370 None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:37.872802 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4363f-7ff7-4af2-beab-e8e0e2127370 None admin] RBAC: Authorizing `identity:get_project(project_id=9739ea1321b14d2187985347ea1247dc)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:37.874244 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4363f-7ff7-4af2-beab-e8e0e2127370 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:37.876048 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 146/288] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:37 2022] GET /identity/v3/projects/9739ea1321b14d2187985347ea1247dc => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:37.892265 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4363f-7ff7-4af2-beab-e8e0e2127370 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:37.920839 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:37.988377 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:38.011963 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4363f-7ff7-4af2-beab-e8e0e2127370 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:38.054615 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a94f0-eb3d-4887-87dd-b8a576edbb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:38.055302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a94f0-eb3d-4887-87dd-b8a576edbb62 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:38.055834 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a94f0-eb3d-4887-87dd-b8a576edbb62 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:38.056108 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a94f0-eb3d-4887-87dd-b8a576edbb62 None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc/users/f44444633dbe483398fda3a142299222/roles/4012481430d24230bf48f7a758321411` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:38.059027 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a94f0-eb3d-4887-87dd-b8a576edbb62 None admin] RBAC: Authorizing `identity:create_grant(project_id=9739ea1321b14d2187985347ea1247dc, user_id=f44444633dbe483398fda3a142299222, role_id=4012481430d24230bf48f7a758321411)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:38.060474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a94f0-eb3d-4887-87dd-b8a576edbb62 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:38.085374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fdd35-33d9-4f3f-bb5f-a1281fde2121 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:38.098128 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 147/289] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:22:37 2022] PUT /identity/v3/projects/9739ea1321b14d2187985347ea1247dc/users/f44444633dbe483398fda3a142299222/roles/4012481430d24230bf48f7a758321411 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:22:38.132956 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34daeab-069c-4fab-8f52-2808198fe9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:38.133583 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34daeab-069c-4fab-8f52-2808198fe9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:38.133862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34daeab-069c-4fab-8f52-2808198fe9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:38.134133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34daeab-069c-4fab-8f52-2808198fe9e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:38.134910 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34daeab-069c-4fab-8f52-2808198fe9e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:38.135289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34daeab-069c-4fab-8f52-2808198fe9e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:38.136850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34daeab-069c-4fab-8f52-2808198fe9e5 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:38.148835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 143/290] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:38.154894 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a94f0-eb3d-4887-87dd-b8a576edbb62 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:38.265940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:38.291466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a94f0-eb3d-4887-87dd-b8a576edbb62 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:38.336312 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d672628-68a9-4aa3-8f3d-381d1aaa0219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:38.336948 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d672628-68a9-4aa3-8f3d-381d1aaa0219 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:38.337224 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d672628-68a9-4aa3-8f3d-381d1aaa0219 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:38.337495 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d672628-68a9-4aa3-8f3d-381d1aaa0219 None admin] PATH_INFO: `/v3/users/b045c6452a5e455ea970a7b19e021824` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:38.338687 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d672628-68a9-4aa3-8f3d-381d1aaa0219 None admin] RBAC: Authorizing `identity:get_user(user_id=b045c6452a5e455ea970a7b19e021824)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:38.340274 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d672628-68a9-4aa3-8f3d-381d1aaa0219 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:38.342016 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 148/291] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:38 2022] GET /identity/v3/users/b045c6452a5e455ea970a7b19e021824 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:38.348107 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34daeab-069c-4fab-8f52-2808198fe9e5 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:38.470472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34daeab-069c-4fab-8f52-2808198fe9e5 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:38.499185 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:38.518459 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4146f5f-5533-403b-bc5e-622c0c3beb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:38.519021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4146f5f-5533-403b-bc5e-622c0c3beb45 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:38.519307 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4146f5f-5533-403b-bc5e-622c0c3beb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:38.519582 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4146f5f-5533-403b-bc5e-622c0c3beb45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:38.596266 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4146f5f-5533-403b-bc5e-622c0c3beb45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:38.598095 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4146f5f-5533-403b-bc5e-622c0c3beb45 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:38.699401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 144/292] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:22:38.707927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d672628-68a9-4aa3-8f3d-381d1aaa0219 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:38.851575 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d672628-68a9-4aa3-8f3d-381d1aaa0219 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:38.901394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4b98d-c855-4108-9af8-aa31357a705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:38.902026 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4b98d-c855-4108-9af8-aa31357a705d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:38.902306 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4b98d-c855-4108-9af8-aa31357a705d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:38.902576 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4b98d-c855-4108-9af8-aa31357a705d None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:38.903730 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4b98d-c855-4108-9af8-aa31357a705d None admin] RBAC: Authorizing `identity:get_project(project_id=9739ea1321b14d2187985347ea1247dc)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:38.905233 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4b98d-c855-4108-9af8-aa31357a705d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:38.907027 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 149/293] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:38 2022] GET /identity/v3/projects/9739ea1321b14d2187985347ea1247dc => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:38.913128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4146f5f-5533-403b-bc5e-622c0c3beb45 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:38.928787 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:39.035346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4146f5f-5533-403b-bc5e-622c0c3beb45 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:39.080504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba6b42-9eff-4312-924a-a9d659ae9ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:39.081125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba6b42-9eff-4312-924a-a9d659ae9ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:39.081402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba6b42-9eff-4312-924a-a9d659ae9ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:39.081672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba6b42-9eff-4312-924a-a9d659ae9ed7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:39.082489 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba6b42-9eff-4312-924a-a9d659ae9ed7 None admin] RBAC: Adding query filter params (role.id=f4df3a7a4c0b4730abc0601e2b072ef4, scope.project.id=9739ea1321b14d2187985347ea1247dc, user.id=b045c6452a5e455ea970a7b19e021824) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:39.082792 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba6b42-9eff-4312-924a-a9d659ae9ed7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:39.084250 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba6b42-9eff-4312-924a-a9d659ae9ed7 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:39.090704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 145/294] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:22:38 2022] GET /identity/v3/role_assignments?user.id=b045c6452a5e455ea970a7b19e021824&scope.project.id=9739ea1321b14d2187985347ea1247dc&role.id=f4df3a7a4c0b4730abc0601e2b072ef4 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:39.537519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac97dcb-a75f-4f01-9d01-f138558c4e6e None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:39.537794 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac97dcb-a75f-4f01-9d01-f138558c4e6e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:39.538324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac97dcb-a75f-4f01-9d01-f138558c4e6e None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:39.540127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 150/295] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:39.545090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc632c6-d00b-40e7-82b9-cd98a2ff61bb None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:39.545605 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc632c6-d00b-40e7-82b9-cd98a2ff61bb None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:39.546091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc632c6-d00b-40e7-82b9-cd98a2ff61bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:39.566711 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-dfc632c6-d00b-40e7-82b9-cd98a2ff61bb None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:39.568357 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-dfc632c6-d00b-40e7-82b9-cd98a2ff61bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:39.650794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 146/296] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:39.699234 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b0836-b680-42a5-849c-24caabbe5685 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:39.699835 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b0836-b680-42a5-849c-24caabbe5685 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:39.700301 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b0836-b680-42a5-849c-24caabbe5685 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:39.701812 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 151/297] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:39.707327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845363b-7f7b-4042-90e5-27aaa87df4f9 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:39.707831 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845363b-7f7b-4042-90e5-27aaa87df4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:39.708330 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845363b-7f7b-4042-90e5-27aaa87df4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:39.714805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:39.729978 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-c845363b-7f7b-4042-90e5-27aaa87df4f9 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:39.731186 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c845363b-7f7b-4042-90e5-27aaa87df4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:39.809535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 147/298] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:39.934694 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b0836-b680-42a5-849c-24caabbe5685 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:39.958451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:40.038884 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b0836-b680-42a5-849c-24caabbe5685 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:40.077041 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a33b9-a61c-463f-af4f-10a556d8f903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:40.077679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a33b9-a61c-463f-af4f-10a556d8f903 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:40.077953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a33b9-a61c-463f-af4f-10a556d8f903 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:40.078217 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a33b9-a61c-463f-af4f-10a556d8f903 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:40.081384 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845363b-7f7b-4042-90e5-27aaa87df4f9 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:40.091021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a33b9-a61c-463f-af4f-10a556d8f903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:40.096689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-f26a33b9-a61c-463f-af4f-10a556d8f903 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 01:22:40.096689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:40.096689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:40.096689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:40.096689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:40.096689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:40.096689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:40.096689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:40.096689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:40.096689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:40.096689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:40.096689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:40.096689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:40.096689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:40.096689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:40.096689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:40.097691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:40.097691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:40.097691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:40.097691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:40.097691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:40.097691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:40.097691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:40.097691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:40.097691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:40.097691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:40.097691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:40.097691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:40.097691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:40.097691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:40.097691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:40.097691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:40.098478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:40.098478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:40.098478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:40.098478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:40.098478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:40.098478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:40.098478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:40.098478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:40.098478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:40.098478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:40.098478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 01:22:40.098478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:40.098478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 152/299] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:40.104516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a33b9-a61c-463f-af4f-10a556d8f903 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:40.194060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:40.201145 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845363b-7f7b-4042-90e5-27aaa87df4f9 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:40.215659 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a33b9-a61c-463f-af4f-10a556d8f903 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:40.241657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:40.248270 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9e12c-e8c7-4727-9469-2cc7026a4537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:40.248942 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9e12c-e8c7-4727-9469-2cc7026a4537 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:40.249223 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9e12c-e8c7-4727-9469-2cc7026a4537 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:40.249496 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9e12c-e8c7-4727-9469-2cc7026a4537 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:40.250595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9e12c-e8c7-4727-9469-2cc7026a4537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:40.252151 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9e12c-e8c7-4727-9469-2cc7026a4537 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:40.252645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b07b8-73b4-4a6d-a5f2-757a04e110d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:40.253307 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b07b8-73b4-4a6d-a5f2-757a04e110d8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:40.253587 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b07b8-73b4-4a6d-a5f2-757a04e110d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:40.253856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b07b8-73b4-4a6d-a5f2-757a04e110d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:40.254519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b07b8-73b4-4a6d-a5f2-757a04e110d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:40.254815 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b07b8-73b4-4a6d-a5f2-757a04e110d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:40.256202 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b07b8-73b4-4a6d-a5f2-757a04e110d8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:40.258567 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 148/300] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:22:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:40.259917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc45d5f-cf7e-4732-9350-d8ecca59ac6b None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:40.260205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc45d5f-cf7e-4732-9350-d8ecca59ac6b None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:40.260483 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc45d5f-cf7e-4732-9350-d8ecca59ac6b None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:40.261728 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 149/301] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:40.262408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc45d5f-cf7e-4732-9350-d8ecca59ac6b None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:40.270857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 153/302] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:40.272780 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a28a5c-b79f-482e-bc36-018f828587da None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:40.273064 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a28a5c-b79f-482e-bc36-018f828587da None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:40.273337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a28a5c-b79f-482e-bc36-018f828587da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:40.291507 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-40a28a5c-b79f-482e-bc36-018f828587da None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:40.292680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-40a28a5c-b79f-482e-bc36-018f828587da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:40.370865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 154/303] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:40.370865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a28a5c-b79f-482e-bc36-018f828587da None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:40.380475 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc45d5f-cf7e-4732-9350-d8ecca59ac6b None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:40.420170 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abb674-6775-4501-81d9-da906291c0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:40.421037 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abb674-6775-4501-81d9-da906291c0fe None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:40.421487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abb674-6775-4501-81d9-da906291c0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:40.421937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abb674-6775-4501-81d9-da906291c0fe None admin] PATH_INFO: `/v3/groups` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:40.422932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abb674-6775-4501-81d9-da906291c0fe None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:40.425137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abb674-6775-4501-81d9-da906291c0fe None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:40.444036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 150/304] 10.222.0.26 () {60 vars in 1134 bytes} [Mon Sep 26 01:22:40 2022] POST /identity/v3/groups => generated 229 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:22:40.471165 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:40.506528 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a28a5c-b79f-482e-bc36-018f828587da None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:40.545654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac029c-e7df-4125-986a-e985a1cd9a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:40.546363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac029c-e7df-4125-986a-e985a1cd9a2c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:40.546651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac029c-e7df-4125-986a-e985a1cd9a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:40.546955 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac029c-e7df-4125-986a-e985a1cd9a2c None admin] PATH_INFO: `/v3/users/91b2fc75891740ce9a39c5cbfb8ee0cb` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:40.562941 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac029c-e7df-4125-986a-e985a1cd9a2c None admin] RBAC: Authorizing `identity:get_user(user_id=91b2fc75891740ce9a39c5cbfb8ee0cb)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:40.565029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac029c-e7df-4125-986a-e985a1cd9a2c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:40.567367 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 155/305] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:40 2022] GET /identity/v3/users/91b2fc75891740ce9a39c5cbfb8ee0cb => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:40.573742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abb674-6775-4501-81d9-da906291c0fe None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:40.639371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:40.672677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac029c-e7df-4125-986a-e985a1cd9a2c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:40.699435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abb674-6775-4501-81d9-da906291c0fe None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:40.747184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0c8d4-2a35-486b-ad2e-0c977d3ef1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:40.748739 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0c8d4-2a35-486b-ad2e-0c977d3ef1db None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:40.749298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0c8d4-2a35-486b-ad2e-0c977d3ef1db None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:40.749745 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0c8d4-2a35-486b-ad2e-0c977d3ef1db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:40.750661 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0c8d4-2a35-486b-ad2e-0c977d3ef1db None admin] RBAC: Adding query filter params (role.id=4012481430d24230bf48f7a758321411, user.id=91b2fc75891740ce9a39c5cbfb8ee0cb, scope.system=all) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:40.751488 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0c8d4-2a35-486b-ad2e-0c977d3ef1db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:40.754089 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0c8d4-2a35-486b-ad2e-0c977d3ef1db None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:40.762100 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 151/306] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Sep 26 01:22:40 2022] GET /identity/v3/role_assignments?user.id=91b2fc75891740ce9a39c5cbfb8ee0cb&scope.system=all&role.id=4012481430d24230bf48f7a758321411 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:40.778411 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a7994-e154-4b5a-abf0-e34f9f8ca1cb None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:40.778684 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a7994-e154-4b5a-abf0-e34f9f8ca1cb None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:40.779001 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a7994-e154-4b5a-abf0-e34f9f8ca1cb None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:40.780641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 152/307] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:22:40.786759 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a295a-2431-4ff5-bf6f-a4ae90ff685e None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:40.787101 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a295a-2431-4ff5-bf6f-a4ae90ff685e None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:40.787351 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a295a-2431-4ff5-bf6f-a4ae90ff685e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:40.797772 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac029c-e7df-4125-986a-e985a1cd9a2c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:40.807493 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-a46a295a-2431-4ff5-bf6f-a4ae90ff685e None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:40.808719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a46a295a-2431-4ff5-bf6f-a4ae90ff685e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:40.834574 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:40.842354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ccae9-c82e-4af1-8882-faad12755628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:40.843448 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ccae9-c82e-4af1-8882-faad12755628 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:40.844027 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ccae9-c82e-4af1-8882-faad12755628 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:40.844625 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ccae9-c82e-4af1-8882-faad12755628 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:40.858575 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ccae9-c82e-4af1-8882-faad12755628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:40.864549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-1c7ccae9-c82e-4af1-8882-faad12755628 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:40.864549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:40.864549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:40.864549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:40.864549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:40.864549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:40.864549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:40.864549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:40.864549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:40.864549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:40.864549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:40.864549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:40.864549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:40.864549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:40.864549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:40.864549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:40.865518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:40.865518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:40.865518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:40.865518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:40.865518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:40.865518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:40.865518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:40.865518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:40.865518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:40.865518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:40.865518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:40.865518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:40.865518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:40.865518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:40.865518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:40.865518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:40.866286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:40.866286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:40.866286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:40.866286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:40.866286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:40.866286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:40.866286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:40.866286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:40.866286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:40.866286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:40.866286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:40.866286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:40.869207 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 156/308] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:22:40.878965 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ccae9-c82e-4af1-8882-faad12755628 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:40.896447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 153/309] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:22:40.991091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ccae9-c82e-4af1-8882-faad12755628 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:41.031720 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8e33c-95eb-403c-898f-2f94bc85bea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:41.032248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8e33c-95eb-403c-898f-2f94bc85bea4 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:41.032524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8e33c-95eb-403c-898f-2f94bc85bea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:41.032797 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8e33c-95eb-403c-898f-2f94bc85bea4 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:41.033524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8e33c-95eb-403c-898f-2f94bc85bea4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:41.033812 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8e33c-95eb-403c-898f-2f94bc85bea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:41.035208 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8e33c-95eb-403c-898f-2f94bc85bea4 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:41.044003 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 157/310] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:41.050268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a295a-2431-4ff5-bf6f-a4ae90ff685e None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:41.114482 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:41.160667 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a295a-2431-4ff5-bf6f-a4ae90ff685e None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:41.173093 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8e33c-95eb-403c-898f-2f94bc85bea4 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:41.204129 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb5895-52ed-43e3-9c65-ab8aadb5b7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:41.205755 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb5895-52ed-43e3-9c65-ab8aadb5b7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:41.206237 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb5895-52ed-43e3-9c65-ab8aadb5b7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:41.206717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb5895-52ed-43e3-9c65-ab8aadb5b7b8 None admin] PATH_INFO: `/v3/users/6b1994a936144dd29acac10b034d0593` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:41.208677 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb5895-52ed-43e3-9c65-ab8aadb5b7b8 None admin] RBAC: Authorizing `identity:get_user(user_id=6b1994a936144dd29acac10b034d0593)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:41.210813 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb5895-52ed-43e3-9c65-ab8aadb5b7b8 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:41.213677 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 154/311] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:41 2022] GET /identity/v3/users/6b1994a936144dd29acac10b034d0593 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:41.221455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb5895-52ed-43e3-9c65-ab8aadb5b7b8 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:41.240078 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:41.294629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8e33c-95eb-403c-898f-2f94bc85bea4 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:41.330917 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349b81a-11fe-4907-a19c-fdfc2dea9eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:41.331566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349b81a-11fe-4907-a19c-fdfc2dea9eaa None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:41.331834 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349b81a-11fe-4907-a19c-fdfc2dea9eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:41.332104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349b81a-11fe-4907-a19c-fdfc2dea9eaa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:41.342979 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349b81a-11fe-4907-a19c-fdfc2dea9eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:41.344358 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb5895-52ed-43e3-9c65-ab8aadb5b7b8 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:41.348909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-3349b81a-11fe-4907-a19c-fdfc2dea9eaa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 01:22:41.348909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:41.348909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:41.348909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:41.348909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:41.348909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:41.348909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:41.348909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:41.348909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:41.348909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:41.348909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:41.348909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:41.348909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:41.348909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:41.348909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:41.348909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:41.349809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:41.349809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:41.349809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:41.349809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:41.349809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:41.349809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:41.349809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:41.349809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:41.349809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:41.349809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:41.349809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:41.349809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:41.349809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:41.349809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:41.349809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:41.349809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:41.350605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:41.350605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:41.350605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:41.350605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:41.350605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:41.350605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:41.350605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:41.350605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:41.350605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:41.350605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:41.350605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 01:22:41.350605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:41.350605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 158/312] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:41.355832 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349b81a-11fe-4907-a19c-fdfc2dea9eaa None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:41.374672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:41.390032 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a767786-8ae6-45e3-a300-2a9e6986ae2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:41.391142 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a767786-8ae6-45e3-a300-2a9e6986ae2e None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:41.391623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a767786-8ae6-45e3-a300-2a9e6986ae2e None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:41.392110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a767786-8ae6-45e3-a300-2a9e6986ae2e None admin] PATH_INFO: `/v3/system/users/6b1994a936144dd29acac10b034d0593/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:41.393974 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a767786-8ae6-45e3-a300-2a9e6986ae2e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6b1994a936144dd29acac10b034d0593, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:41.395734 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a767786-8ae6-45e3-a300-2a9e6986ae2e None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:41.415094 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 155/313] 10.222.0.26 () {58 vars in 1334 bytes} [Mon Sep 26 01:22:41 2022] PUT /identity/v3/system/users/6b1994a936144dd29acac10b034d0593/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:22:41.495808 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349b81a-11fe-4907-a19c-fdfc2dea9eaa None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:41.512317 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:41.537200 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba50ce-37d8-45fd-82a7-c9829480727b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:41.538227 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba50ce-37d8-45fd-82a7-c9829480727b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:41.538717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba50ce-37d8-45fd-82a7-c9829480727b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:41.539334 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba50ce-37d8-45fd-82a7-c9829480727b None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:41.540207 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba50ce-37d8-45fd-82a7-c9829480727b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:41.540712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba50ce-37d8-45fd-82a7-c9829480727b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:41.542336 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba50ce-37d8-45fd-82a7-c9829480727b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:41.553481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 159/314] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:41.560115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a767786-8ae6-45e3-a300-2a9e6986ae2e None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:41.675099 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a767786-8ae6-45e3-a300-2a9e6986ae2e None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:41.710422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd1576-a64e-430f-aefd-9fc1c59eb280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:41.711198 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd1576-a64e-430f-aefd-9fc1c59eb280 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:41.711386 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd1576-a64e-430f-aefd-9fc1c59eb280 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:41.711666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd1576-a64e-430f-aefd-9fc1c59eb280 None admin] PATH_INFO: `/v3/users/f44444633dbe483398fda3a142299222` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:41.712846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd1576-a64e-430f-aefd-9fc1c59eb280 None admin] RBAC: Authorizing `identity:get_user(user_id=f44444633dbe483398fda3a142299222)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:41.714261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd1576-a64e-430f-aefd-9fc1c59eb280 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:41.716181 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 156/315] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:41 2022] GET /identity/v3/users/f44444633dbe483398fda3a142299222 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:41.721637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba50ce-37d8-45fd-82a7-c9829480727b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:41.829572 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba50ce-37d8-45fd-82a7-c9829480727b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:41.866726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da38e9-5d85-44a6-817a-16143ea27383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:41.867711 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da38e9-5d85-44a6-817a-16143ea27383 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:41.868214 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da38e9-5d85-44a6-817a-16143ea27383 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:41.868680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da38e9-5d85-44a6-817a-16143ea27383 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:41.919884 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:41.948029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da38e9-5d85-44a6-817a-16143ea27383 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:41.949535 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da38e9-5d85-44a6-817a-16143ea27383 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:42.056925 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 160/316] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 01:22:42.062469 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd1576-a64e-430f-aefd-9fc1c59eb280 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:42.124583 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:42.172015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd1576-a64e-430f-aefd-9fc1c59eb280 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:42.208177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b1897-910c-40c5-b156-bf7ab95eadb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:42.209172 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b1897-910c-40c5-b156-bf7ab95eadb1 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:42.209648 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b1897-910c-40c5-b156-bf7ab95eadb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:42.210118 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b1897-910c-40c5-b156-bf7ab95eadb1 None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:42.211461 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b1897-910c-40c5-b156-bf7ab95eadb1 None admin] RBAC: Authorizing `identity:get_project(project_id=9739ea1321b14d2187985347ea1247dc)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:42.213091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b1897-910c-40c5-b156-bf7ab95eadb1 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:42.214955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 157/317] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:42 2022] GET /identity/v3/projects/9739ea1321b14d2187985347ea1247dc => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:42.222988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da38e9-5d85-44a6-817a-16143ea27383 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:42.297926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:42.324436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da38e9-5d85-44a6-817a-16143ea27383 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:42.359968 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b71299-3882-41c6-9d04-33d72823e114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:42.360574 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b71299-3882-41c6-9d04-33d72823e114 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:42.360845 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b71299-3882-41c6-9d04-33d72823e114 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:42.361700 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b71299-3882-41c6-9d04-33d72823e114 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:42.362596 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b71299-3882-41c6-9d04-33d72823e114 None admin] RBAC: Adding query filter params (role.id=4012481430d24230bf48f7a758321411, scope.project.id=9739ea1321b14d2187985347ea1247dc, user.id=f44444633dbe483398fda3a142299222) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:42.362920 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b71299-3882-41c6-9d04-33d72823e114 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:42.364354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b71299-3882-41c6-9d04-33d72823e114 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:42.370702 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 161/318] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:22:42 2022] GET /identity/v3/role_assignments?user.id=f44444633dbe483398fda3a142299222&scope.project.id=9739ea1321b14d2187985347ea1247dc&role.id=4012481430d24230bf48f7a758321411 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:42.832476 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f2b15-9da4-4d24-9bcb-9df36cfea4cb None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:42.833029 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f2b15-9da4-4d24-9bcb-9df36cfea4cb None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:42.833029 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f2b15-9da4-4d24-9bcb-9df36cfea4cb None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:42.834452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 158/319] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:22:42.839779 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dcb51-b274-4abb-bde9-9979b8a0e2af None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:42.840067 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dcb51-b274-4abb-bde9-9979b8a0e2af None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:42.840340 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dcb51-b274-4abb-bde9-9979b8a0e2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:42.859779 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-e81dcb51-b274-4abb-bde9-9979b8a0e2af None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:42.861005 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e81dcb51-b274-4abb-bde9-9979b8a0e2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:42.931975 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 162/320] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:42.965833 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b554acf-ce8e-4e64-b31e-8ab475a051cd None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:42.966113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b554acf-ce8e-4e64-b31e-8ab475a051cd None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:42.966388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b554acf-ce8e-4e64-b31e-8ab475a051cd None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:42.967872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 159/321] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:42.973248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c48351-d436-4061-b991-be29d51c1a0d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:42.973540 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c48351-d436-4061-b991-be29d51c1a0d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:42.973817 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c48351-d436-4061-b991-be29d51c1a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:42.992905 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-48c48351-d436-4061-b991-be29d51c1a0d None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:42.994069 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-48c48351-d436-4061-b991-be29d51c1a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:43.056831 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:43.065425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 163/322] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:43.197851 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b554acf-ce8e-4e64-b31e-8ab475a051cd None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:43.300423 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b554acf-ce8e-4e64-b31e-8ab475a051cd None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:43.323611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:43.336437 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c933492-2be7-445f-8a7f-ccd3923bd7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:43.337067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c933492-2be7-445f-8a7f-ccd3923bd7e0 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:43.337347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c933492-2be7-445f-8a7f-ccd3923bd7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:43.337618 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c933492-2be7-445f-8a7f-ccd3923bd7e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:43.338708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c933492-2be7-445f-8a7f-ccd3923bd7e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:43.340160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c933492-2be7-445f-8a7f-ccd3923bd7e0 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:43.341893 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 160/323] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:22:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:43.343395 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c48351-d436-4061-b991-be29d51c1a0d None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:43.347183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c933492-2be7-445f-8a7f-ccd3923bd7e0 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:43.462870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c48351-d436-4061-b991-be29d51c1a0d None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:43.471821 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c933492-2be7-445f-8a7f-ccd3923bd7e0 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:43.498423 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204aef84-93d5-4f87-96c1-2280b1a1cdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:43.499088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204aef84-93d5-4f87-96c1-2280b1a1cdd6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:43.499383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204aef84-93d5-4f87-96c1-2280b1a1cdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:43.499637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204aef84-93d5-4f87-96c1-2280b1a1cdd6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:43.507867 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf7068-5375-4763-98f2-c75a5ca95705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:43.508467 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf7068-5375-4763-98f2-c75a5ca95705 None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:43.508741 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf7068-5375-4763-98f2-c75a5ca95705 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:43.509010 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf7068-5375-4763-98f2-c75a5ca95705 None admin] PATH_INFO: `/v3/groups` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:43.509651 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf7068-5375-4763-98f2-c75a5ca95705 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:43.510529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204aef84-93d5-4f87-96c1-2280b1a1cdd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:43.511083 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf7068-5375-4763-98f2-c75a5ca95705 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:43.515852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-204aef84-93d5-4f87-96c1-2280b1a1cdd6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 01:22:43.515852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:43.515852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:43.515852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:43.515852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:43.515852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:43.515852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:43.515852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:43.515852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:43.515852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:43.515852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:43.515852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:43.515852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:43.515852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:43.515852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:43.515852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:43.516751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:43.516751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:43.516751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:43.516751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:43.516751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:43.516751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:43.516751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:43.516751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:43.516751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:43.516751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:43.516751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:43.516751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:43.516751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:43.516751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:43.516751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:43.516751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:43.518215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:43.518215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:43.518215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:43.518215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:43.518215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:43.518215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:43.518215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:43.518215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:43.518215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:43.518215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:43.518215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 01:22:43.518215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:43.518215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 164/324] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:43.524099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204aef84-93d5-4f87-96c1-2280b1a1cdd6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:43.531792 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 161/325] 10.222.0.26 () {60 vars in 1134 bytes} [Mon Sep 26 01:22:43 2022] POST /identity/v3/groups => generated 226 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:22:43.607800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:43.653993 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204aef84-93d5-4f87-96c1-2280b1a1cdd6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:43.691154 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd6a0d-0a5b-451a-b20a-efdd695686b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:43.691782 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd6a0d-0a5b-451a-b20a-efdd695686b7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:43.692059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd6a0d-0a5b-451a-b20a-efdd695686b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:43.692329 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd6a0d-0a5b-451a-b20a-efdd695686b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:43.693010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd6a0d-0a5b-451a-b20a-efdd695686b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:43.693313 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd6a0d-0a5b-451a-b20a-efdd695686b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:43.694707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd6a0d-0a5b-451a-b20a-efdd695686b7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:43.698260 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56daca-1549-4939-9265-3fc6437f1fe2 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:43.698540 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56daca-1549-4939-9265-3fc6437f1fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:43.698870 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56daca-1549-4939-9265-3fc6437f1fe2 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:43.700370 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 162/326] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:22:43.706384 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 165/327] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:43.706537 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd9175-7e43-45ce-bc26-0b67bc168d64 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:43.706537 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd9175-7e43-45ce-bc26-0b67bc168d64 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:43.706750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd9175-7e43-45ce-bc26-0b67bc168d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:43.711602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd6a0d-0a5b-451a-b20a-efdd695686b7 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:43.726204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-21cd9175-7e43-45ce-bc26-0b67bc168d64 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:43.727686 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-21cd9175-7e43-45ce-bc26-0b67bc168d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:43.782183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:43.813546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 163/328] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:22:43.834759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd6a0d-0a5b-451a-b20a-efdd695686b7 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:43.855755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:43.871183 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840c8c0-2617-460a-ba87-5377804f8e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:43.871814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840c8c0-2617-460a-ba87-5377804f8e16 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:43.872091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840c8c0-2617-460a-ba87-5377804f8e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:43.872424 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840c8c0-2617-460a-ba87-5377804f8e16 None admin] PATH_INFO: `/v3/users/91b2fc75891740ce9a39c5cbfb8ee0cb` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:43.873617 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840c8c0-2617-460a-ba87-5377804f8e16 None admin] RBAC: Authorizing `identity:get_user(user_id=91b2fc75891740ce9a39c5cbfb8ee0cb)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:43.875162 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840c8c0-2617-460a-ba87-5377804f8e16 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:43.877646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 166/329] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:43 2022] GET /identity/v3/users/91b2fc75891740ce9a39c5cbfb8ee0cb => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:43.883145 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd9175-7e43-45ce-bc26-0b67bc168d64 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:43.999179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd9175-7e43-45ce-bc26-0b67bc168d64 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:44.038890 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03060ece-43ce-4bef-abd7-e048aaf8ec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:44.039546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03060ece-43ce-4bef-abd7-e048aaf8ec29 None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:44.039826 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03060ece-43ce-4bef-abd7-e048aaf8ec29 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:44.040098 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03060ece-43ce-4bef-abd7-e048aaf8ec29 None admin] PATH_INFO: `/v3/system/users/91b2fc75891740ce9a39c5cbfb8ee0cb/roles/4012481430d24230bf48f7a758321411` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:44.041519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03060ece-43ce-4bef-abd7-e048aaf8ec29 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=91b2fc75891740ce9a39c5cbfb8ee0cb, role_id=4012481430d24230bf48f7a758321411)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:44.042987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03060ece-43ce-4bef-abd7-e048aaf8ec29 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:44.053715 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 164/330] 10.222.0.26 () {58 vars in 1334 bytes} [Mon Sep 26 01:22:43 2022] PUT /identity/v3/system/users/91b2fc75891740ce9a39c5cbfb8ee0cb/roles/4012481430d24230bf48f7a758321411 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:22:44.105337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840c8c0-2617-460a-ba87-5377804f8e16 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:44.235043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840c8c0-2617-460a-ba87-5377804f8e16 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:44.274715 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9231b7-1d9f-405c-af2b-e61996a85055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:44.275440 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9231b7-1d9f-405c-af2b-e61996a85055 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:44.275723 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9231b7-1d9f-405c-af2b-e61996a85055 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:44.275993 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9231b7-1d9f-405c-af2b-e61996a85055 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:44.287583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9231b7-1d9f-405c-af2b-e61996a85055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:44.292949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-2e9231b7-1d9f-405c-af2b-e61996a85055 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:44.292949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:44.292949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:44.292949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:44.292949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:44.292949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:44.292949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:44.292949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:44.292949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:44.292949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:44.292949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:44.292949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:44.292949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:44.292949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:44.292949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:44.292949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:44.293833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:44.293833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:44.293833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:44.293833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:44.293833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:44.293833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:44.293833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:44.293833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:44.293833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:44.293833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:44.293833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:44.293833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:44.293833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:44.293833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:44.293833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:44.293833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:44.294607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:44.294607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:44.294607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:44.294607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:44.294607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:44.294607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:44.294607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:44.294607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:44.294607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:44.294607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:44.294607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:44.294607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:44.299222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 167/331] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:44.300696 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03060ece-43ce-4bef-abd7-e048aaf8ec29 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:44.358467 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:44.432906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03060ece-43ce-4bef-abd7-e048aaf8ec29 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:44.476653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247b18b-1016-449d-bb4a-618e997bf8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:44.477257 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247b18b-1016-449d-bb4a-618e997bf8cd None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:44.477532 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247b18b-1016-449d-bb4a-618e997bf8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:44.477803 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247b18b-1016-449d-bb4a-618e997bf8cd None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:44.478460 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247b18b-1016-449d-bb4a-618e997bf8cd None admin] RBAC: Adding query filter params (name=member) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:44.478757 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247b18b-1016-449d-bb4a-618e997bf8cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:44.480173 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247b18b-1016-449d-bb4a-618e997bf8cd None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:44.493079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 165/332] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:44.499012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9231b7-1d9f-405c-af2b-e61996a85055 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:44.569607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:44.643075 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9231b7-1d9f-405c-af2b-e61996a85055 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:44.691872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa7634-402b-4a58-a94f-e2878284d6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:44.692527 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa7634-402b-4a58-a94f-e2878284d6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:44.692804 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa7634-402b-4a58-a94f-e2878284d6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:44.693068 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa7634-402b-4a58-a94f-e2878284d6d0 None admin] PATH_INFO: `/v3/users/6b1994a936144dd29acac10b034d0593` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:44.694234 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa7634-402b-4a58-a94f-e2878284d6d0 None admin] RBAC: Authorizing `identity:get_user(user_id=6b1994a936144dd29acac10b034d0593)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:44.695963 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa7634-402b-4a58-a94f-e2878284d6d0 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:44.697832 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 168/333] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:44 2022] GET /identity/v3/users/6b1994a936144dd29acac10b034d0593 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:44.703524 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247b18b-1016-449d-bb4a-618e997bf8cd None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:44.822178 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247b18b-1016-449d-bb4a-618e997bf8cd None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:44.832832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:44.863868 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67e370-ffb6-4185-b70d-d7e20d376078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:44.864481 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67e370-ffb6-4185-b70d-d7e20d376078 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:44.864768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67e370-ffb6-4185-b70d-d7e20d376078 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:44.865048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67e370-ffb6-4185-b70d-d7e20d376078 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:44.865774 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67e370-ffb6-4185-b70d-d7e20d376078 None admin] RBAC: Adding query filter params (role.id=f4df3a7a4c0b4730abc0601e2b072ef4, user.id=6b1994a936144dd29acac10b034d0593, scope.system=all) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:44.866082 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67e370-ffb6-4185-b70d-d7e20d376078 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:44.867952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67e370-ffb6-4185-b70d-d7e20d376078 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:44.882865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 166/334] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Sep 26 01:22:44 2022] GET /identity/v3/role_assignments?user.id=6b1994a936144dd29acac10b034d0593&scope.system=all&role.id=f4df3a7a4c0b4730abc0601e2b072ef4 => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:46.171150 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679edde8-2298-4348-9f1e-454c104add3b None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:46.172220 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679edde8-2298-4348-9f1e-454c104add3b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:46.172710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679edde8-2298-4348-9f1e-454c104add3b None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:46.175746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 169/335] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:46.181133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8060f-cc8c-4e3b-860b-0003d8f3f790 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:46.182051 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8060f-cc8c-4e3b-860b-0003d8f3f790 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:46.182529 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8060f-cc8c-4e3b-860b-0003d8f3f790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:46.209165 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-0ce8060f-cc8c-4e3b-860b-0003d8f3f790 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:46.210733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0ce8060f-cc8c-4e3b-860b-0003d8f3f790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:46.301881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 167/336] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:46.327702 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc832b-89b1-4d70-8bef-bff2ce272e32 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:46.328316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc832b-89b1-4d70-8bef-bff2ce272e32 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:46.328815 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc832b-89b1-4d70-8bef-bff2ce272e32 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:46.331195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 170/337] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:46.336280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f5d16-c6ca-4e17-81ff-3676f1459980 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:46.336564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f5d16-c6ca-4e17-81ff-3676f1459980 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:46.336839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f5d16-c6ca-4e17-81ff-3676f1459980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:46.360572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-874f5d16-c6ca-4e17-81ff-3676f1459980 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:46.362302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-874f5d16-c6ca-4e17-81ff-3676f1459980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:46.464606 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 168/338] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:46.750767 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc832b-89b1-4d70-8bef-bff2ce272e32 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:46.780913 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f5d16-c6ca-4e17-81ff-3676f1459980 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:46.822656 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:46.881343 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc832b-89b1-4d70-8bef-bff2ce272e32 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:46.918411 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:46.960328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce7f44-3be5-4fea-bc91-4caa2b372881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:46.960963 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce7f44-3be5-4fea-bc91-4caa2b372881 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:46.961237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce7f44-3be5-4fea-bc91-4caa2b372881 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:46.961512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce7f44-3be5-4fea-bc91-4caa2b372881 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:46.976845 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f5d16-c6ca-4e17-81ff-3676f1459980 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:46.990091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce7f44-3be5-4fea-bc91-4caa2b372881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:46.995246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-4fce7f44-3be5-4fea-bc91-4caa2b372881 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:46.995246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:46.995246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:46.995246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:46.995246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:46.995246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:46.995246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:46.995246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:46.995246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:46.995246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:46.995246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:46.995246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:46.995246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:46.995246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:46.995246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:46.995246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:46.996134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:46.996134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:46.996134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:46.996134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:46.996134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:46.996134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:46.996134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:46.996134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:46.996134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:46.996134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:46.996134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:46.996134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:46.996134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:46.996134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:46.996134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:46.996134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:46.996966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:46.996966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:46.996966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:46.996966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:46.996966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:46.996966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:46.996966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:46.996966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:46.996966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:46.996966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:46.996966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:46.996966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:46.998482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 171/339] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:47.010569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce7f44-3be5-4fea-bc91-4caa2b372881 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:47.037541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bc1e2-90a0-4c2e-8f55-78f008a70587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:47.038188 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bc1e2-90a0-4c2e-8f55-78f008a70587 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:47.038464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bc1e2-90a0-4c2e-8f55-78f008a70587 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:47.038737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bc1e2-90a0-4c2e-8f55-78f008a70587 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:47.065634 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bc1e2-90a0-4c2e-8f55-78f008a70587 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:47.076327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-6b6bc1e2-90a0-4c2e-8f55-78f008a70587 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:47.076327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:47.076327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:47.076327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:47.076327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:47.076327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:47.076327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:47.076327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:47.076327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:47.076327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:47.076327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:47.076327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:47.076327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:47.076327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:47.076327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:47.076327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:47.077273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:47.077273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:47.077273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:47.077273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:47.077273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:47.077273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:47.077273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:47.077273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:47.077273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:47.077273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:47.077273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:47.077273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:47.077273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:47.077273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:47.077273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:47.077273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:47.078120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:47.078120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:47.078120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:47.078120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:47.078120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:47.078120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:47.078120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:47.078120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:47.078120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:47.078120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:47.078120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:47.078120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:47.078120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 169/340] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:22:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:47.085238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bc1e2-90a0-4c2e-8f55-78f008a70587 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:47.208901 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:47.229594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bc1e2-90a0-4c2e-8f55-78f008a70587 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:47.273975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06309507-833a-4b8d-8744-ebf40a625917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:47.274550 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06309507-833a-4b8d-8744-ebf40a625917 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:47.274843 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06309507-833a-4b8d-8744-ebf40a625917 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:47.275165 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06309507-833a-4b8d-8744-ebf40a625917 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:47.276187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06309507-833a-4b8d-8744-ebf40a625917 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:47.276495 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06309507-833a-4b8d-8744-ebf40a625917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:47.277892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06309507-833a-4b8d-8744-ebf40a625917 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:47.278305 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce7f44-3be5-4fea-bc91-4caa2b372881 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:47.288390 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 170/341] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:22:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:47.295210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06309507-833a-4b8d-8744-ebf40a625917 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:47.364972 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea339e-f9bb-4042-ba43-c7e9475b5ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:47.365990 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea339e-f9bb-4042-ba43-c7e9475b5ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:47.366527 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea339e-f9bb-4042-ba43-c7e9475b5ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:47.367071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea339e-f9bb-4042-ba43-c7e9475b5ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:47.367946 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea339e-f9bb-4042-ba43-c7e9475b5ea3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:47.368467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea339e-f9bb-4042-ba43-c7e9475b5ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:47.370103 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea339e-f9bb-4042-ba43-c7e9475b5ea3 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:47.386789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 172/342] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:47.394808 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea339e-f9bb-4042-ba43-c7e9475b5ea3 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:47.418895 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06309507-833a-4b8d-8744-ebf40a625917 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:47.461910 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385257e-4f11-470f-afc3-0f3128b579ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:47.462529 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385257e-4f11-470f-afc3-0f3128b579ee None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:47.462811 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385257e-4f11-470f-afc3-0f3128b579ee None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:47.463122 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385257e-4f11-470f-afc3-0f3128b579ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:47.486210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:47.496168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:47.552095 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385257e-4f11-470f-afc3-0f3128b579ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:47.553801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385257e-4f11-470f-afc3-0f3128b579ee None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:47.639338 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea339e-f9bb-4042-ba43-c7e9475b5ea3 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:47.667074 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 171/343] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 01:22:47.668699 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe655-851d-4856-bf26-1f7be6b95401 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:47.669125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe655-851d-4856-bf26-1f7be6b95401 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:47.669560 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe655-851d-4856-bf26-1f7be6b95401 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:47.675410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 172/344] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:47.677572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfe655-851d-4856-bf26-1f7be6b95401 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:47.743245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:47.752994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd463f6b-c788-4d29-8193-81179a594c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:47.753923 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd463f6b-c788-4d29-8193-81179a594c9d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:47.755040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd463f6b-c788-4d29-8193-81179a594c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:47.755420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd463f6b-c788-4d29-8193-81179a594c9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:47.796855 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfe655-851d-4856-bf26-1f7be6b95401 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:47.840305 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4d220-91c8-4917-bdde-5aa884ad48ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:47.841419 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4d220-91c8-4917-bdde-5aa884ad48ed None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:47.843141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4d220-91c8-4917-bdde-5aa884ad48ed None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:47.844359 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4d220-91c8-4917-bdde-5aa884ad48ed None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:47.847041 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4d220-91c8-4917-bdde-5aa884ad48ed None admin] RBAC: Authorizing `identity:get_project(project_id=def6cb215c3c45f2a54435c338e667ab)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:47.848724 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4d220-91c8-4917-bdde-5aa884ad48ed None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:47.855653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 173/345] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:47 2022] GET /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:47.857072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b4454-d849-4e64-ab53-ccf58b095a99 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:47.857498 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b4454-d849-4e64-ab53-ccf58b095a99 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:47.857911 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b4454-d849-4e64-ab53-ccf58b095a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:47.867395 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd463f6b-c788-4d29-8193-81179a594c9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:47.868719 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd463f6b-c788-4d29-8193-81179a594c9d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:47.890605 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-520b4454-d849-4e64-ab53-ccf58b095a99 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:47.891841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-520b4454-d849-4e64-ab53-ccf58b095a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:47.936485 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:47.974538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 174/346] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:47.975919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc57c5d-8e43-46f0-8f65-277bde768f45 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:47.976207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc57c5d-8e43-46f0-8f65-277bde768f45 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:47.976531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc57c5d-8e43-46f0-8f65-277bde768f45 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:47.978220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 175/347] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:47.978813 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc57c5d-8e43-46f0-8f65-277bde768f45 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:48.021656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 173/348] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 01:22:48.023436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903b4c6-dccf-4709-9ade-3b80f5886fdd None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:48.024819 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903b4c6-dccf-4709-9ade-3b80f5886fdd None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:48.025309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903b4c6-dccf-4709-9ade-3b80f5886fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:48.039321 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:48.051509 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-4903b4c6-dccf-4709-9ade-3b80f5886fdd None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:48.053710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4903b4c6-dccf-4709-9ade-3b80f5886fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:48.116134 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc57c5d-8e43-46f0-8f65-277bde768f45 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:48.146111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 174/349] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:48.147299 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903b4c6-dccf-4709-9ade-3b80f5886fdd None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:48.187545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dbff1-b604-4b93-ac9e-b230ebfd0bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:48.188228 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dbff1-b604-4b93-ac9e-b230ebfd0bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:48.188506 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dbff1-b604-4b93-ac9e-b230ebfd0bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:48.188778 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dbff1-b604-4b93-ac9e-b230ebfd0bf5 None admin] PATH_INFO: `/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:48.203114 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9dbff1-b604-4b93-ac9e-b230ebfd0bf5 None admin] RBAC: Authorizing `identity:get_group(group_id=e6a6a927d2e946ef99afe3897cae0cf0)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:48.204572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9dbff1-b604-4b93-ac9e-b230ebfd0bf5 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:48.206704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 176/350] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 26 01:22:47 2022] GET /identity/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:48.221617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dbff1-b604-4b93-ac9e-b230ebfd0bf5 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:48.231251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:48.298143 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903b4c6-dccf-4709-9ade-3b80f5886fdd None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:48.363512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117a073-eb8b-4e0a-97f2-37ddc3e892f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:48.364168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117a073-eb8b-4e0a-97f2-37ddc3e892f2 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:48.364448 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117a073-eb8b-4e0a-97f2-37ddc3e892f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:48.364722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117a073-eb8b-4e0a-97f2-37ddc3e892f2 None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:48.367634 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117a073-eb8b-4e0a-97f2-37ddc3e892f2 None admin] RBAC: Authorizing `identity:get_project(project_id=def6cb215c3c45f2a54435c338e667ab)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:48.369288 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117a073-eb8b-4e0a-97f2-37ddc3e892f2 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:48.371842 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 175/351] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:48 2022] GET /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:48.379996 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117a073-eb8b-4e0a-97f2-37ddc3e892f2 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:48.413532 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dbff1-b604-4b93-ac9e-b230ebfd0bf5 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:48.430301 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:48.482305 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f6197-3d31-49cc-8c20-983c8cc58a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:48.483314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f6197-3d31-49cc-8c20-983c8cc58a9c None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:48.483781 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f6197-3d31-49cc-8c20-983c8cc58a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:48.484206 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f6197-3d31-49cc-8c20-983c8cc58a9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:48.485113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f6197-3d31-49cc-8c20-983c8cc58a9c None admin] RBAC: Adding query filter params (group.id=e6a6a927d2e946ef99afe3897cae0cf0, role.id=e1504eb5f35c468086d3b269e2c72011, scope.project.id=def6cb215c3c45f2a54435c338e667ab) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:48.485799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f6197-3d31-49cc-8c20-983c8cc58a9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:48.489279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f6197-3d31-49cc-8c20-983c8cc58a9c None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:48.500371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 177/352] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 26 01:22:48 2022] GET /identity/v3/role_assignments?group.id=e6a6a927d2e946ef99afe3897cae0cf0&scope.project.id=def6cb215c3c45f2a54435c338e667ab&role.id=e1504eb5f35c468086d3b269e2c72011 => generated 260 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:48.501471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f6197-3d31-49cc-8c20-983c8cc58a9c None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:48.563523 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117a073-eb8b-4e0a-97f2-37ddc3e892f2 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:48.636805 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8537b-d9d8-4a11-9299-67d50768a1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:48.637715 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8537b-d9d8-4a11-9299-67d50768a1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:48.638292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8537b-d9d8-4a11-9299-67d50768a1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:48.638710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8537b-d9d8-4a11-9299-67d50768a1a3 None admin] PATH_INFO: `/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:48.641563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8537b-d9d8-4a11-9299-67d50768a1a3 None admin] RBAC: Authorizing `identity:get_group(group_id=e6a6a927d2e946ef99afe3897cae0cf0)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:48.646370 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8537b-d9d8-4a11-9299-67d50768a1a3 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:48.650509 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 176/353] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 26 01:22:48 2022] GET /identity/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0 => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:48.657298 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8537b-d9d8-4a11-9299-67d50768a1a3 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:48.667469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:48.670863 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f6197-3d31-49cc-8c20-983c8cc58a9c None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:48.723328 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8c6b0-11ba-42d6-8b6d-c5145cea4ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:48.723955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8c6b0-11ba-42d6-8b6d-c5145cea4ebb None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:48.724231 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8c6b0-11ba-42d6-8b6d-c5145cea4ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:48.724500 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8c6b0-11ba-42d6-8b6d-c5145cea4ebb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:48.745581 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8c6b0-11ba-42d6-8b6d-c5145cea4ebb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:48.752312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-fdd8c6b0-11ba-42d6-8b6d-c5145cea4ebb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 01:22:48.752312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:48.752312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:48.752312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:48.752312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:48.752312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:48.752312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:48.752312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:48.752312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:48.752312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:48.752312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:48.752312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:48.752312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:48.752312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:48.752312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:48.752312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:48.753458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:48.753458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:48.753458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:48.753458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:48.753458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:48.753458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:48.753458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:48.753458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:48.753458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:48.753458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:48.753458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:48.753458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:48.753458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:48.753458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:48.753458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:48.753458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:48.754259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:48.754259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:48.754259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:48.754259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:48.754259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:48.754259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:48.754259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:48.754259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:48.754259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:48.754259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:48.754259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 01:22:48.754259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:48.754259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 178/354] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:48.754259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8c6b0-11ba-42d6-8b6d-c5145cea4ebb None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:48.800502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:48.830403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8537b-d9d8-4a11-9299-67d50768a1a3 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:48.872974 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b2b64-6e49-418f-bc91-f07c56556f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:48.873836 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b2b64-6e49-418f-bc91-f07c56556f7e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:48.874245 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b2b64-6e49-418f-bc91-f07c56556f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:48.874670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b2b64-6e49-418f-bc91-f07c56556f7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:48.884216 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8c6b0-11ba-42d6-8b6d-c5145cea4ebb None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:48.888323 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b2b64-6e49-418f-bc91-f07c56556f7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:48.897446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-244b2b64-6e49-418f-bc91-f07c56556f7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:48.897446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:48.897446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:48.897446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:48.897446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:48.897446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:48.897446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:48.897446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:48.897446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:48.897446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:48.897446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:48.897446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:48.897446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:48.897446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:48.897446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:48.897446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:48.898557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:48.898557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:48.898557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:48.898557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:48.898557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:48.898557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:48.898557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:48.898557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:48.898557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:48.898557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:48.898557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:48.898557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:48.898557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:48.898557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:48.898557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:48.898557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:48.899524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:48.899524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:48.899524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:48.899524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:48.899524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:48.899524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:48.899524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:48.899524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:48.899524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:48.899524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:48.899524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:48.899524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:48.901537 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 177/355] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:48.903032 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766f50b-bf46-4c27-aed9-7f2f613e0fa2 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:48.903519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766f50b-bf46-4c27-aed9-7f2f613e0fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:48.903978 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766f50b-bf46-4c27-aed9-7f2f613e0fa2 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:48.905415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 178/356] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:48.906306 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766f50b-bf46-4c27-aed9-7f2f613e0fa2 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:48.959553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbdf6c-5a95-4cf1-9a1d-27023d8195e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:48.960166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbdf6c-5a95-4cf1-9a1d-27023d8195e0 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:48.960444 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbdf6c-5a95-4cf1-9a1d-27023d8195e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:48.960721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbdf6c-5a95-4cf1-9a1d-27023d8195e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:48.961446 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbdf6c-5a95-4cf1-9a1d-27023d8195e0 None admin] RBAC: Adding query filter params (group.id=e6a6a927d2e946ef99afe3897cae0cf0, role.id=f4df3a7a4c0b4730abc0601e2b072ef4, scope.project.id=def6cb215c3c45f2a54435c338e667ab) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:48.962411 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbdf6c-5a95-4cf1-9a1d-27023d8195e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:48.963205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbdf6c-5a95-4cf1-9a1d-27023d8195e0 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:48.976140 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 179/357] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 26 01:22:48 2022] GET /identity/v3/role_assignments?group.id=e6a6a927d2e946ef99afe3897cae0cf0&scope.project.id=def6cb215c3c45f2a54435c338e667ab&role.id=f4df3a7a4c0b4730abc0601e2b072ef4 => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:48.976140 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbdf6c-5a95-4cf1-9a1d-27023d8195e0 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:49.005476 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:49.062783 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766f50b-bf46-4c27-aed9-7f2f613e0fa2 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:49.113876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a889cf3-f06f-4004-b03a-767b73d57b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:49.114494 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a889cf3-f06f-4004-b03a-767b73d57b73 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:49.114770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a889cf3-f06f-4004-b03a-767b73d57b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:49.115083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a889cf3-f06f-4004-b03a-767b73d57b73 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:49.116431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a889cf3-f06f-4004-b03a-767b73d57b73 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:49.116744 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a889cf3-f06f-4004-b03a-767b73d57b73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:49.118418 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a889cf3-f06f-4004-b03a-767b73d57b73 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:49.124810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:49.133541 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 179/358] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:49.134154 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbdf6c-5a95-4cf1-9a1d-27023d8195e0 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:49.134807 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301e7b8-61a2-44e9-8341-1057130a044a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:49.139333 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301e7b8-61a2-44e9-8341-1057130a044a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:49.140467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301e7b8-61a2-44e9-8341-1057130a044a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:49.171477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-c301e7b8-61a2-44e9-8341-1057130a044a None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:49.173550 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c301e7b8-61a2-44e9-8341-1057130a044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:49.186976 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164a9f8-6a73-435a-a810-f2df8edfb94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:49.187600 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164a9f8-6a73-435a-a810-f2df8edfb94f None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:49.187916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164a9f8-6a73-435a-a810-f2df8edfb94f None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:49.188180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164a9f8-6a73-435a-a810-f2df8edfb94f None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:49.189373 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164a9f8-6a73-435a-a810-f2df8edfb94f None admin] RBAC: Adding query filter params (name=member) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:49.189989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164a9f8-6a73-435a-a810-f2df8edfb94f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:49.191597 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164a9f8-6a73-435a-a810-f2df8edfb94f None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:49.203019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 180/359] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:49.204452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111333c-6d8c-4567-b802-380dde7ed94f None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:49.205298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111333c-6d8c-4567-b802-380dde7ed94f None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:49.205688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111333c-6d8c-4567-b802-380dde7ed94f None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:49.208795 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 181/360] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:49.210118 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111333c-6d8c-4567-b802-380dde7ed94f None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:49.282332 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 180/361] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:49.283544 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301e7b8-61a2-44e9-8341-1057130a044a None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:49.375812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111333c-6d8c-4567-b802-380dde7ed94f None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:49.429620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c280bdc-23c0-4ded-b77f-6b3c4caa4de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:49.430255 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c280bdc-23c0-4ded-b77f-6b3c4caa4de8 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:49.430587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c280bdc-23c0-4ded-b77f-6b3c4caa4de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:49.430948 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c280bdc-23c0-4ded-b77f-6b3c4caa4de8 None admin] PATH_INFO: `/v3/users/91b2fc75891740ce9a39c5cbfb8ee0cb` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:49.432705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c280bdc-23c0-4ded-b77f-6b3c4caa4de8 None admin] RBAC: Authorizing `identity:get_user(user_id=91b2fc75891740ce9a39c5cbfb8ee0cb)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:49.434351 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c280bdc-23c0-4ded-b77f-6b3c4caa4de8 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:49.436360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 182/362] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:22:49 2022] GET /identity/v3/users/91b2fc75891740ce9a39c5cbfb8ee0cb => generated 293 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:49.437771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f309f8d-64bf-44f7-8d87-45acac4ae830 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:49.438056 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f309f8d-64bf-44f7-8d87-45acac4ae830 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:49.438329 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f309f8d-64bf-44f7-8d87-45acac4ae830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:49.442760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:49.464916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-0f309f8d-64bf-44f7-8d87-45acac4ae830 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:49.466175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0f309f8d-64bf-44f7-8d87-45acac4ae830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:49.491265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:49.537548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301e7b8-61a2-44e9-8341-1057130a044a None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:49.551460 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 183/363] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:49.552438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f309f8d-64bf-44f7-8d87-45acac4ae830 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:49.617910 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688f3c4-9d9b-4406-b7fd-8cb9ef93466d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:49.618614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688f3c4-9d9b-4406-b7fd-8cb9ef93466d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:49.618918 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688f3c4-9d9b-4406-b7fd-8cb9ef93466d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:49.619197 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688f3c4-9d9b-4406-b7fd-8cb9ef93466d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:49.725988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f309f8d-64bf-44f7-8d87-45acac4ae830 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:49.779484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea4968-1984-4338-be6f-85805bf5d00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:49.779869 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688f3c4-9d9b-4406-b7fd-8cb9ef93466d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:49.780686 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea4968-1984-4338-be6f-85805bf5d00c None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:49.781172 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea4968-1984-4338-be6f-85805bf5d00c None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:49.781353 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688f3c4-9d9b-4406-b7fd-8cb9ef93466d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:49.781814 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea4968-1984-4338-be6f-85805bf5d00c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:49.783281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea4968-1984-4338-be6f-85805bf5d00c None admin] RBAC: Adding query filter params (role.id=4012481430d24230bf48f7a758321411, user.id=91b2fc75891740ce9a39c5cbfb8ee0cb, scope.system=all) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:49.784089 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea4968-1984-4338-be6f-85805bf5d00c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:49.785719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea4968-1984-4338-be6f-85805bf5d00c None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:49.807853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 184/364] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Sep 26 01:22:49 2022] GET /identity/v3/role_assignments?user.id=91b2fc75891740ce9a39c5cbfb8ee0cb&scope.system=all&role.id=4012481430d24230bf48f7a758321411 => generated 510 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:49.809620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea4968-1984-4338-be6f-85805bf5d00c None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:49.835234 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:49.908203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:49.985604 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 181/365] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:22:49.992415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688f3c4-9d9b-4406-b7fd-8cb9ef93466d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:50.001194 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea4968-1984-4338-be6f-85805bf5d00c None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:50.086591 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6082e8-e46b-496f-87e0-66097469f176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:50.087277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6082e8-e46b-496f-87e0-66097469f176 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:50.087558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6082e8-e46b-496f-87e0-66097469f176 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:50.087831 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6082e8-e46b-496f-87e0-66097469f176 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:50.111107 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6082e8-e46b-496f-87e0-66097469f176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:50.118553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-1b6082e8-e46b-496f-87e0-66097469f176 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:50.118553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:50.118553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:50.118553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:50.118553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:50.118553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:50.118553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:50.118553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:50.118553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:50.118553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:50.118553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:50.118553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:50.118553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:50.118553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:50.118553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:50.118553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:50.119625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:50.119625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:50.119625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:50.119625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:50.119625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:50.119625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:50.119625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:50.119625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:50.119625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:50.119625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:50.119625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:50.119625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:50.119625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:50.119625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:50.119625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:50.119625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:50.121019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:50.121019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:50.121019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:50.121019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:50.121019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:50.121019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:50.121019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:50.121019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:50.121019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:50.121019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:50.121019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:50.121019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:50.121019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 185/366] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:22:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:50.121019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6082e8-e46b-496f-87e0-66097469f176 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:50.176247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688f3c4-9d9b-4406-b7fd-8cb9ef93466d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:50.222239 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36e89d-c627-4153-a383-9e14fba8f966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:50.222900 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36e89d-c627-4153-a383-9e14fba8f966 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:50.223181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36e89d-c627-4153-a383-9e14fba8f966 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:50.223455 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36e89d-c627-4153-a383-9e14fba8f966 None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:50.225415 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:50.226154 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36e89d-c627-4153-a383-9e14fba8f966 None admin] RBAC: Authorizing `identity:get_project(project_id=9739ea1321b14d2187985347ea1247dc)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:50.227690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36e89d-c627-4153-a383-9e14fba8f966 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:50.229738 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 182/367] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:49 2022] GET /identity/v3/projects/9739ea1321b14d2187985347ea1247dc => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:50.230624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36e89d-c627-4153-a383-9e14fba8f966 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:50.253700 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6082e8-e46b-496f-87e0-66097469f176 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:50.262400 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:50.293066 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273453c1-409f-4481-b1d1-b1ace0eee1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:50.293882 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273453c1-409f-4481-b1d1-b1ace0eee1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:50.294175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273453c1-409f-4481-b1d1-b1ace0eee1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:50.294766 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273453c1-409f-4481-b1d1-b1ace0eee1d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:50.317218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273453c1-409f-4481-b1d1-b1ace0eee1d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:50.324881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-273453c1-409f-4481-b1d1-b1ace0eee1d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:50.324881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:50.324881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:50.324881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:50.324881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:50.324881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:50.324881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:50.324881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:50.324881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:50.324881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:50.324881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:50.324881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:50.324881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:50.324881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:50.324881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:50.324881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:50.325756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:50.325756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:50.325756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:50.325756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:50.325756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:50.325756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:50.325756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:50.325756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:50.325756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:50.325756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:50.325756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:50.325756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:50.325756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:50.325756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:50.325756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:50.325756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:50.327201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:50.327201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:50.327201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:50.327201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:50.327201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:50.327201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:50.327201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:50.327201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:50.327201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:50.327201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:50.327201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:50.327201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:50.327201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 186/368] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:22:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:50.327201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273453c1-409f-4481-b1d1-b1ace0eee1d9 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:50.375722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36e89d-c627-4153-a383-9e14fba8f966 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:50.424208 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9c2ec-efae-43ff-90ee-3a4f8529de65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:50.425937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9c2ec-efae-43ff-90ee-3a4f8529de65 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:50.426290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9c2ec-efae-43ff-90ee-3a4f8529de65 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:50.426636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9c2ec-efae-43ff-90ee-3a4f8529de65 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:50.427413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9c2ec-efae-43ff-90ee-3a4f8529de65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:50.427784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9c2ec-efae-43ff-90ee-3a4f8529de65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:50.429218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9c2ec-efae-43ff-90ee-3a4f8529de65 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:50.440558 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 183/369] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:22:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:50.442097 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9c2ec-efae-43ff-90ee-3a4f8529de65 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:50.468704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273453c1-409f-4481-b1d1-b1ace0eee1d9 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:50.510740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b7efb-f20d-43b8-a34c-a212474acef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:50.511733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b7efb-f20d-43b8-a34c-a212474acef0 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:50.512225 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b7efb-f20d-43b8-a34c-a212474acef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:50.512699 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b7efb-f20d-43b8-a34c-a212474acef0 None admin] PATH_INFO: `/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:50.514134 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b7efb-f20d-43b8-a34c-a212474acef0 None admin] RBAC: Authorizing `identity:get_group(group_id=e6a6a927d2e946ef99afe3897cae0cf0)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:50.516184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b7efb-f20d-43b8-a34c-a212474acef0 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:50.519882 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 187/370] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 26 01:22:50 2022] GET /identity/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:50.521025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b7efb-f20d-43b8-a34c-a212474acef0 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:50.525003 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:50.556326 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:50.574981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9c2ec-efae-43ff-90ee-3a4f8529de65 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:50.612396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ea9bc-fe14-4dd2-9e62-11bb96168f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:50.613008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ea9bc-fe14-4dd2-9e62-11bb96168f7c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:50.613281 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ea9bc-fe14-4dd2-9e62-11bb96168f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:50.613549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ea9bc-fe14-4dd2-9e62-11bb96168f7c None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:50.614207 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ea9bc-fe14-4dd2-9e62-11bb96168f7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:50.614502 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ea9bc-fe14-4dd2-9e62-11bb96168f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:50.615918 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ea9bc-fe14-4dd2-9e62-11bb96168f7c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:50.625241 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 184/371] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:50.626112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ea9bc-fe14-4dd2-9e62-11bb96168f7c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:50.656921 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b7efb-f20d-43b8-a34c-a212474acef0 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:50.698035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40644987-d078-47c4-b34a-b67e4a66f663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:50.699053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40644987-d078-47c4-b34a-b67e4a66f663 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:50.699553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40644987-d078-47c4-b34a-b67e4a66f663 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:50.700043 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40644987-d078-47c4-b34a-b67e4a66f663 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:50.756536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ea9bc-fe14-4dd2-9e62-11bb96168f7c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:50.793802 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40644987-d078-47c4-b34a-b67e4a66f663 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:50.795299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40644987-d078-47c4-b34a-b67e4a66f663 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:50.797503 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:50.808911 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7154a6-9aec-4aed-8062-f213a6c35752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:50.810385 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7154a6-9aec-4aed-8062-f213a6c35752 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:50.810914 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7154a6-9aec-4aed-8062-f213a6c35752 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:50.811411 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7154a6-9aec-4aed-8062-f213a6c35752 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:50.812366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7154a6-9aec-4aed-8062-f213a6c35752 None admin] RBAC: Adding query filter params (group.id=e6a6a927d2e946ef99afe3897cae0cf0, role.id=f4df3a7a4c0b4730abc0601e2b072ef4, scope.project.id=9739ea1321b14d2187985347ea1247dc) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:50.813302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7154a6-9aec-4aed-8062-f213a6c35752 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:50.815719 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7154a6-9aec-4aed-8062-f213a6c35752 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:50.824230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 185/372] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 26 01:22:50 2022] GET /identity/v3/role_assignments?group.id=e6a6a927d2e946ef99afe3897cae0cf0&scope.project.id=9739ea1321b14d2187985347ea1247dc&role.id=f4df3a7a4c0b4730abc0601e2b072ef4 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:50.825299 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7154a6-9aec-4aed-8062-f213a6c35752 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:50.846460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:50.953663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 188/373] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:22:50.959247 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40644987-d078-47c4-b34a-b67e4a66f663 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:50.968264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7154a6-9aec-4aed-8062-f213a6c35752 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:51.011392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356422b0-fbf4-4fee-bfee-b2e134b96bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:51.012169 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356422b0-fbf4-4fee-bfee-b2e134b96bbc None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:51.012770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356422b0-fbf4-4fee-bfee-b2e134b96bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:51.012906 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356422b0-fbf4-4fee-bfee-b2e134b96bbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:51.093026 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40644987-d078-47c4-b34a-b67e4a66f663 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:51.096038 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:51.103757 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356422b0-fbf4-4fee-bfee-b2e134b96bbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:51.106384 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356422b0-fbf4-4fee-bfee-b2e134b96bbc None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:51.125167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:51.139052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402c3f3-eccf-4e8d-8c23-f8d4e45d248f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:51.140407 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402c3f3-eccf-4e8d-8c23-f8d4e45d248f None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:51.141101 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402c3f3-eccf-4e8d-8c23-f8d4e45d248f None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:51.141522 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402c3f3-eccf-4e8d-8c23-f8d4e45d248f None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:51.143271 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402c3f3-eccf-4e8d-8c23-f8d4e45d248f None admin] RBAC: Authorizing `identity:get_project(project_id=9739ea1321b14d2187985347ea1247dc)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:51.145037 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402c3f3-eccf-4e8d-8c23-f8d4e45d248f None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:51.146862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 189/374] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:50 2022] GET /identity/v3/projects/9739ea1321b14d2187985347ea1247dc => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:51.152539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402c3f3-eccf-4e8d-8c23-f8d4e45d248f None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:51.234145 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 186/375] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:22:51.241217 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356422b0-fbf4-4fee-bfee-b2e134b96bbc None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:51.263961 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402c3f3-eccf-4e8d-8c23-f8d4e45d248f None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:51.303256 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b67d6d-b732-4f47-b6d9-31f1b325624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:51.304267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67d6d-b732-4f47-b6d9-31f1b325624b None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:51.304750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67d6d-b732-4f47-b6d9-31f1b325624b None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:51.305241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67d6d-b732-4f47-b6d9-31f1b325624b None admin] PATH_INFO: `/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:51.306657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b67d6d-b732-4f47-b6d9-31f1b325624b None admin] RBAC: Authorizing `identity:get_group(group_id=e6a6a927d2e946ef99afe3897cae0cf0)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:51.308313 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b67d6d-b732-4f47-b6d9-31f1b325624b None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:51.310403 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 190/376] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 26 01:22:51 2022] GET /identity/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:51.316152 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b67d6d-b732-4f47-b6d9-31f1b325624b None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:51.358207 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356422b0-fbf4-4fee-bfee-b2e134b96bbc None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:51.374856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:51.379725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:51.400356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4664db4-ec9d-4759-a768-f6fbf695f2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:51.400992 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4664db4-ec9d-4759-a768-f6fbf695f2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:51.406937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4664db4-ec9d-4759-a768-f6fbf695f2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:51.406937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4664db4-ec9d-4759-a768-f6fbf695f2a7 None admin] PATH_INFO: `/v3/projects/4ba2dacdbbb943beb977f1070136e466` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:51.406937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4664db4-ec9d-4759-a768-f6fbf695f2a7 None admin] RBAC: Authorizing `identity:get_project(project_id=4ba2dacdbbb943beb977f1070136e466)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:51.406937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4664db4-ec9d-4759-a768-f6fbf695f2a7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:51.406937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 187/377] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:51 2022] GET /identity/v3/projects/4ba2dacdbbb943beb977f1070136e466 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:51.412427 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4664db4-ec9d-4759-a768-f6fbf695f2a7 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:51.460327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b67d6d-b732-4f47-b6d9-31f1b325624b None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:51.501951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fe054-d5d3-40d9-9e7d-0dee412408f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:51.503405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fe054-d5d3-40d9-9e7d-0dee412408f8 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:51.503888 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fe054-d5d3-40d9-9e7d-0dee412408f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:51.504378 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fe054-d5d3-40d9-9e7d-0dee412408f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:51.505397 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375fe054-d5d3-40d9-9e7d-0dee412408f8 None admin] RBAC: Adding query filter params (group.id=e6a6a927d2e946ef99afe3897cae0cf0, role.id=e1504eb5f35c468086d3b269e2c72011, scope.project.id=9739ea1321b14d2187985347ea1247dc) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:51.505918 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375fe054-d5d3-40d9-9e7d-0dee412408f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:51.507608 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375fe054-d5d3-40d9-9e7d-0dee412408f8 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:51.515485 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 191/378] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 26 01:22:51 2022] GET /identity/v3/role_assignments?group.id=e6a6a927d2e946ef99afe3897cae0cf0&scope.project.id=9739ea1321b14d2187985347ea1247dc&role.id=e1504eb5f35c468086d3b269e2c72011 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:51.517627 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a0c1d-4456-44d8-94a3-4078beece354 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:51.518148 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a0c1d-4456-44d8-94a3-4078beece354 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:51.518629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a0c1d-4456-44d8-94a3-4078beece354 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:51.520550 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 192/379] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:51.528100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4664db4-ec9d-4759-a768-f6fbf695f2a7 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:51.528815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38823518-7046-49c2-90da-50b1caf008ce None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:51.529265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38823518-7046-49c2-90da-50b1caf008ce None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:51.529685 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38823518-7046-49c2-90da-50b1caf008ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:51.555301 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-38823518-7046-49c2-90da-50b1caf008ce None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:51.558032 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-38823518-7046-49c2-90da-50b1caf008ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:51.574652 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0792ad-1052-4374-b715-eee120c18516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:51.575600 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0792ad-1052-4374-b715-eee120c18516 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:51.576033 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0792ad-1052-4374-b715-eee120c18516 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:51.576405 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0792ad-1052-4374-b715-eee120c18516 None admin] PATH_INFO: `/v3/groups/0a721535aa944d589b3eb21da7e8f109` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:51.588589 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0792ad-1052-4374-b715-eee120c18516 None admin] RBAC: Authorizing `identity:get_group(group_id=0a721535aa944d589b3eb21da7e8f109)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:51.590338 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0792ad-1052-4374-b715-eee120c18516 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:51.592669 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 188/380] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 26 01:22:51 2022] GET /identity/v3/groups/0a721535aa944d589b3eb21da7e8f109 => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:51.598986 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0792ad-1052-4374-b715-eee120c18516 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:51.653372 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:51.661571 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 193/381] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:51.723639 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0792ad-1052-4374-b715-eee120c18516 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:51.761765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c9cc7-b46c-4884-aece-98a67e4f4272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:51.762439 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c9cc7-b46c-4884-aece-98a67e4f4272 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:51.762723 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c9cc7-b46c-4884-aece-98a67e4f4272 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:51.763026 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c9cc7-b46c-4884-aece-98a67e4f4272 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:51.763772 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c9cc7-b46c-4884-aece-98a67e4f4272 None admin] RBAC: Adding query filter params (group.id=0a721535aa944d589b3eb21da7e8f109, role.id=50adf18edc1a47b2bae0876828a88dbf, scope.project.id=4ba2dacdbbb943beb977f1070136e466) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:51.764076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c9cc7-b46c-4884-aece-98a67e4f4272 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:51.765528 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c9cc7-b46c-4884-aece-98a67e4f4272 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:51.772556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 189/382] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 26 01:22:51 2022] GET /identity/v3/role_assignments?group.id=0a721535aa944d589b3eb21da7e8f109&scope.project.id=4ba2dacdbbb943beb977f1070136e466&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:51.794796 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ed09f-eaa0-467e-b5f6-19e1017c5e86 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:51.795406 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ed09f-eaa0-467e-b5f6-19e1017c5e86 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:51.795883 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ed09f-eaa0-467e-b5f6-19e1017c5e86 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:51.797457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 194/383] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:51.804268 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f33f2-0e9f-4eaf-b7a2-c60c254a77af None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:51.804608 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f33f2-0e9f-4eaf-b7a2-c60c254a77af None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:51.804884 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f33f2-0e9f-4eaf-b7a2-c60c254a77af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:51.831961 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-793f33f2-0e9f-4eaf-b7a2-c60c254a77af None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:51.833193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-793f33f2-0e9f-4eaf-b7a2-c60c254a77af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:51.914757 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 190/384] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:51.980054 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ed09f-eaa0-467e-b5f6-19e1017c5e86 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:52.027550 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:52.122345 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ed09f-eaa0-467e-b5f6-19e1017c5e86 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:52.172949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b78095-087f-4ad7-9be7-ae7f6a2f34eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:52.174029 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b78095-087f-4ad7-9be7-ae7f6a2f34eb None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:52.174312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b78095-087f-4ad7-9be7-ae7f6a2f34eb None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:52.174584 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b78095-087f-4ad7-9be7-ae7f6a2f34eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:52.190577 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b78095-087f-4ad7-9be7-ae7f6a2f34eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:52.195928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-06b78095-087f-4ad7-9be7-ae7f6a2f34eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:52.195928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:52.195928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:52.195928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:52.195928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:52.195928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:52.195928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:52.195928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:52.195928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:52.195928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:52.195928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:52.195928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:52.195928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:52.195928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:52.195928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:52.195928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:52.196797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:52.196797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:52.196797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:52.196797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:52.196797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:52.196797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:52.196797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:52.196797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:52.196797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:52.196797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:52.196797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:52.196797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:52.196797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:52.196797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:52.196797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:52.196797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:52.197981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:52.197981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:52.197981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:52.197981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:52.197981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:52.197981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:52.197981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:52.197981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:52.197981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:52.197981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:52.197981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:52.197981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:52.197981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 195/385] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:22:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:52.204771 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f33f2-0e9f-4eaf-b7a2-c60c254a77af None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:52.224629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b78095-087f-4ad7-9be7-ae7f6a2f34eb None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:52.271662 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:52.377370 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f33f2-0e9f-4eaf-b7a2-c60c254a77af None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:52.424123 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:52.435275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6107435-0689-4801-92f6-d8ee3fa096da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:52.436541 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6107435-0689-4801-92f6-d8ee3fa096da None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:52.436974 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6107435-0689-4801-92f6-d8ee3fa096da None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:52.437384 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6107435-0689-4801-92f6-d8ee3fa096da None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:52.438366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6107435-0689-4801-92f6-d8ee3fa096da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:52.438819 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6107435-0689-4801-92f6-d8ee3fa096da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:52.440604 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6107435-0689-4801-92f6-d8ee3fa096da None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:52.448248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b78095-087f-4ad7-9be7-ae7f6a2f34eb None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:52.452190 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 191/386] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:22:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:52.460007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6107435-0689-4801-92f6-d8ee3fa096da None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:52.519073 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc0cf2-a56e-4ead-a972-190d3be4a68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:52.520306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc0cf2-a56e-4ead-a972-190d3be4a68d None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:52.520763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc0cf2-a56e-4ead-a972-190d3be4a68d None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:52.522735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc0cf2-a56e-4ead-a972-190d3be4a68d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:52.547194 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc0cf2-a56e-4ead-a972-190d3be4a68d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:52.554047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-20bc0cf2-a56e-4ead-a972-190d3be4a68d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:52.554047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:52.554047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:52.554047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:52.554047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:52.554047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:52.554047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:52.554047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:52.554047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:52.554047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:52.554047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:52.554047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:52.554047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:52.554047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:52.554047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:52.554047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:52.555274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:52.555274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:52.555274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:52.555274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:52.555274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:52.555274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:52.555274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:52.555274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:52.555274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:52.555274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:52.555274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:52.555274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:52.555274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:52.555274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:52.555274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:52.555274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:52.556259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:52.556259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:52.556259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:52.556259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:52.556259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:52.556259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:52.556259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:52.556259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:52.556259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:52.556259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:52.556259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:52.556259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:52.565805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 196/387] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:52.569917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc0cf2-a56e-4ead-a972-190d3be4a68d None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:52.654202 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6107435-0689-4801-92f6-d8ee3fa096da None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:52.656624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:52.716839 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bb4cb-bbc6-4a3b-b4b0-1bc101ae134b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:52.717474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bb4cb-bbc6-4a3b-b4b0-1bc101ae134b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:52.717747 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bb4cb-bbc6-4a3b-b4b0-1bc101ae134b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:52.718017 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bb4cb-bbc6-4a3b-b4b0-1bc101ae134b None admin] PATH_INFO: `/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:52.721819 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bb4cb-bbc6-4a3b-b4b0-1bc101ae134b None admin] RBAC: Authorizing `identity:get_group(group_id=e6a6a927d2e946ef99afe3897cae0cf0)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:52.723683 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bb4cb-bbc6-4a3b-b4b0-1bc101ae134b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:52.725880 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 192/388] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 26 01:22:52 2022] GET /identity/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0 => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:52.735901 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bb4cb-bbc6-4a3b-b4b0-1bc101ae134b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:52.770870 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc0cf2-a56e-4ead-a972-190d3be4a68d None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:52.848042 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365a46b-f9fb-43fb-a4c9-ac3c7037a6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:52.848963 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365a46b-f9fb-43fb-a4c9-ac3c7037a6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:52.851245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365a46b-f9fb-43fb-a4c9-ac3c7037a6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:52.851735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365a46b-f9fb-43fb-a4c9-ac3c7037a6d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:52.852597 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365a46b-f9fb-43fb-a4c9-ac3c7037a6d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:52.854890 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365a46b-f9fb-43fb-a4c9-ac3c7037a6d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:52.856429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365a46b-f9fb-43fb-a4c9-ac3c7037a6d8 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:52.870567 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 197/389] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:52.878008 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365a46b-f9fb-43fb-a4c9-ac3c7037a6d8 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:52.909233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:52.950263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bb4cb-bbc6-4a3b-b4b0-1bc101ae134b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:53.032261 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c4ae9-343d-4f87-91a4-60d312f25180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:53.033386 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c4ae9-343d-4f87-91a4-60d312f25180 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:53.033706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c4ae9-343d-4f87-91a4-60d312f25180 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:53.033999 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c4ae9-343d-4f87-91a4-60d312f25180 None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:53.039636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c4ae9-343d-4f87-91a4-60d312f25180 None admin] RBAC: Authorizing `identity:get_project(project_id=def6cb215c3c45f2a54435c338e667ab)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:53.041115 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c4ae9-343d-4f87-91a4-60d312f25180 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:53.043155 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 193/390] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:52 2022] GET /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:53.052020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365a46b-f9fb-43fb-a4c9-ac3c7037a6d8 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:53.063947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c4ae9-343d-4f87-91a4-60d312f25180 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:53.100434 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6ca39-155e-4cbd-a0f7-a6f713da290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:53.101461 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6ca39-155e-4cbd-a0f7-a6f713da290f None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:53.101982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6ca39-155e-4cbd-a0f7-a6f713da290f None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:53.102522 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6ca39-155e-4cbd-a0f7-a6f713da290f None admin] PATH_INFO: `/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:53.103923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6ca39-155e-4cbd-a0f7-a6f713da290f None admin] RBAC: Authorizing `identity:get_group(group_id=e6a6a927d2e946ef99afe3897cae0cf0)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:53.105544 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6ca39-155e-4cbd-a0f7-a6f713da290f None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:53.107441 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 198/391] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 26 01:22:52 2022] GET /identity/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:53.119270 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6ca39-155e-4cbd-a0f7-a6f713da290f None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:53.132903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:53.208832 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c4ae9-343d-4f87-91a4-60d312f25180 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:53.248569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893b232-3b84-4322-a160-aa2d4866c179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:53.249243 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893b232-3b84-4322-a160-aa2d4866c179 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:53.249518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893b232-3b84-4322-a160-aa2d4866c179 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:53.249793 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893b232-3b84-4322-a160-aa2d4866c179 None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab/groups/e6a6a927d2e946ef99afe3897cae0cf0/roles/e1504eb5f35c468086d3b269e2c72011` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:53.252716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893b232-3b84-4322-a160-aa2d4866c179 None admin] RBAC: Authorizing `identity:create_grant(project_id=def6cb215c3c45f2a54435c338e667ab, group_id=e6a6a927d2e946ef99afe3897cae0cf0, role_id=e1504eb5f35c468086d3b269e2c72011)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:53.254690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893b232-3b84-4322-a160-aa2d4866c179 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:53.276906 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 194/392] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Sep 26 01:22:53 2022] PUT /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab/groups/e6a6a927d2e946ef99afe3897cae0cf0/roles/e1504eb5f35c468086d3b269e2c72011 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:22:53.294742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:53.316365 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6ca39-155e-4cbd-a0f7-a6f713da290f None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:53.353957 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df30fd-1be7-4714-be0b-2a5e1bc4be27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:53.354586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df30fd-1be7-4714-be0b-2a5e1bc4be27 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:53.354887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df30fd-1be7-4714-be0b-2a5e1bc4be27 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:53.355166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df30fd-1be7-4714-be0b-2a5e1bc4be27 None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:53.356294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df30fd-1be7-4714-be0b-2a5e1bc4be27 None admin] RBAC: Authorizing `identity:get_project(project_id=def6cb215c3c45f2a54435c338e667ab)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:53.357725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df30fd-1be7-4714-be0b-2a5e1bc4be27 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:53.359754 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 199/393] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:53 2022] GET /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:53.365758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893b232-3b84-4322-a160-aa2d4866c179 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:53.479889 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:53.489605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893b232-3b84-4322-a160-aa2d4866c179 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:53.528740 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713ce77-394d-44de-af4a-600f9c5bdfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:53.529453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713ce77-394d-44de-af4a-600f9c5bdfd4 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:53.529736 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713ce77-394d-44de-af4a-600f9c5bdfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:53.530009 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713ce77-394d-44de-af4a-600f9c5bdfd4 None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab/groups/e6a6a927d2e946ef99afe3897cae0cf0/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:53.532041 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713ce77-394d-44de-af4a-600f9c5bdfd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=def6cb215c3c45f2a54435c338e667ab, group_id=e6a6a927d2e946ef99afe3897cae0cf0, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:53.533760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713ce77-394d-44de-af4a-600f9c5bdfd4 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:53.557803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 195/394] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Sep 26 01:22:53 2022] PUT /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab/groups/e6a6a927d2e946ef99afe3897cae0cf0/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:22:53.752754 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee58f6d-0a45-4f5d-8ac7-484515d8ed5d None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:53.753291 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee58f6d-0a45-4f5d-8ac7-484515d8ed5d None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:53.753291 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee58f6d-0a45-4f5d-8ac7-484515d8ed5d None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:53.754998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 200/395] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:53.760678 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1476ae5-cee3-4cb7-82f1-e2c5964d8df7 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:53.761195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1476ae5-cee3-4cb7-82f1-e2c5964d8df7 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:53.761271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1476ae5-cee3-4cb7-82f1-e2c5964d8df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:53.780977 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-d1476ae5-cee3-4cb7-82f1-e2c5964d8df7 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:53.782518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d1476ae5-cee3-4cb7-82f1-e2c5964d8df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:53.862392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 196/396] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:54.143310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee58f6d-0a45-4f5d-8ac7-484515d8ed5d None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:54.250015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee58f6d-0a45-4f5d-8ac7-484515d8ed5d None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:54.290340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a1790-3884-4f63-904a-2e1da68330dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:54.291396 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a1790-3884-4f63-904a-2e1da68330dd None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:54.291951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a1790-3884-4f63-904a-2e1da68330dd None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:54.292429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a1790-3884-4f63-904a-2e1da68330dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:54.307984 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a1790-3884-4f63-904a-2e1da68330dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:54.313623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-cd6a1790-3884-4f63-904a-2e1da68330dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:54.313623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:54.313623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:54.313623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:54.313623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:54.313623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:54.313623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:54.313623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:54.313623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:54.313623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:54.313623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:54.313623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:54.313623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:54.313623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:54.313623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:54.313623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:54.315048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:54.315048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:54.315048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:54.315048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:54.315048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:54.315048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:54.315048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:54.315048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:54.315048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:54.315048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:54.315048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:54.315048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:54.315048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:54.315048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:54.315048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:54.315048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:54.315841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:54.315841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:54.315841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:54.315841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:54.315841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:54.315841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:54.315841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:54.315841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:54.315841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:54.315841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:54.315841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:54.315841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:54.319465 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 201/397] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:54.325644 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1476ae5-cee3-4cb7-82f1-e2c5964d8df7 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:54.452087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:54.469627 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1476ae5-cee3-4cb7-82f1-e2c5964d8df7 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:54.500006 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6ba6e-ee7d-48ff-ad3f-16f971b88e4a None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:54.500340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6ba6e-ee7d-48ff-ad3f-16f971b88e4a None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:54.500543 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6ba6e-ee7d-48ff-ad3f-16f971b88e4a None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:54.503129 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 202/398] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:22:54.509165 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87561a03-547b-40dc-8346-ec5f9ffaffb8 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:54.509452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87561a03-547b-40dc-8346-ec5f9ffaffb8 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:54.509727 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87561a03-547b-40dc-8346-ec5f9ffaffb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:54.527727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40057e5-937f-4948-a119-7bb399738d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:54.528347 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40057e5-937f-4948-a119-7bb399738d2f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:54.528627 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40057e5-937f-4948-a119-7bb399738d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:54.528901 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40057e5-937f-4948-a119-7bb399738d2f None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:54.529571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40057e5-937f-4948-a119-7bb399738d2f None admin] RBAC: Adding query filter params (name=member) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:54.529874 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40057e5-937f-4948-a119-7bb399738d2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:54.531442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40057e5-937f-4948-a119-7bb399738d2f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:54.544358 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-87561a03-547b-40dc-8346-ec5f9ffaffb8 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:54.545556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-87561a03-547b-40dc-8346-ec5f9ffaffb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:54.550288 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 197/399] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:54.556463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40057e5-937f-4948-a119-7bb399738d2f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:54.557605 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:54.680220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 203/400] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:22:54.743115 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40057e5-937f-4948-a119-7bb399738d2f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:54.781338 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc52f50-696f-466d-bee5-191cea229f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:54.781955 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc52f50-696f-466d-bee5-191cea229f39 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:54.782407 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc52f50-696f-466d-bee5-191cea229f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:54.782744 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc52f50-696f-466d-bee5-191cea229f39 None admin] PATH_INFO: `/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:54.787616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc52f50-696f-466d-bee5-191cea229f39 None admin] RBAC: Authorizing `identity:get_group(group_id=e6a6a927d2e946ef99afe3897cae0cf0)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:54.789097 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc52f50-696f-466d-bee5-191cea229f39 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:54.791056 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 198/401] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 26 01:22:54 2022] GET /identity/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:54.796211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87561a03-547b-40dc-8346-ec5f9ffaffb8 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:54.858909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9fd74-ebcb-4624-bbab-49e191ddbd47 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:54.859550 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9fd74-ebcb-4624-bbab-49e191ddbd47 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:54.860028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9fd74-ebcb-4624-bbab-49e191ddbd47 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:54.862428 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 199/402] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:54.867708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ef07e-b188-42ff-9506-d3fba864a70a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:54.868250 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ef07e-b188-42ff-9506-d3fba864a70a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:54.868752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ef07e-b188-42ff-9506-d3fba864a70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:54.904115 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-6a3ef07e-b188-42ff-9506-d3fba864a70a None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:54.905328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6a3ef07e-b188-42ff-9506-d3fba864a70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:54.927606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:54.933569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87561a03-547b-40dc-8346-ec5f9ffaffb8 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:54.973898 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175ca86-5050-4740-bee9-d56a3b446e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:54.975042 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175ca86-5050-4740-bee9-d56a3b446e78 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:54.975531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175ca86-5050-4740-bee9-d56a3b446e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:54.976007 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175ca86-5050-4740-bee9-d56a3b446e78 None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:54.977360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175ca86-5050-4740-bee9-d56a3b446e78 None admin] RBAC: Authorizing `identity:get_project(project_id=9739ea1321b14d2187985347ea1247dc)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:54.979039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175ca86-5050-4740-bee9-d56a3b446e78 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:54.981211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 204/403] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:54 2022] GET /identity/v3/projects/9739ea1321b14d2187985347ea1247dc => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:54.987261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175ca86-5050-4740-bee9-d56a3b446e78 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:54.999189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:55.039489 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 200/404] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:22:55.040545 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ef07e-b188-42ff-9506-d3fba864a70a None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:55.154814 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175ca86-5050-4740-bee9-d56a3b446e78 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:55.212765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ef07e-b188-42ff-9506-d3fba864a70a None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:55.219157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33d300-a399-4d6d-aa19-5b234e5aadb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:55.219988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33d300-a399-4d6d-aa19-5b234e5aadb9 None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:55.220749 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33d300-a399-4d6d-aa19-5b234e5aadb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:55.221159 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33d300-a399-4d6d-aa19-5b234e5aadb9 None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc/groups/e6a6a927d2e946ef99afe3897cae0cf0/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:55.227841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33d300-a399-4d6d-aa19-5b234e5aadb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9739ea1321b14d2187985347ea1247dc, group_id=e6a6a927d2e946ef99afe3897cae0cf0, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:55.229433 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33d300-a399-4d6d-aa19-5b234e5aadb9 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:55.253174 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 205/405] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Sep 26 01:22:54 2022] PUT /identity/v3/projects/9739ea1321b14d2187985347ea1247dc/groups/e6a6a927d2e946ef99afe3897cae0cf0/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:22:55.290365 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e015bf-8f76-4112-89e7-f71f313c5c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:55.291374 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e015bf-8f76-4112-89e7-f71f313c5c47 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:55.291792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e015bf-8f76-4112-89e7-f71f313c5c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:55.292203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e015bf-8f76-4112-89e7-f71f313c5c47 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:55.305104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e015bf-8f76-4112-89e7-f71f313c5c47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:55.310693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-48e015bf-8f76-4112-89e7-f71f313c5c47 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:55.310693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:55.310693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:55.310693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:55.310693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:55.310693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:55.310693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:55.310693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:55.310693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:55.310693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:55.310693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:55.310693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:55.310693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:55.310693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:55.310693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:55.310693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:55.314716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:55.314716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:55.314716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:55.314716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:55.314716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:55.314716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:55.314716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:55.314716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:55.314716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:55.314716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:55.314716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:55.314716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:55.314716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:55.314716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:55.314716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:55.314716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:55.315529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:55.315529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:55.315529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:55.315529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:55.315529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:55.315529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:55.315529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:55.315529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:55.315529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:55.315529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:55.315529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:55.315529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:55.317719 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 201/406] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:22:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:55.324182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33d300-a399-4d6d-aa19-5b234e5aadb9 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:55.414968 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e015bf-8f76-4112-89e7-f71f313c5c47 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:55.429139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:55.431580 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:55.501172 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33d300-a399-4d6d-aa19-5b234e5aadb9 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:55.559303 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4740fef-6d83-44d1-b777-1cca471fd622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:55.560179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4740fef-6d83-44d1-b777-1cca471fd622 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:55.560455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4740fef-6d83-44d1-b777-1cca471fd622 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:55.560974 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4740fef-6d83-44d1-b777-1cca471fd622 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:55.562020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4740fef-6d83-44d1-b777-1cca471fd622 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:55.562331 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4740fef-6d83-44d1-b777-1cca471fd622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:55.563714 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4740fef-6d83-44d1-b777-1cca471fd622 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:55.576422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 206/407] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:22:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:55.581591 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4740fef-6d83-44d1-b777-1cca471fd622 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:55.582045 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e015bf-8f76-4112-89e7-f71f313c5c47 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:55.618854 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01118a45-fd99-4a8e-a8a4-789d162b9a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:55.619546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01118a45-fd99-4a8e-a8a4-789d162b9a9b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:55.619827 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01118a45-fd99-4a8e-a8a4-789d162b9a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:55.620101 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01118a45-fd99-4a8e-a8a4-789d162b9a9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:55.632370 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01118a45-fd99-4a8e-a8a4-789d162b9a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:55.637477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-01118a45-fd99-4a8e-a8a4-789d162b9a9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:55.637477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:55.637477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:55.637477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:55.637477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:55.637477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:55.637477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:55.637477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:55.637477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:55.637477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:55.637477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:55.637477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:55.637477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:55.637477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:55.637477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:55.637477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:55.638366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:55.638366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:55.638366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:55.638366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:55.638366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:55.638366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:55.638366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:55.638366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:55.638366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:55.638366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:55.638366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:55.638366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:55.638366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:55.638366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:55.638366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:55.638366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:55.639203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:55.639203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:55.639203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:55.639203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:55.639203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:55.639203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:55.639203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:55.639203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:55.639203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:55.639203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:55.639203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:55.639203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:55.639203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 202/408] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:22:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:22:55.645302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01118a45-fd99-4a8e-a8a4-789d162b9a9b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:55.683645 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4740fef-6d83-44d1-b777-1cca471fd622 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:55.713031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:55.718535 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:55.721749 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b02d8-b888-4f6e-a652-055126cb7e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:55.722545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b02d8-b888-4f6e-a652-055126cb7e2b None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:55.722840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b02d8-b888-4f6e-a652-055126cb7e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:55.723123 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b02d8-b888-4f6e-a652-055126cb7e2b None admin] PATH_INFO: `/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:55.724557 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b02d8-b888-4f6e-a652-055126cb7e2b None admin] RBAC: Authorizing `identity:get_group(group_id=e6a6a927d2e946ef99afe3897cae0cf0)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:55.726065 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b02d8-b888-4f6e-a652-055126cb7e2b None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:55.727963 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 207/409] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 26 01:22:55 2022] GET /identity/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:55.733278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b02d8-b888-4f6e-a652-055126cb7e2b None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:55.757117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01118a45-fd99-4a8e-a8a4-789d162b9a9b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:55.793170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769aedbc-51a2-4e9a-96bf-22e1ddeab38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:55.793926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769aedbc-51a2-4e9a-96bf-22e1ddeab38c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:55.794089 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769aedbc-51a2-4e9a-96bf-22e1ddeab38c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:55.794293 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769aedbc-51a2-4e9a-96bf-22e1ddeab38c None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:55.794983 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769aedbc-51a2-4e9a-96bf-22e1ddeab38c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:55.795285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769aedbc-51a2-4e9a-96bf-22e1ddeab38c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:55.796657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769aedbc-51a2-4e9a-96bf-22e1ddeab38c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:55.805636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 203/410] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:55.811088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769aedbc-51a2-4e9a-96bf-22e1ddeab38c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:55.838714 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b02d8-b888-4f6e-a652-055126cb7e2b None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:55.874281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d15e2-120b-42a0-8dd5-995adf093aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:55.874952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d15e2-120b-42a0-8dd5-995adf093aad None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:55.875230 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d15e2-120b-42a0-8dd5-995adf093aad None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:55.875502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d15e2-120b-42a0-8dd5-995adf093aad None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:55.877227 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d15e2-120b-42a0-8dd5-995adf093aad None admin] RBAC: Authorizing `identity:get_project(project_id=9739ea1321b14d2187985347ea1247dc)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:55.879429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d15e2-120b-42a0-8dd5-995adf093aad None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:55.881350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 208/411] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:55 2022] GET /identity/v3/projects/9739ea1321b14d2187985347ea1247dc => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:55.887631 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d15e2-120b-42a0-8dd5-995adf093aad None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:55.924491 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769aedbc-51a2-4e9a-96bf-22e1ddeab38c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:55.960706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:55.971055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2c9c9-37e8-4933-9415-a16a8b0bc000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:55.972450 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2c9c9-37e8-4933-9415-a16a8b0bc000 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:55.973062 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2c9c9-37e8-4933-9415-a16a8b0bc000 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:55.973564 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2c9c9-37e8-4933-9415-a16a8b0bc000 None admin] PATH_INFO: `/v3/groups/0a721535aa944d589b3eb21da7e8f109` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:55.974977 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2c9c9-37e8-4933-9415-a16a8b0bc000 None admin] RBAC: Authorizing `identity:get_group(group_id=0a721535aa944d589b3eb21da7e8f109)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:55.976731 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2c9c9-37e8-4933-9415-a16a8b0bc000 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:55.977850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:55.980451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 204/412] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 26 01:22:55 2022] GET /identity/v3/groups/0a721535aa944d589b3eb21da7e8f109 => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:55.988044 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2c9c9-37e8-4933-9415-a16a8b0bc000 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:56.074123 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d15e2-120b-42a0-8dd5-995adf093aad None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:56.124225 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2c9c9-37e8-4933-9415-a16a8b0bc000 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:56.152422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84f79f-401b-4933-ba1f-3dfb51ebbc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:56.153564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84f79f-401b-4933-ba1f-3dfb51ebbc4e None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:56.154987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84f79f-401b-4933-ba1f-3dfb51ebbc4e None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:56.155490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84f79f-401b-4933-ba1f-3dfb51ebbc4e None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc/groups/e6a6a927d2e946ef99afe3897cae0cf0/roles/e1504eb5f35c468086d3b269e2c72011` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:56.161390 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84f79f-401b-4933-ba1f-3dfb51ebbc4e None admin] RBAC: Authorizing `identity:create_grant(project_id=9739ea1321b14d2187985347ea1247dc, group_id=e6a6a927d2e946ef99afe3897cae0cf0, role_id=e1504eb5f35c468086d3b269e2c72011)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:56.164164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84f79f-401b-4933-ba1f-3dfb51ebbc4e None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:56.192451 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 209/413] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Sep 26 01:22:55 2022] PUT /identity/v3/projects/9739ea1321b14d2187985347ea1247dc/groups/e6a6a927d2e946ef99afe3897cae0cf0/roles/e1504eb5f35c468086d3b269e2c72011 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:22:56.195599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1158e5d-000f-472a-9bc6-d59b405a7a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:56.196615 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1158e5d-000f-472a-9bc6-d59b405a7a70 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:56.197121 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1158e5d-000f-472a-9bc6-d59b405a7a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:56.197605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1158e5d-000f-472a-9bc6-d59b405a7a70 None admin] PATH_INFO: `/v3/projects/4ba2dacdbbb943beb977f1070136e466` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:56.199255 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1158e5d-000f-472a-9bc6-d59b405a7a70 None admin] RBAC: Authorizing `identity:get_project(project_id=4ba2dacdbbb943beb977f1070136e466)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:56.201139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1158e5d-000f-472a-9bc6-d59b405a7a70 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:56.203503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 205/414] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:55 2022] GET /identity/v3/projects/4ba2dacdbbb943beb977f1070136e466 => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:56.211805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84f79f-401b-4933-ba1f-3dfb51ebbc4e None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:56.369929 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84f79f-401b-4933-ba1f-3dfb51ebbc4e None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:56.411790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:56.428231 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380a111-f989-41e9-ae44-b7a3753fecfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:56.428947 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380a111-f989-41e9-ae44-b7a3753fecfa None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:56.429263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380a111-f989-41e9-ae44-b7a3753fecfa None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:56.429537 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380a111-f989-41e9-ae44-b7a3753fecfa None admin] PATH_INFO: `/v3/projects/4ba2dacdbbb943beb977f1070136e466/groups/0a721535aa944d589b3eb21da7e8f109/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:56.433220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380a111-f989-41e9-ae44-b7a3753fecfa None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba2dacdbbb943beb977f1070136e466, group_id=0a721535aa944d589b3eb21da7e8f109, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:56.434665 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380a111-f989-41e9-ae44-b7a3753fecfa None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:56.462770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 210/415] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Sep 26 01:22:56 2022] PUT /identity/v3/projects/4ba2dacdbbb943beb977f1070136e466/groups/0a721535aa944d589b3eb21da7e8f109/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:22:56.524660 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bbb4a-a1d3-40f7-aaef-5604a64d3b7d None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:56.525023 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bbb4a-a1d3-40f7-aaef-5604a64d3b7d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:56.525229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bbb4a-a1d3-40f7-aaef-5604a64d3b7d None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:56.526954 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 206/416] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:56.533478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2586d8-9b3d-499c-a311-eabafce1975e None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:56.534316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2586d8-9b3d-499c-a311-eabafce1975e None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:56.534801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2586d8-9b3d-499c-a311-eabafce1975e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:56.560358 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-3e2586d8-9b3d-499c-a311-eabafce1975e None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:56.561631 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-3e2586d8-9b3d-499c-a311-eabafce1975e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:56.565554 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679fa9e-e9a6-41a4-a9d9-1398595dd130 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:56.566086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679fa9e-e9a6-41a4-a9d9-1398595dd130 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:56.566360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679fa9e-e9a6-41a4-a9d9-1398595dd130 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:56.567722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 207/417] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:56.574362 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697ccf4-e452-429f-a744-1322615a547e None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:56.574697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697ccf4-e452-429f-a744-1322615a547e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:56.574957 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697ccf4-e452-429f-a744-1322615a547e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:56.599043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-f697ccf4-e452-429f-a744-1322615a547e None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:56.600439 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f697ccf4-e452-429f-a744-1322615a547e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:56.659678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 211/418] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:56.683234 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:56.693137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 208/419] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:22:56.976167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2586d8-9b3d-499c-a311-eabafce1975e None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:56.993873 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697ccf4-e452-429f-a744-1322615a547e None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:57.124329 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2586d8-9b3d-499c-a311-eabafce1975e None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:57.145039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:57.163231 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f6e33-a826-49ea-9381-726ee764fa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:57.163865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f6e33-a826-49ea-9381-726ee764fa5b None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:57.164335 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f6e33-a826-49ea-9381-726ee764fa5b None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:57.164440 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f6e33-a826-49ea-9381-726ee764fa5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:57.176054 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f6e33-a826-49ea-9381-726ee764fa5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:57.181119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-8a7f6e33-a826-49ea-9381-726ee764fa5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:57.181119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:57.181119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:57.181119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:57.181119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:57.181119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:57.181119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:57.181119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:57.181119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:57.181119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:57.181119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:57.181119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:57.181119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:57.181119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:57.181119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:57.181119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:57.181998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:57.181998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:57.181998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:57.181998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:57.181998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:57.181998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:57.181998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:57.181998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:57.181998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:57.181998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:57.181998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:57.181998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:57.181998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:57.181998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:57.181998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:57.181998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:57.182783 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:57.182783 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:57.182783 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:57.182783 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:57.182783 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:57.182783 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:57.182783 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:57.182783 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:57.182783 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:57.182783 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:57.182783 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:57.182783 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:57.182783 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 212/420] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:57.189429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f6e33-a826-49ea-9381-726ee764fa5b None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:57.236824 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697ccf4-e452-429f-a744-1322615a547e None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:57.294186 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f6e33-a826-49ea-9381-726ee764fa5b None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:57.301451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69caf46-c8bd-4ac9-aad0-26426cb36d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:57.302093 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69caf46-c8bd-4ac9-aad0-26426cb36d88 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:57.302366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69caf46-c8bd-4ac9-aad0-26426cb36d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:57.302636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69caf46-c8bd-4ac9-aad0-26426cb36d88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:57.323144 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69caf46-c8bd-4ac9-aad0-26426cb36d88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:57.330270 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a13d2-63bd-4dfb-8daf-b56b9c8d8c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:57.330902 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a13d2-63bd-4dfb-8daf-b56b9c8d8c35 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:57.331183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a13d2-63bd-4dfb-8daf-b56b9c8d8c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:57.331460 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a13d2-63bd-4dfb-8daf-b56b9c8d8c35 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:57.332124 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a13d2-63bd-4dfb-8daf-b56b9c8d8c35 None admin] RBAC: Adding query filter params (name=member) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:57.332424 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a13d2-63bd-4dfb-8daf-b56b9c8d8c35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:57.333779 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a13d2-63bd-4dfb-8daf-b56b9c8d8c35 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:57.336176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-e69caf46-c8bd-4ac9-aad0-26426cb36d88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:57.336176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:57.336176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:57.336176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:57.336176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:57.336176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:57.336176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:57.336176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:57.336176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:57.336176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:57.336176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:57.336176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:57.336176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:57.336176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:57.336176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:57.336176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:57.337055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:57.337055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:57.337055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:57.337055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:57.337055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:57.337055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:57.337055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:57.337055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:57.337055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:57.337055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:57.337055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:57.337055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:57.337055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:57.337055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:57.337055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:57.337055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:57.337864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:57.337864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:57.337864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:57.337864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:57.337864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:57.337864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:57.337864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:57.337864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:57.337864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:57.337864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:57.337864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:57.337864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:57.337864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 209/421] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:22:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:22:57.342933 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69caf46-c8bd-4ac9-aad0-26426cb36d88 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:57.347404 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 213/422] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:57.350038 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a13d2-63bd-4dfb-8daf-b56b9c8d8c35 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:57.391902 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:57.455808 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a13d2-63bd-4dfb-8daf-b56b9c8d8c35 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:57.464386 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:57.491057 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186dd36-228b-4425-96ec-54681f0bffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:57.491589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186dd36-228b-4425-96ec-54681f0bffd8 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:57.491868 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186dd36-228b-4425-96ec-54681f0bffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:57.492136 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186dd36-228b-4425-96ec-54681f0bffd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:57.560212 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69caf46-c8bd-4ac9-aad0-26426cb36d88 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:57.563214 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2186dd36-228b-4425-96ec-54681f0bffd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:57.564832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2186dd36-228b-4425-96ec-54681f0bffd8 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:57.608964 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:57.639533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9030c2-866f-43ae-98f8-75f80e3926c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:57.640157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9030c2-866f-43ae-98f8-75f80e3926c5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:57.640440 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9030c2-866f-43ae-98f8-75f80e3926c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:57.640714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9030c2-866f-43ae-98f8-75f80e3926c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:57.641388 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9030c2-866f-43ae-98f8-75f80e3926c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:57.641692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9030c2-866f-43ae-98f8-75f80e3926c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:57.643953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9030c2-866f-43ae-98f8-75f80e3926c5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:57.666237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 210/423] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:22:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:57.670468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 214/424] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:22:57.675930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9030c2-866f-43ae-98f8-75f80e3926c5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:57.676554 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186dd36-228b-4425-96ec-54681f0bffd8 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:57.788345 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186dd36-228b-4425-96ec-54681f0bffd8 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:57.825380 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424a1dd-49d5-4385-8a49-a39e53cba90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:57.826004 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424a1dd-49d5-4385-8a49-a39e53cba90a None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:57.826354 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424a1dd-49d5-4385-8a49-a39e53cba90a None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:57.826702 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424a1dd-49d5-4385-8a49-a39e53cba90a None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:57.828031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424a1dd-49d5-4385-8a49-a39e53cba90a None admin] RBAC: Authorizing `identity:get_project(project_id=def6cb215c3c45f2a54435c338e667ab)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:57.829489 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424a1dd-49d5-4385-8a49-a39e53cba90a None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:57.831534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 215/425] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:57 2022] GET /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:57.836862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424a1dd-49d5-4385-8a49-a39e53cba90a None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:57.855205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:57.877616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9030c2-866f-43ae-98f8-75f80e3926c5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:57.895975 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:57.916525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11aeb7-2432-43a9-92d8-01f7cf876597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:57.917376 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11aeb7-2432-43a9-92d8-01f7cf876597 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:57.917833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11aeb7-2432-43a9-92d8-01f7cf876597 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:57.918245 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11aeb7-2432-43a9-92d8-01f7cf876597 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:57.965340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424a1dd-49d5-4385-8a49-a39e53cba90a None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:58.001150 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11aeb7-2432-43a9-92d8-01f7cf876597 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:58.001150 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11aeb7-2432-43a9-92d8-01f7cf876597 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:58.004292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c79b6-5660-4814-9577-d35d9ca14ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:58.005220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c79b6-5660-4814-9577-d35d9ca14ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:58.005487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c79b6-5660-4814-9577-d35d9ca14ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:58.005867 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c79b6-5660-4814-9577-d35d9ca14ab3 None admin] PATH_INFO: `/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:58.007174 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c79b6-5660-4814-9577-d35d9ca14ab3 None admin] RBAC: Authorizing `identity:get_group(group_id=e6a6a927d2e946ef99afe3897cae0cf0)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:58.008780 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c79b6-5660-4814-9577-d35d9ca14ab3 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:58.015939 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 216/426] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 26 01:22:57 2022] GET /identity/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:58.018006 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da725c32-2289-4784-b00d-6df76b0a5522 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:58.018508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da725c32-2289-4784-b00d-6df76b0a5522 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:58.019102 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da725c32-2289-4784-b00d-6df76b0a5522 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:58.020812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 217/427] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:22:58.021701 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da725c32-2289-4784-b00d-6df76b0a5522 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:58.106187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:58.135104 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da725c32-2289-4784-b00d-6df76b0a5522 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:58.135379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 211/428] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:22:58.136955 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4b826-c2c3-43aa-aa96-9a9e33e029ee None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:58.137399 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4b826-c2c3-43aa-aa96-9a9e33e029ee None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:58.137907 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4b826-c2c3-43aa-aa96-9a9e33e029ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:58.160744 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-9ac4b826-c2c3-43aa-aa96-9a9e33e029ee None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:58.161958 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-9ac4b826-c2c3-43aa-aa96-9a9e33e029ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:58.174044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10087ca4-2772-48cb-a04a-b7739e7ecdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:58.174961 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10087ca4-2772-48cb-a04a-b7739e7ecdfe None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:58.175159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:58.175424 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10087ca4-2772-48cb-a04a-b7739e7ecdfe None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:58.176009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10087ca4-2772-48cb-a04a-b7739e7ecdfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:58.176758 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10087ca4-2772-48cb-a04a-b7739e7ecdfe None admin] RBAC: Adding query filter params (group.id=e6a6a927d2e946ef99afe3897cae0cf0, role.id=f4df3a7a4c0b4730abc0601e2b072ef4, scope.project.id=def6cb215c3c45f2a54435c338e667ab) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:58.177069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10087ca4-2772-48cb-a04a-b7739e7ecdfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:58.178516 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10087ca4-2772-48cb-a04a-b7739e7ecdfe None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:58.185183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 218/429] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 26 01:22:58 2022] GET /identity/v3/role_assignments?group.id=e6a6a927d2e946ef99afe3897cae0cf0&scope.project.id=def6cb215c3c45f2a54435c338e667ab&role.id=f4df3a7a4c0b4730abc0601e2b072ef4 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:58.185782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10087ca4-2772-48cb-a04a-b7739e7ecdfe None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:58.284800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 212/430] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:58.368789 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10087ca4-2772-48cb-a04a-b7739e7ecdfe None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:58.410748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0342184-89db-44a2-84ad-76ae1b093925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:58.410748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0342184-89db-44a2-84ad-76ae1b093925 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:58.410748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0342184-89db-44a2-84ad-76ae1b093925 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:58.410748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0342184-89db-44a2-84ad-76ae1b093925 None admin] PATH_INFO: `/v3/projects/def6cb215c3c45f2a54435c338e667ab` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:58.411174 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0342184-89db-44a2-84ad-76ae1b093925 None admin] RBAC: Authorizing `identity:get_project(project_id=def6cb215c3c45f2a54435c338e667ab)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:58.412374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0342184-89db-44a2-84ad-76ae1b093925 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:58.418671 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 219/431] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:58 2022] GET /identity/v3/projects/def6cb215c3c45f2a54435c338e667ab => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:58.420203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4b826-c2c3-43aa-aa96-9a9e33e029ee None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:58.553998 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4b826-c2c3-43aa-aa96-9a9e33e029ee None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:58.597551 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdb888-7996-4b53-8208-7298545ff4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:58.598551 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdb888-7996-4b53-8208-7298545ff4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:58.599076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdb888-7996-4b53-8208-7298545ff4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:58.599555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdb888-7996-4b53-8208-7298545ff4a4 None admin] PATH_INFO: `/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:58.601028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdb888-7996-4b53-8208-7298545ff4a4 None admin] RBAC: Authorizing `identity:get_group(group_id=e6a6a927d2e946ef99afe3897cae0cf0)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:58.603057 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdb888-7996-4b53-8208-7298545ff4a4 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:58.604913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 213/432] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 26 01:22:58 2022] GET /identity/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:58.611094 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0342184-89db-44a2-84ad-76ae1b093925 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:58.621498 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:58.655575 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdb888-7996-4b53-8208-7298545ff4a4 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:58.677303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:58.785494 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0342184-89db-44a2-84ad-76ae1b093925 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:58.808889 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdb888-7996-4b53-8208-7298545ff4a4 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:58.827378 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d932e-20b1-4b38-8b2f-063ea210df40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:58.828221 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d932e-20b1-4b38-8b2f-063ea210df40 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:58.828718 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d932e-20b1-4b38-8b2f-063ea210df40 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:58.829224 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d932e-20b1-4b38-8b2f-063ea210df40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:58.830808 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d932e-20b1-4b38-8b2f-063ea210df40 None admin] RBAC: Adding query filter params (group.id=e6a6a927d2e946ef99afe3897cae0cf0, role.id=e1504eb5f35c468086d3b269e2c72011, scope.project.id=def6cb215c3c45f2a54435c338e667ab) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:58.831274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d932e-20b1-4b38-8b2f-063ea210df40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:58.832865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d932e-20b1-4b38-8b2f-063ea210df40 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:58.845273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 220/433] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 26 01:22:58 2022] GET /identity/v3/role_assignments?group.id=e6a6a927d2e946ef99afe3897cae0cf0&scope.project.id=def6cb215c3c45f2a54435c338e667ab&role.id=e1504eb5f35c468086d3b269e2c72011 => generated 611 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:58.860489 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe543324-f25f-47bd-ac84-940e47df0915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:58.861465 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543324-f25f-47bd-ac84-940e47df0915 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:58.861589 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543324-f25f-47bd-ac84-940e47df0915 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:58.861846 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543324-f25f-47bd-ac84-940e47df0915 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:58.878578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe543324-f25f-47bd-ac84-940e47df0915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:58.885345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-fe543324-f25f-47bd-ac84-940e47df0915 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:58.885345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:58.885345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:58.885345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:58.885345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:58.885345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:58.885345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:58.885345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:58.885345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:58.885345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:58.885345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:58.885345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:58.885345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:58.885345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:58.885345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:58.885345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:58.886309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:58.886309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:58.886309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:58.886309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:58.886309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:58.886309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:58.886309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:58.886309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:58.886309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:58.886309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:58.886309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:58.886309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:58.886309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:58.886309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:58.886309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:58.886309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:58.887402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:58.887402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:58.887402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:58.887402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:58.887402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:58.887402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:58.887402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:58.887402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:58.887402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:58.887402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:58.887402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 01:22:58.887402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:58.887402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 214/434] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:22:58.895808 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d932e-20b1-4b38-8b2f-063ea210df40 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:58.980038 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:59.031378 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d932e-20b1-4b38-8b2f-063ea210df40 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:59.085148 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f791dd7-d0ce-4f89-b3f6-2970c6f6a492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:59.086134 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f791dd7-d0ce-4f89-b3f6-2970c6f6a492 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:59.086624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f791dd7-d0ce-4f89-b3f6-2970c6f6a492 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:59.087377 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f791dd7-d0ce-4f89-b3f6-2970c6f6a492 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:59.088475 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f791dd7-d0ce-4f89-b3f6-2970c6f6a492 None admin] RBAC: Adding query filter params (name=member) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:59.089294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f791dd7-d0ce-4f89-b3f6-2970c6f6a492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:59.092149 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f791dd7-d0ce-4f89-b3f6-2970c6f6a492 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:59.104937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 221/435] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:22:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:59.111075 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe543324-f25f-47bd-ac84-940e47df0915 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:59.173837 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b3160-3b31-41ef-8337-5e37c944e001 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:59.174383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b3160-3b31-41ef-8337-5e37c944e001 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:59.174956 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b3160-3b31-41ef-8337-5e37c944e001 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:59.177338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 222/436] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:22:59.183046 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc5f1b-2ee1-45e1-93c7-d43e25dd1420 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:59.183556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc5f1b-2ee1-45e1-93c7-d43e25dd1420 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:59.183999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc5f1b-2ee1-45e1-93c7-d43e25dd1420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:59.210456 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:59.211419 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-7fdc5f1b-2ee1-45e1-93c7-d43e25dd1420 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:59.213030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-7fdc5f1b-2ee1-45e1-93c7-d43e25dd1420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:59.248063 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe543324-f25f-47bd-ac84-940e47df0915 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:59.294335 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade573e-187a-4dfa-88b6-8e1a836b9a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:59.295373 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade573e-187a-4dfa-88b6-8e1a836b9a65 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:59.295857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade573e-187a-4dfa-88b6-8e1a836b9a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:59.296442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade573e-187a-4dfa-88b6-8e1a836b9a65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:59.298794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 223/437] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:22:59.374987 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade573e-187a-4dfa-88b6-8e1a836b9a65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:59.376476 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade573e-187a-4dfa-88b6-8e1a836b9a65 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:59.396767 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f8b1-8dec-4949-a6af-408cab26631d None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:59.397077 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f8b1-8dec-4949-a6af-408cab26631d None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:59.397321 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f8b1-8dec-4949-a6af-408cab26631d None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:59.398936 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 224/438] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:22:59.404055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0aab3-55c3-43ca-8d01-a860fee31f04 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:59.404338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0aab3-55c3-43ca-8d01-a860fee31f04 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:59.404611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0aab3-55c3-43ca-8d01-a860fee31f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:59.431115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-16b0aab3-55c3-43ca-8d01-a860fee31f04 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:22:59.432249 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-16b0aab3-55c3-43ca-8d01-a860fee31f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:22:59.464959 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:59.499471 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 215/439] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:22:59.500473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade573e-187a-4dfa-88b6-8e1a836b9a65 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:59.504255 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:59.514736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 225/440] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:22:59.576681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0aab3-55c3-43ca-8d01-a860fee31f04 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:59.604454 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade573e-187a-4dfa-88b6-8e1a836b9a65 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:59.640237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c917b4-ceb9-4a49-8c15-1fb1955824b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:59.640918 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c917b4-ceb9-4a49-8c15-1fb1955824b5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:59.641194 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c917b4-ceb9-4a49-8c15-1fb1955824b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:59.641487 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c917b4-ceb9-4a49-8c15-1fb1955824b5 None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:59.642649 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c917b4-ceb9-4a49-8c15-1fb1955824b5 None admin] RBAC: Authorizing `identity:get_project(project_id=9739ea1321b14d2187985347ea1247dc)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:59.644126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c917b4-ceb9-4a49-8c15-1fb1955824b5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:59.647324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 216/441] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:22:59 2022] GET /identity/v3/projects/9739ea1321b14d2187985347ea1247dc => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:22:59.651748 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c917b4-ceb9-4a49-8c15-1fb1955824b5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:59.681673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0aab3-55c3-43ca-8d01-a860fee31f04 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:59.697063 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:59.721990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adedb5-66e0-495e-bbf0-54b7baf0b927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:59.722619 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adedb5-66e0-495e-bbf0-54b7baf0b927 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:59.722928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adedb5-66e0-495e-bbf0-54b7baf0b927 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:59.723205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adedb5-66e0-495e-bbf0-54b7baf0b927 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:59.736447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adedb5-66e0-495e-bbf0-54b7baf0b927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:59.742125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-02adedb5-66e0-495e-bbf0-54b7baf0b927 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:59.742125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:59.742125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:59.742125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:59.742125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:59.742125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:59.742125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:59.742125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:59.742125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:59.742125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:59.742125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:59.742125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:59.742125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:59.742125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:59.742125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:59.742125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:59.743048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:59.743048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:59.743048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:59.743048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:59.743048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:59.743048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:59.743048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:59.743048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:59.743048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:59.743048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:59.743048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:59.743048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:59.743048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:59.743048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:59.743048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:59.743048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:59.743853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:59.743853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:59.743853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:59.743853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:59.743853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:59.743853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:59.743853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:59.743853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:59.743853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:59.743853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:59.743853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:22:59.743853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:22:59.744446 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 226/442] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:22:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:22:59.749250 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adedb5-66e0-495e-bbf0-54b7baf0b927 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:59.757268 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c917b4-ceb9-4a49-8c15-1fb1955824b5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:59.793215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3c0f2-d6a0-4864-8b87-36b2a4e1af0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:59.793846 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3c0f2-d6a0-4864-8b87-36b2a4e1af0c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:59.794125 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3c0f2-d6a0-4864-8b87-36b2a4e1af0c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:59.794400 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3c0f2-d6a0-4864-8b87-36b2a4e1af0c None admin] PATH_INFO: `/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:59.795554 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3c0f2-d6a0-4864-8b87-36b2a4e1af0c None admin] RBAC: Authorizing `identity:get_group(group_id=e6a6a927d2e946ef99afe3897cae0cf0)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:59.796976 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3c0f2-d6a0-4864-8b87-36b2a4e1af0c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:59.799197 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 217/443] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 26 01:22:59 2022] GET /identity/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:59.799955 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3c0f2-d6a0-4864-8b87-36b2a4e1af0c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:59.806814 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:59.854195 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adedb5-66e0-495e-bbf0-54b7baf0b927 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:59.889329 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967febea-5c88-4f9b-ad90-f97f937e5b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:59.889932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967febea-5c88-4f9b-ad90-f97f937e5b74 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:59.890190 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967febea-5c88-4f9b-ad90-f97f937e5b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:59.890460 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967febea-5c88-4f9b-ad90-f97f937e5b74 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:59.891152 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967febea-5c88-4f9b-ad90-f97f937e5b74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:22:59.891462 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967febea-5c88-4f9b-ad90-f97f937e5b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:22:59.893035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967febea-5c88-4f9b-ad90-f97f937e5b74 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:22:59.898877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3c0f2-d6a0-4864-8b87-36b2a4e1af0c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:22:59.900874 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 227/444] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:22:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:22:59.901650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967febea-5c88-4f9b-ad90-f97f937e5b74 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:22:59.911492 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:22:59.935470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f5ca4-f9de-41fa-924e-a549a41bf50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:22:59.936028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f5ca4-f9de-41fa-924e-a549a41bf50e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:22:59.936301 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f5ca4-f9de-41fa-924e-a549a41bf50e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:22:59.936567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f5ca4-f9de-41fa-924e-a549a41bf50e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:22:59.946662 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f5ca4-f9de-41fa-924e-a549a41bf50e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:22:59.951354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-885f5ca4-f9de-41fa-924e-a549a41bf50e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:59.951354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:22:59.951354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:22:59.951354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:22:59.951354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:22:59.951354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:22:59.951354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:22:59.951354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:22:59.951354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:22:59.951354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:22:59.951354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:22:59.951354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:22:59.951354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:22:59.951354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:22:59.951354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:22:59.951354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:22:59.952473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:22:59.952473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:22:59.952473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:22:59.952473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:22:59.952473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:22:59.952473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:22:59.952473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:22:59.952473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:22:59.952473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:22:59.952473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:22:59.952473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:22:59.952473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:22:59.952473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:22:59.952473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:22:59.952473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:22:59.952473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:22:59.953474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:22:59.953474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:22:59.953474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:22:59.953474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:22:59.953474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:22:59.953474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:22:59.953474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:22:59.953474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:22:59.953474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:22:59.953474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:22:59.953474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:22:59.953474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:22:59.957696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 218/445] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:22:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:22:59.958552 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f5ca4-f9de-41fa-924e-a549a41bf50e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:00.000676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967febea-5c88-4f9b-ad90-f97f937e5b74 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:00.014144 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:00.036442 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f322a-baee-4163-8ecd-182a6df1478b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:00.037130 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f322a-baee-4163-8ecd-182a6df1478b None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:00.037428 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f322a-baee-4163-8ecd-182a6df1478b None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:00.037710 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f322a-baee-4163-8ecd-182a6df1478b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:00.038435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f322a-baee-4163-8ecd-182a6df1478b None admin] RBAC: Adding query filter params (group.id=e6a6a927d2e946ef99afe3897cae0cf0, role.id=f4df3a7a4c0b4730abc0601e2b072ef4, scope.project.id=9739ea1321b14d2187985347ea1247dc) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:00.038748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f322a-baee-4163-8ecd-182a6df1478b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:00.040197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f322a-baee-4163-8ecd-182a6df1478b None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:00.045813 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 228/446] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 26 01:22:59 2022] GET /identity/v3/role_assignments?group.id=e6a6a927d2e946ef99afe3897cae0cf0&scope.project.id=9739ea1321b14d2187985347ea1247dc&role.id=f4df3a7a4c0b4730abc0601e2b072ef4 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:00.046586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f322a-baee-4163-8ecd-182a6df1478b None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:00.071781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f5ca4-f9de-41fa-924e-a549a41bf50e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:00.112067 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777926f4-4602-42a3-a4b0-5dfaad11f725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:00.112764 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777926f4-4602-42a3-a4b0-5dfaad11f725 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:00.113098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777926f4-4602-42a3-a4b0-5dfaad11f725 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:00.113246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777926f4-4602-42a3-a4b0-5dfaad11f725 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:00.157092 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:00.163187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f322a-baee-4163-8ecd-182a6df1478b None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:00.191139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777926f4-4602-42a3-a4b0-5dfaad11f725 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:00.192545 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777926f4-4602-42a3-a4b0-5dfaad11f725 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:00.203597 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae494b5-c4a1-4605-af92-d8b3fe703791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:00.204989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae494b5-c4a1-4605-af92-d8b3fe703791 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:00.205287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae494b5-c4a1-4605-af92-d8b3fe703791 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:00.205609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae494b5-c4a1-4605-af92-d8b3fe703791 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:00.206286 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae494b5-c4a1-4605-af92-d8b3fe703791 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:00.206586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae494b5-c4a1-4605-af92-d8b3fe703791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:00.207993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae494b5-c4a1-4605-af92-d8b3fe703791 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:00.217029 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 229/447] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:00.222848 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae494b5-c4a1-4605-af92-d8b3fe703791 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:00.273014 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:00.314149 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 219/448] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:22:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:23:00.320487 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777926f4-4602-42a3-a4b0-5dfaad11f725 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:00.338188 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae494b5-c4a1-4605-af92-d8b3fe703791 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:00.378110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b233d63-45bd-4665-b1de-b9112a7ce526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:00.379139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b233d63-45bd-4665-b1de-b9112a7ce526 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:00.379607 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b233d63-45bd-4665-b1de-b9112a7ce526 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:00.379885 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b233d63-45bd-4665-b1de-b9112a7ce526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:00.409434 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:00.447473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777926f4-4602-42a3-a4b0-5dfaad11f725 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:00.467514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b233d63-45bd-4665-b1de-b9112a7ce526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:00.468972 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b233d63-45bd-4665-b1de-b9112a7ce526 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:00.482605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf8c92-8e66-4ebb-8737-d3bc1efb48c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:00.483256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf8c92-8e66-4ebb-8737-d3bc1efb48c7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:00.483533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf8c92-8e66-4ebb-8737-d3bc1efb48c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:00.483804 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf8c92-8e66-4ebb-8737-d3bc1efb48c7 None admin] PATH_INFO: `/v3/projects/4ba2dacdbbb943beb977f1070136e466` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:00.484914 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf8c92-8e66-4ebb-8737-d3bc1efb48c7 None admin] RBAC: Authorizing `identity:get_project(project_id=4ba2dacdbbb943beb977f1070136e466)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:00.486996 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf8c92-8e66-4ebb-8737-d3bc1efb48c7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:00.488664 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 220/449] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:23:00 2022] GET /identity/v3/projects/4ba2dacdbbb943beb977f1070136e466 => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:23:00.493815 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf8c92-8e66-4ebb-8737-d3bc1efb48c7 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:00.510852 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:00.569041 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 230/450] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:23:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 01:23:00.575060 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b233d63-45bd-4665-b1de-b9112a7ce526 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:00.590972 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf8c92-8e66-4ebb-8737-d3bc1efb48c7 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:00.623709 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937567e-f63d-4e4e-b4e2-edae57e71826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:00.624318 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937567e-f63d-4e4e-b4e2-edae57e71826 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:00.624590 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937567e-f63d-4e4e-b4e2-edae57e71826 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:00.624859 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937567e-f63d-4e4e-b4e2-edae57e71826 None admin] PATH_INFO: `/v3/groups/0a721535aa944d589b3eb21da7e8f109` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:00.625951 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937567e-f63d-4e4e-b4e2-edae57e71826 None admin] RBAC: Authorizing `identity:get_group(group_id=0a721535aa944d589b3eb21da7e8f109)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:00.627640 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937567e-f63d-4e4e-b4e2-edae57e71826 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:00.629373 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 221/451] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 26 01:23:00 2022] GET /identity/v3/groups/0a721535aa944d589b3eb21da7e8f109 => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:23:00.634819 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937567e-f63d-4e4e-b4e2-edae57e71826 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:00.643188 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:00.676807 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b233d63-45bd-4665-b1de-b9112a7ce526 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:00.710881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b11a81-f51a-4b62-b07b-4edca48912bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:00.711435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b11a81-f51a-4b62-b07b-4edca48912bd None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:00.711705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b11a81-f51a-4b62-b07b-4edca48912bd None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:00.711976 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b11a81-f51a-4b62-b07b-4edca48912bd None admin] PATH_INFO: `/v3/projects/9739ea1321b14d2187985347ea1247dc` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:00.713073 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b11a81-f51a-4b62-b07b-4edca48912bd None admin] RBAC: Authorizing `identity:get_project(project_id=9739ea1321b14d2187985347ea1247dc)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:00.714496 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b11a81-f51a-4b62-b07b-4edca48912bd None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:00.716132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 231/452] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:23:00 2022] GET /identity/v3/projects/9739ea1321b14d2187985347ea1247dc => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:00.722261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b11a81-f51a-4b62-b07b-4edca48912bd None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:00.732255 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:00.733539 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937567e-f63d-4e4e-b4e2-edae57e71826 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:00.767924 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0e961-1abe-4115-aa21-f4eac433dcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:00.768547 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0e961-1abe-4115-aa21-f4eac433dcaa None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:00.768825 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0e961-1abe-4115-aa21-f4eac433dcaa None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:00.769095 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0e961-1abe-4115-aa21-f4eac433dcaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:00.769810 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0e961-1abe-4115-aa21-f4eac433dcaa None admin] RBAC: Adding query filter params (group.id=0a721535aa944d589b3eb21da7e8f109, role.id=50adf18edc1a47b2bae0876828a88dbf, scope.project.id=4ba2dacdbbb943beb977f1070136e466) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:00.770112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0e961-1abe-4115-aa21-f4eac433dcaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:00.771565 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0e961-1abe-4115-aa21-f4eac433dcaa None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:00.777182 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 222/453] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 26 01:23:00 2022] GET /identity/v3/role_assignments?group.id=0a721535aa944d589b3eb21da7e8f109&scope.project.id=4ba2dacdbbb943beb977f1070136e466&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:23:00.828099 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b11a81-f51a-4b62-b07b-4edca48912bd None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:00.865082 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5c559-9643-44a2-9075-b69238e4d4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:00.865723 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5c559-9643-44a2-9075-b69238e4d4cf None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:00.866002 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5c559-9643-44a2-9075-b69238e4d4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:00.866272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5c559-9643-44a2-9075-b69238e4d4cf None admin] PATH_INFO: `/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:00.867458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5c559-9643-44a2-9075-b69238e4d4cf None admin] RBAC: Authorizing `identity:get_group(group_id=e6a6a927d2e946ef99afe3897cae0cf0)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:00.868909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5c559-9643-44a2-9075-b69238e4d4cf None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:00.870702 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 232/454] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 26 01:23:00 2022] GET /identity/v3/groups/e6a6a927d2e946ef99afe3897cae0cf0 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:23:00.877254 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0e961-1abe-4115-aa21-f4eac433dcaa None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:00.949851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:00.982359 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0e961-1abe-4115-aa21-f4eac433dcaa None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:01.016666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015cae6-d1dd-42ea-b855-760b89638b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:01.017573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015cae6-d1dd-42ea-b855-760b89638b89 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:01.017860 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015cae6-d1dd-42ea-b855-760b89638b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:01.018137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015cae6-d1dd-42ea-b855-760b89638b89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:01.018893 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015cae6-d1dd-42ea-b855-760b89638b89 None admin] RBAC: Adding query filter params (group.id=e6a6a927d2e946ef99afe3897cae0cf0, role.id=e1504eb5f35c468086d3b269e2c72011, scope.project.id=9739ea1321b14d2187985347ea1247dc) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:01.019206 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015cae6-d1dd-42ea-b855-760b89638b89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:01.020627 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015cae6-d1dd-42ea-b855-760b89638b89 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:01.026174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 223/455] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 26 01:23:00 2022] GET /identity/v3/role_assignments?group.id=e6a6a927d2e946ef99afe3897cae0cf0&scope.project.id=9739ea1321b14d2187985347ea1247dc&role.id=e1504eb5f35c468086d3b269e2c72011 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:03.705633 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eebb31-cb5e-44ff-886a-7cd24b1d401c None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:03.706112 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eebb31-cb5e-44ff-886a-7cd24b1d401c None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:03.706112 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eebb31-cb5e-44ff-886a-7cd24b1d401c None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:03.707733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 233/456] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:03.712654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537b3a4-b245-4691-83fd-bdc5e78a4f8d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:03.713445 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537b3a4-b245-4691-83fd-bdc5e78a4f8d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:03.713922 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537b3a4-b245-4691-83fd-bdc5e78a4f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:03.735042 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-c537b3a4-b245-4691-83fd-bdc5e78a4f8d None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:03.737239 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c537b3a4-b245-4691-83fd-bdc5e78a4f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:03.830647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 224/457] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:04.018701 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516c49b-50a7-45c0-8fc6-62b004e024bd None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:04.019281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516c49b-50a7-45c0-8fc6-62b004e024bd None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:04.019692 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516c49b-50a7-45c0-8fc6-62b004e024bd None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:04.021438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 234/458] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:04.026618 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e34cc-5cc7-4bb4-8777-8aebc26d826b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:04.027052 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e34cc-5cc7-4bb4-8777-8aebc26d826b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:04.027404 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e34cc-5cc7-4bb4-8777-8aebc26d826b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:04.034233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf12df-e10a-4809-8c07-3c08477e977f None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:04.034701 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf12df-e10a-4809-8c07-3c08477e977f None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:04.035160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf12df-e10a-4809-8c07-3c08477e977f None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:04.036933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 235/459] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:04.041658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6863c-b965-4f22-b53d-1c8cf65d204b None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:04.042163 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6863c-b965-4f22-b53d-1c8cf65d204b None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:04.042626 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6863c-b965-4f22-b53d-1c8cf65d204b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:04.063482 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-47e6863c-b965-4f22-b53d-1c8cf65d204b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:04.065262 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-47e6863c-b965-4f22-b53d-1c8cf65d204b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:04.067040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-c51e34cc-5cc7-4bb4-8777-8aebc26d826b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:04.068221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c51e34cc-5cc7-4bb4-8777-8aebc26d826b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:04.149477 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 236/460] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:23:04.185059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:04.196679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 225/461] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:04.209653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6863c-b965-4f22-b53d-1c8cf65d204b None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:04.222996 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:04.333614 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6863c-b965-4f22-b53d-1c8cf65d204b None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:04.372995 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c5090-1380-4ad5-9bbc-9ea7732e538e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:04.374021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c5090-1380-4ad5-9bbc-9ea7732e538e None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:04.374492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c5090-1380-4ad5-9bbc-9ea7732e538e None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:04.375016 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c5090-1380-4ad5-9bbc-9ea7732e538e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:04.386778 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c5090-1380-4ad5-9bbc-9ea7732e538e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:04.388484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c5090-1380-4ad5-9bbc-9ea7732e538e None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:04.414261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-979c5090-1380-4ad5-9bbc-9ea7732e538e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:04.414261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:04.414261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:04.414261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:04.414261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:04.414261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:04.414261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:04.414261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:04.414261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:04.414261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:04.414261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:04.414261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:04.414261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:04.414261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:04.414261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:04.414261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:04.415213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:04.415213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:04.415213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:04.415213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:04.415213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:04.415213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:04.415213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:04.415213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:04.415213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:04.415213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:04.415213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:04.415213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:04.415213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:04.415213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:04.415213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:04.415213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:04.415213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:04.416280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:04.416280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:04.416280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:04.417979 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 237/462] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:04.424055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e34cc-5cc7-4bb4-8777-8aebc26d826b None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:04.465436 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2cf1-e618-4d4f-b53b-09d3795c8b43 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:04.466196 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2cf1-e618-4d4f-b53b-09d3795c8b43 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:04.466669 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2cf1-e618-4d4f-b53b-09d3795c8b43 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:04.468272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 238/463] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:23:04.477106 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4759251-02f8-428a-8db4-11a49144c511 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:04.477653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4759251-02f8-428a-8db4-11a49144c511 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:04.478117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4759251-02f8-428a-8db4-11a49144c511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:04.502342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-f4759251-02f8-428a-8db4-11a49144c511 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:04.504363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f4759251-02f8-428a-8db4-11a49144c511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:04.554566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e34cc-5cc7-4bb4-8777-8aebc26d826b None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:04.571584 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:04.588106 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 239/464] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:23:04.588862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4759251-02f8-428a-8db4-11a49144c511 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:04.596862 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d888fab-55c2-4cbb-940c-3b4c6eed3b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:04.598252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d888fab-55c2-4cbb-940c-3b4c6eed3b5c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:04.598749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d888fab-55c2-4cbb-940c-3b4c6eed3b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:04.599681 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d888fab-55c2-4cbb-940c-3b4c6eed3b5c None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:04.600555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d888fab-55c2-4cbb-940c-3b4c6eed3b5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:04.601440 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d888fab-55c2-4cbb-940c-3b4c6eed3b5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:04.603528 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d888fab-55c2-4cbb-940c-3b4c6eed3b5c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:04.628166 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 226/465] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:04.629277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d888fab-55c2-4cbb-940c-3b4c6eed3b5c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:04.697874 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4759251-02f8-428a-8db4-11a49144c511 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:04.702201 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:04.740096 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8c101-8b46-4689-8407-7395bf49a5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:04.740928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8c101-8b46-4689-8407-7395bf49a5ed None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:04.741406 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8c101-8b46-4689-8407-7395bf49a5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:04.741901 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8c101-8b46-4689-8407-7395bf49a5ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:04.756126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8c101-8b46-4689-8407-7395bf49a5ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:04.757987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8c101-8b46-4689-8407-7395bf49a5ed None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:04.761020 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d888fab-55c2-4cbb-940c-3b4c6eed3b5c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:04.776782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-0bd8c101-8b46-4689-8407-7395bf49a5ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:04.776782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:04.776782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:04.776782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:04.776782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:04.776782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:04.776782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:04.776782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:04.776782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:04.776782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:04.776782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:04.776782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:04.776782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:04.776782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:04.776782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:04.776782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:04.777935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:04.777935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:04.777935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:04.777935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:04.777935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:04.777935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:04.777935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:04.777935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:04.777935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:04.777935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:04.777935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:04.777935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:04.777935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:04.777935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:04.777935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:04.777935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:04.777935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:04.779056 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:04.779056 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:04.779056 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:04.782866 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 240/466] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:04.783977 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8c101-8b46-4689-8407-7395bf49a5ed None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:04.802125 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00cdee-9c27-472a-bb4c-aa619c68c5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:04.803209 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00cdee-9c27-472a-bb4c-aa619c68c5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:04.803704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00cdee-9c27-472a-bb4c-aa619c68c5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:04.804167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00cdee-9c27-472a-bb4c-aa619c68c5f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:04.816080 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00cdee-9c27-472a-bb4c-aa619c68c5f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:04.817961 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00cdee-9c27-472a-bb4c-aa619c68c5f9 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:04.833352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:04.837124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-fb00cdee-9c27-472a-bb4c-aa619c68c5f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:04.837124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:04.837124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:04.837124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:04.837124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:04.837124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:04.837124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:04.837124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:04.837124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:04.837124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:04.837124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:04.837124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:04.837124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:04.837124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:04.837124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:04.837124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:04.843543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:04.843543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:04.843543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:04.843543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:04.843543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:04.843543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:04.843543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:04.843543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:04.843543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:04.843543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:04.843543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:04.843543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:04.843543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:04.843543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:04.843543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:04.843543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:04.843543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:04.844941 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:04.844941 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:04.844941 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:04.844941 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 227/467] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:04.846350 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00cdee-9c27-472a-bb4c-aa619c68c5f9 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:04.902789 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8c101-8b46-4689-8407-7395bf49a5ed None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:04.940147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98f3a7-7c17-48ca-ba52-164cd97696a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:04.940740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98f3a7-7c17-48ca-ba52-164cd97696a1 None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:04.941021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98f3a7-7c17-48ca-ba52-164cd97696a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:04.941295 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98f3a7-7c17-48ca-ba52-164cd97696a1 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:04.941926 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98f3a7-7c17-48ca-ba52-164cd97696a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:04.943364 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98f3a7-7c17-48ca-ba52-164cd97696a1 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:04.961281 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00cdee-9c27-472a-bb4c-aa619c68c5f9 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:04.968945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 241/468] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 26 01:23:04 2022] POST /identity/v3/users => generated 246 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:23:04.970476 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98f3a7-7c17-48ca-ba52-164cd97696a1 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:04.970620 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:05.021221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63fe70-aab6-43d5-85da-65e43b797c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:05.022145 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63fe70-aab6-43d5-85da-65e43b797c44 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:05.022602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63fe70-aab6-43d5-85da-65e43b797c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:05.023429 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63fe70-aab6-43d5-85da-65e43b797c44 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:05.024234 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63fe70-aab6-43d5-85da-65e43b797c44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:05.025019 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63fe70-aab6-43d5-85da-65e43b797c44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:05.026989 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63fe70-aab6-43d5-85da-65e43b797c44 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:05.054430 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 228/469] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:05.056915 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63fe70-aab6-43d5-85da-65e43b797c44 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:05.086994 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:05.094347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98f3a7-7c17-48ca-ba52-164cd97696a1 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:05.137231 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656539a-5a8e-4b26-84b8-3faff571b1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:05.138023 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656539a-5a8e-4b26-84b8-3faff571b1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:05.138398 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656539a-5a8e-4b26-84b8-3faff571b1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:05.138768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656539a-5a8e-4b26-84b8-3faff571b1f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:05.139671 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656539a-5a8e-4b26-84b8-3faff571b1f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:05.140077 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656539a-5a8e-4b26-84b8-3faff571b1f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:05.142603 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656539a-5a8e-4b26-84b8-3faff571b1f6 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:05.156664 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 242/470] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:05.158675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656539a-5a8e-4b26-84b8-3faff571b1f6 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:05.214682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63fe70-aab6-43d5-85da-65e43b797c44 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:05.268130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2cc47-baa6-4da6-bcb4-3af837b39e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:05.268765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2cc47-baa6-4da6-bcb4-3af837b39e34 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:05.269045 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2cc47-baa6-4da6-bcb4-3af837b39e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:05.269317 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2cc47-baa6-4da6-bcb4-3af837b39e34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:05.283553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2cc47-baa6-4da6-bcb4-3af837b39e34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:05.285155 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2cc47-baa6-4da6-bcb4-3af837b39e34 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:05.289200 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656539a-5a8e-4b26-84b8-3faff571b1f6 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:05.302088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-99c2cc47-baa6-4da6-bcb4-3af837b39e34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:05.302088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:05.302088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:05.302088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:05.302088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:05.302088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:05.302088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:05.302088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:05.302088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:05.302088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:05.302088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:05.302088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:05.302088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:05.302088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:05.302088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:05.302088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:05.303071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:05.303071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:05.303071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:05.303071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:05.303071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:05.303071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:05.303071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:05.303071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:05.303071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:05.303071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:05.303071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:05.303071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:05.303071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:05.303071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:05.303071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:05.303071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:05.303071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:05.303918 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:05.303918 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:05.303918 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:05.303918 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 229/471] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:05.304788 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2cc47-baa6-4da6-bcb4-3af837b39e34 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:05.325789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:05.349261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd692f-762c-4ffe-a1c8-6f6350ad6e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:05.350696 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd692f-762c-4ffe-a1c8-6f6350ad6e46 None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:05.351199 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd692f-762c-4ffe-a1c8-6f6350ad6e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:05.351666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd692f-762c-4ffe-a1c8-6f6350ad6e46 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:05.353015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd692f-762c-4ffe-a1c8-6f6350ad6e46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:05.355476 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd692f-762c-4ffe-a1c8-6f6350ad6e46 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:05.386745 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 243/472] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 26 01:23:05 2022] POST /identity/v3/users => generated 248 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:23:05.387916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd692f-762c-4ffe-a1c8-6f6350ad6e46 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:05.407135 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:05.457254 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2cc47-baa6-4da6-bcb4-3af837b39e34 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:05.525579 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd692f-762c-4ffe-a1c8-6f6350ad6e46 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:05.531557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0b25b-7042-4dbf-b824-b67bd2018d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:05.532182 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0b25b-7042-4dbf-b824-b67bd2018d74 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:05.533177 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0b25b-7042-4dbf-b824-b67bd2018d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:05.533573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0b25b-7042-4dbf-b824-b67bd2018d74 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:05.534356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0b25b-7042-4dbf-b824-b67bd2018d74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:05.535834 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0b25b-7042-4dbf-b824-b67bd2018d74 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:05.607050 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 230/473] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 26 01:23:05 2022] POST /identity/v3/users => generated 248 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:23:05.623962 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0da333-14a4-477b-9e21-b52a6f5b0d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:05.625050 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0da333-14a4-477b-9e21-b52a6f5b0d47 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:05.625572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0da333-14a4-477b-9e21-b52a6f5b0d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:05.626590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0da333-14a4-477b-9e21-b52a6f5b0d47 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:05.627654 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0da333-14a4-477b-9e21-b52a6f5b0d47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:05.628222 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0da333-14a4-477b-9e21-b52a6f5b0d47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:05.629892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0da333-14a4-477b-9e21-b52a6f5b0d47 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:05.663797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 244/474] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:05.670075 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0b25b-7042-4dbf-b824-b67bd2018d74 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:05.710070 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a78f5e-46a6-47f4-a818-66fb5c7dccdb None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:05.710388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a78f5e-46a6-47f4-a818-66fb5c7dccdb None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:05.710623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a78f5e-46a6-47f4-a818-66fb5c7dccdb None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:05.712388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 245/475] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:05.718121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9a89f-aace-484e-941c-35428a653789 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:05.718406 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9a89f-aace-484e-941c-35428a653789 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:05.718667 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9a89f-aace-484e-941c-35428a653789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:05.739461 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-d9c9a89f-aace-484e-941c-35428a653789 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:05.742938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d9c9a89f-aace-484e-941c-35428a653789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:05.790963 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:05.832295 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0b25b-7042-4dbf-b824-b67bd2018d74 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:05.833884 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 246/476] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:05.874138 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fd3ed-43b2-4c6a-b67b-0ae4d15d0af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:05.874675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fd3ed-43b2-4c6a-b67b-0ae4d15d0af6 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:05.875010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fd3ed-43b2-4c6a-b67b-0ae4d15d0af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:05.875284 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fd3ed-43b2-4c6a-b67b-0ae4d15d0af6 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:05.875977 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fd3ed-43b2-4c6a-b67b-0ae4d15d0af6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:05.877662 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fd3ed-43b2-4c6a-b67b-0ae4d15d0af6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:05.909086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 231/477] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 26 01:23:05 2022] POST /identity/v3/users => generated 249 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:23:06.128114 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9a89f-aace-484e-941c-35428a653789 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:06.130194 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:06.239971 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9a89f-aace-484e-941c-35428a653789 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:06.279454 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cffa0-561c-4672-8dab-4ed7f16c0416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:06.280069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cffa0-561c-4672-8dab-4ed7f16c0416 None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:06.280349 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cffa0-561c-4672-8dab-4ed7f16c0416 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:06.280618 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cffa0-561c-4672-8dab-4ed7f16c0416 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:06.281287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cffa0-561c-4672-8dab-4ed7f16c0416 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:06.283337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cffa0-561c-4672-8dab-4ed7f16c0416 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:06.293712 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.sql.core [None req-781cffa0-561c-4672-8dab-4ed7f16c0416 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 26 01:23:06.293712 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 26 01:23:06.293712 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [parameters: {'id': 'b601fd466ebc41aab6f0bda929e50af3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 26 01:23:06.293712 dv-cinder-859203-2-smb devstack@keystone.service[81422]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81422) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 26 01:23:06.311283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-781cffa0-561c-4672-8dab-4ed7f16c0416 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 26 01:23:06.311283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:06.311283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 01:23:06.311283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 01:23:06.311283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 01:23:06.311283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 01:23:06.311283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 01:23:06.311283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 01:23:06.311283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 01:23:06.311283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application conn.query(q) Sep 26 01:23:06.311283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 01:23:06.311283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 01:23:06.311283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 01:23:06.311283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application result.read() Sep 26 01:23:06.311283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 01:23:06.312210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 01:23:06.312210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 01:23:06.312210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 01:23:06.312210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 01:23:06.312210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 01:23:06.312210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 01:23:06.312210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 01:23:06.312210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 26 01:23:06.312210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:06.312210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 26 01:23:06.312210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:06.312210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:06.312210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 26 01:23:06.312210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 26 01:23:06.312210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 26 01:23:06.312210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return ref.to_dict() Sep 26 01:23:06.312210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 01:23:06.312210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application next(self.gen) Sep 26 01:23:06.313139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 26 01:23:06.313139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application yield resource Sep 26 01:23:06.313139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 01:23:06.313139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application next(self.gen) Sep 26 01:23:06.313139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 26 01:23:06.313139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self.session.rollback() Sep 26 01:23:06.313139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 26 01:23:06.313139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self.force_reraise() Sep 26 01:23:06.313139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 26 01:23:06.313139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise self.value Sep 26 01:23:06.313139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 26 01:23:06.313139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 26 01:23:06.313139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 26 01:23:06.313139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application session.commit() Sep 26 01:23:06.313139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 26 01:23:06.313139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 26 01:23:06.313139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 26 01:23:06.314531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._prepare_impl() Sep 26 01:23:06.314531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 26 01:23:06.314531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self.session.flush() Sep 26 01:23:06.314531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 26 01:23:06.314531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._flush(objects) Sep 26 01:23:06.314531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 26 01:23:06.314531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 26 01:23:06.314531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 26 01:23:06.314531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application compat.raise_( Sep 26 01:23:06.314531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 01:23:06.314531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception Sep 26 01:23:06.314531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 26 01:23:06.314531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application flush_context.execute() Sep 26 01:23:06.314531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 26 01:23:06.314531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rec.execute(self) Sep 26 01:23:06.314531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 26 01:23:06.314531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 26 01:23:06.316416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 26 01:23:06.316416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 26 01:23:06.316416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 26 01:23:06.316416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 26 01:23:06.316416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 26 01:23:06.316416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 26 01:23:06.316416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 26 01:23:06.316416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 26 01:23:06.316416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 26 01:23:06.316416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 26 01:23:06.316416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 26 01:23:06.316416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 26 01:23:06.316416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 26 01:23:06.316416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 26 01:23:06.316416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 01:23:06.316416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception Sep 26 01:23:06.317681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 01:23:06.317681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 01:23:06.317681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 01:23:06.317681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 01:23:06.317681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 01:23:06.317681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 01:23:06.317681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 01:23:06.317681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application conn.query(q) Sep 26 01:23:06.317681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 01:23:06.317681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 01:23:06.317681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 01:23:06.317681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application result.read() Sep 26 01:23:06.317681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 01:23:06.317681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 01:23:06.317681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 01:23:06.317681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 01:23:06.323315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 01:23:06.323315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 01:23:06.323315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 01:23:06.323315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 01:23:06.323315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 26 01:23:06.323315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 26 01:23:06.323315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [parameters: {'id': 'b601fd466ebc41aab6f0bda929e50af3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 26 01:23:06.323315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 26 01:23:06.323315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:06.323315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:23:06.323315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:06.323315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:06.323315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:06.323315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:06.323315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:06.323315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:06.324111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:06.324111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:06.324111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:06.324111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:06.324111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:06.324111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:06.324111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 26 01:23:06.324111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 26 01:23:06.324111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:06.324111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:06.324111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 26 01:23:06.324111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 26 01:23:06.324111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 26 01:23:06.324111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 26 01:23:06.324111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 26 01:23:06.324111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:06.324915 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 247/478] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Sep 26 01:23:06 2022] POST /identity/v3/roles => generated 144 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:06.324978 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fd3ed-43b2-4c6a-b67b-0ae4d15d0af6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:06.498066 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fd3ed-43b2-4c6a-b67b-0ae4d15d0af6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:06.529269 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:06.536914 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f71f9-a288-4822-b6a3-6030a206c9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:06.537707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f71f9-a288-4822-b6a3-6030a206c9cb None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:06.538131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f71f9-a288-4822-b6a3-6030a206c9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:06.538504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f71f9-a288-4822-b6a3-6030a206c9cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:06.551118 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f71f9-a288-4822-b6a3-6030a206c9cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:06.556707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-6a6f71f9-a288-4822-b6a3-6030a206c9cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:23:06.556707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:06.556707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:06.556707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:06.556707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:06.556707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:06.556707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:06.556707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:06.556707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:06.556707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:06.556707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:06.556707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:06.556707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:06.556707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:06.556707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:06.556707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:06.557770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:06.557770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:06.557770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:06.557770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:06.557770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:06.557770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:06.557770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:06.557770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:06.557770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:06.557770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:06.557770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:06.557770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:06.557770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:06.557770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:06.557770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:06.557770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:06.558770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:06.558770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:06.558770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:06.558770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:06.558770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:06.558770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:06.558770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:06.558770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:06.558770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:06.558770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:06.558770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 01:23:06.558770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:06.560739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 232/479] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:23:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:06.568529 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cffa0-561c-4672-8dab-4ed7f16c0416 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:06.674630 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:06.718467 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cffa0-561c-4672-8dab-4ed7f16c0416 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:06.773707 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aeb50c-6eb5-4225-aca7-96458990cd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:06.774352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeb50c-6eb5-4225-aca7-96458990cd58 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:06.774602 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeb50c-6eb5-4225-aca7-96458990cd58 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:06.774893 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeb50c-6eb5-4225-aca7-96458990cd58 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:06.775582 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aeb50c-6eb5-4225-aca7-96458990cd58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:06.775884 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aeb50c-6eb5-4225-aca7-96458990cd58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:06.777284 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aeb50c-6eb5-4225-aca7-96458990cd58 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:06.792204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 248/480] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:07.549620 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fed29-390a-4bf8-b734-1917455ce478 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:07.550124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fed29-390a-4bf8-b734-1917455ce478 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:07.550198 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fed29-390a-4bf8-b734-1917455ce478 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:07.551846 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 233/481] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:07.557380 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1fd7f-3d9c-4a65-b152-e131144c862e None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:07.557670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1fd7f-3d9c-4a65-b152-e131144c862e None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:07.557949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1fd7f-3d9c-4a65-b152-e131144c862e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:07.577632 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-9ad1fd7f-3d9c-4a65-b152-e131144c862e None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:07.578853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-9ad1fd7f-3d9c-4a65-b152-e131144c862e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:07.675081 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 249/482] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:08.041872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fed29-390a-4bf8-b734-1917455ce478 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:08.156628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fed29-390a-4bf8-b734-1917455ce478 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:08.196823 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9968203-cc36-4d8a-974a-5782719d9021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:08.197819 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9968203-cc36-4d8a-974a-5782719d9021 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:08.198294 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9968203-cc36-4d8a-974a-5782719d9021 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:08.198785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9968203-cc36-4d8a-974a-5782719d9021 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:08.211670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9968203-cc36-4d8a-974a-5782719d9021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:08.216838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-b9968203-cc36-4d8a-974a-5782719d9021 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:08.216838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:08.216838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:08.216838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:08.216838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:08.216838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:08.216838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:08.216838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:08.216838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:08.216838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:08.216838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:08.216838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:08.216838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:08.216838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:08.216838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:08.216838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:08.217746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:08.217746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:08.217746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:08.217746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:08.217746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:08.217746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:08.217746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:08.217746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:08.217746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:08.217746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:08.217746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:08.217746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:08.217746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:08.217746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:08.217746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:08.217746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:08.218553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:08.218553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:08.218553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:08.218553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:08.218553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:08.218553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:08.218553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:08.218553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:08.218553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:08.218553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:08.218553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:08.218553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:08.221110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 234/483] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:08.227055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1fd7f-3d9c-4a65-b152-e131144c862e None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:08.290328 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:08.307257 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543dd84-1dc0-4b89-a423-05b9087f2f7d None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:08.307524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543dd84-1dc0-4b89-a423-05b9087f2f7d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:08.307720 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543dd84-1dc0-4b89-a423-05b9087f2f7d None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:08.309237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 235/484] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:23:08.320543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5f10a-a2d2-401e-b5b9-d267beadd542 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:08.320841 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5f10a-a2d2-401e-b5b9-d267beadd542 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:08.321089 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5f10a-a2d2-401e-b5b9-d267beadd542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:08.338688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1fd7f-3d9c-4a65-b152-e131144c862e None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:08.373044 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-6fb5f10a-a2d2-401e-b5b9-d267beadd542 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:08.374264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6fb5f10a-a2d2-401e-b5b9-d267beadd542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:08.418467 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c5fe9-bd89-443f-89fd-24413b3d3023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:08.419142 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c5fe9-bd89-443f-89fd-24413b3d3023 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:08.422858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c5fe9-bd89-443f-89fd-24413b3d3023 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:08.422858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c5fe9-bd89-443f-89fd-24413b3d3023 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:08.422858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c5fe9-bd89-443f-89fd-24413b3d3023 None admin] RBAC: Adding query filter params (name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:08.422858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c5fe9-bd89-443f-89fd-24413b3d3023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:08.422858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c5fe9-bd89-443f-89fd-24413b3d3023 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:08.436204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 250/485] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:23:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:08.451849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c5fe9-bd89-443f-89fd-24413b3d3023 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:08.553257 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:08.620544 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 236/486] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:08.676395 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaae616-eb43-4cda-8374-e95bcb5d6765 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:08.676712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaae616-eb43-4cda-8374-e95bcb5d6765 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:08.676970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaae616-eb43-4cda-8374-e95bcb5d6765 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:08.678555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 237/487] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:08.683118 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c5fe9-bd89-443f-89fd-24413b3d3023 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:08.688028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ede36-607e-4113-b323-f3925dd64b4a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:08.688304 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ede36-607e-4113-b323-f3925dd64b4a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:08.688612 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ede36-607e-4113-b323-f3925dd64b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:08.742323 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:08.743999 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-ec2ede36-607e-4113-b323-f3925dd64b4a None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:08.745209 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ec2ede36-607e-4113-b323-f3925dd64b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:08.797175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab82a8-3b8d-452a-b562-c9acb680645d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:08.798368 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab82a8-3b8d-452a-b562-c9acb680645d None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:08.798645 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab82a8-3b8d-452a-b562-c9acb680645d None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:08.800942 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab82a8-3b8d-452a-b562-c9acb680645d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:08.816446 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab82a8-3b8d-452a-b562-c9acb680645d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:08.818091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab82a8-3b8d-452a-b562-c9acb680645d None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:08.836917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-eaab82a8-3b8d-452a-b562-c9acb680645d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:08.836917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:08.836917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:08.836917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:08.836917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:08.836917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:08.836917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:08.836917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:08.836917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:08.836917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:08.836917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:08.836917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:08.836917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:08.836917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:08.836917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:08.836917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:08.838080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:08.838080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:08.838080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:08.838080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:08.838080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:08.838080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:08.838080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:08.838080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:08.838080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:08.838080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:08.838080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:08.838080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:08.838080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:08.838080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:08.838080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:08.838080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:08.838080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:08.838963 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:08.838963 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:08.838963 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:08.838963 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 251/488] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:08.838963 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fa90f-1ac4-42c6-b7ba-46407824f6eb None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:08.838963 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fa90f-1ac4-42c6-b7ba-46407824f6eb None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:08.838963 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fa90f-1ac4-42c6-b7ba-46407824f6eb None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:08.845825 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 252/489] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:08.845825 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fa90f-1ac4-42c6-b7ba-46407824f6eb None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:08.921148 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 238/490] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:08.922660 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a533da9-1fb1-4219-8669-1f0d33c2114e None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:08.923636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a533da9-1fb1-4219-8669-1f0d33c2114e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:08.924074 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a533da9-1fb1-4219-8669-1f0d33c2114e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:08.963641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-5a533da9-1fb1-4219-8669-1f0d33c2114e None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:08.966839 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5a533da9-1fb1-4219-8669-1f0d33c2114e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:09.017410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fa90f-1ac4-42c6-b7ba-46407824f6eb None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:09.059965 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 239/491] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:09.059965 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a533da9-1fb1-4219-8669-1f0d33c2114e None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:09.061407 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fea6ad-6ac9-43d8-950b-9761cf80c4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:09.061533 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fea6ad-6ac9-43d8-950b-9761cf80c4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:09.063150 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fea6ad-6ac9-43d8-950b-9761cf80c4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:09.063150 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fea6ad-6ac9-43d8-950b-9761cf80c4e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:09.063150 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fea6ad-6ac9-43d8-950b-9761cf80c4e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:09.063150 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fea6ad-6ac9-43d8-950b-9761cf80c4e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:09.064587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fea6ad-6ac9-43d8-950b-9761cf80c4e4 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:09.089805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 253/492] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:09.097920 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fea6ad-6ac9-43d8-950b-9761cf80c4e4 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:09.132696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:09.153542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:09.222955 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a533da9-1fb1-4219-8669-1f0d33c2114e None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:09.243487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fea6ad-6ac9-43d8-950b-9761cf80c4e4 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:09.271851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f1cb7-87b0-457d-b7d2-54f99f536443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:09.272746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f1cb7-87b0-457d-b7d2-54f99f536443 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:09.273026 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f1cb7-87b0-457d-b7d2-54f99f536443 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:09.273347 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f1cb7-87b0-457d-b7d2-54f99f536443 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:09.279587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3db768-b286-441d-9dd8-4fdcdbedeaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:09.280400 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3db768-b286-441d-9dd8-4fdcdbedeaf0 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:09.280679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3db768-b286-441d-9dd8-4fdcdbedeaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:09.280949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3db768-b286-441d-9dd8-4fdcdbedeaf0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:09.286395 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f1cb7-87b0-457d-b7d2-54f99f536443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:09.289232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3db768-b286-441d-9dd8-4fdcdbedeaf0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:09.290663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3db768-b286-441d-9dd8-4fdcdbedeaf0 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:09.291851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-bc3f1cb7-87b0-457d-b7d2-54f99f536443 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:09.291851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:09.291851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:09.291851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:09.291851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:09.291851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:09.291851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:09.291851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:09.291851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:09.291851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:09.291851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:09.291851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:09.291851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:09.291851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:09.291851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:09.291851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:09.292716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:09.292716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:09.292716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:09.292716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:09.292716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:09.292716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:09.292716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:09.292716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:09.292716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:09.292716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:09.292716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:09.292716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:09.292716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:09.292716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:09.292716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:09.292716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:09.293511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:09.293511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:09.293511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:09.293511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:09.293511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:09.293511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:09.293511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:09.293511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:09.293511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:09.293511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:09.293511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:09.293511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:09.294255 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 240/493] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:09.295589 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f1cb7-87b0-457d-b7d2-54f99f536443 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:09.304594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-cc3db768-b286-441d-9dd8-4fdcdbedeaf0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 01:23:09.304594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:09.304594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:09.304594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:09.304594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:09.304594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:09.304594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:09.304594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:09.304594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:09.304594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:09.304594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:09.304594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:09.304594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:09.304594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:09.304594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:09.304594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:09.306622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:09.306622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:09.306622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:09.306622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:09.306622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:09.306622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:09.306622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:09.306622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:09.306622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:09.306622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:09.306622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:09.306622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:09.306622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:09.306622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:09.306622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:09.306622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:09.306622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:09.306622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:09.308801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:09.308801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:09.308801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:09.308801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:09.308801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:09.308801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:09.308801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:09.308801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:09.308801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 01:23:09.308801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:09.308801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 254/494] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 26 01:23:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:09.308801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3db768-b286-441d-9dd8-4fdcdbedeaf0 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:09.412813 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:09.423691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3db768-b286-441d-9dd8-4fdcdbedeaf0 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:09.431837 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:09.434640 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f1cb7-87b0-457d-b7d2-54f99f536443 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:09.464203 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912743ad-711f-4708-8dd1-c4ccef5fefe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:09.464828 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912743ad-711f-4708-8dd1-c4ccef5fefe9 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:09.465144 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912743ad-711f-4708-8dd1-c4ccef5fefe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:09.465872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912743ad-711f-4708-8dd1-c4ccef5fefe9 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:09.466526 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912743ad-711f-4708-8dd1-c4ccef5fefe9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:09.466905 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912743ad-711f-4708-8dd1-c4ccef5fefe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:09.468356 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912743ad-711f-4708-8dd1-c4ccef5fefe9 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:09.471928 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2eed6a-9302-4682-8123-d6ff6aa4724c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:09.472557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eed6a-9302-4682-8123-d6ff6aa4724c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:09.472838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eed6a-9302-4682-8123-d6ff6aa4724c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:09.473162 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eed6a-9302-4682-8123-d6ff6aa4724c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:09.481503 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 255/495] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:23:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:09.481503 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912743ad-711f-4708-8dd1-c4ccef5fefe9 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:09.488913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2eed6a-9302-4682-8123-d6ff6aa4724c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:09.493708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-5a2eed6a-9302-4682-8123-d6ff6aa4724c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:09.493708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:09.493708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:09.493708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:09.493708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:09.493708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:09.493708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:09.493708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:09.493708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:09.493708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:09.493708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:09.493708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:09.493708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:09.493708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:09.493708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:09.493708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:09.494610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:09.494610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:09.494610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:09.494610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:09.494610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:09.494610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:09.494610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:09.494610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:09.494610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:09.494610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:09.494610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:09.494610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:09.494610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:09.494610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:09.494610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:09.494610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:09.496112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:09.496112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:09.496112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:09.496112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:09.496112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:09.496112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:09.496112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:09.496112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:09.496112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:09.496112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:09.496112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:09.496112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:09.496112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 241/496] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:09.496112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2eed6a-9302-4682-8123-d6ff6aa4724c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:09.591831 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912743ad-711f-4708-8dd1-c4ccef5fefe9 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:09.598369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2eed6a-9302-4682-8123-d6ff6aa4724c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:09.626573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4f93c-d441-47ee-a1b0-93ca16ccf386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:09.627304 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4f93c-d441-47ee-a1b0-93ca16ccf386 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:09.627581 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4f93c-d441-47ee-a1b0-93ca16ccf386 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:09.627853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4f93c-d441-47ee-a1b0-93ca16ccf386 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:09.628577 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4f93c-d441-47ee-a1b0-93ca16ccf386 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:09.628868 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4f93c-d441-47ee-a1b0-93ca16ccf386 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:09.630277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4f93c-d441-47ee-a1b0-93ca16ccf386 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:09.633438 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c2f6a-bfe9-42c0-b767-2832b45c7a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:09.634059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c2f6a-bfe9-42c0-b767-2832b45c7a9d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:09.634337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c2f6a-bfe9-42c0-b767-2832b45c7a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:09.634606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c2f6a-bfe9-42c0-b767-2832b45c7a9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:09.645769 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c2f6a-bfe9-42c0-b767-2832b45c7a9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:09.651030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-bb9c2f6a-bfe9-42c0-b767-2832b45c7a9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:09.651030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:09.651030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:09.651030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:09.651030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:09.651030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:09.651030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:09.651030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:09.651030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:09.651030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:09.651030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:09.651030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:09.651030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:09.651030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:09.651030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:09.651030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:09.651904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:09.651904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:09.651904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:09.651904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:09.651904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:09.651904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:09.651904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:09.651904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:09.651904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:09.651904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:09.651904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:09.651904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:09.651904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:09.651904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:09.651904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:09.651904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:09.653285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:09.653285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:09.653285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:09.653285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:09.653285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:09.653285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:09.653285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:09.653285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:09.653285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:09.653285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:09.653285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:09.653285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:09.653285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 242/497] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:09.653285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c2f6a-bfe9-42c0-b767-2832b45c7a9d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:09.674678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 256/498] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 26 01:23:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:09.675534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4f93c-d441-47ee-a1b0-93ca16ccf386 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:09.682320 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:09.692277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:09.770332 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c2f6a-bfe9-42c0-b767-2832b45c7a9d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:09.783713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4f93c-d441-47ee-a1b0-93ca16ccf386 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:09.813323 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71586d81-87c5-4575-8b0b-fe1cd65f3cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:09.814707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71586d81-87c5-4575-8b0b-fe1cd65f3cda None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:09.815024 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71586d81-87c5-4575-8b0b-fe1cd65f3cda None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:09.815292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71586d81-87c5-4575-8b0b-fe1cd65f3cda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:09.819679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c1e2c-f13c-4999-bc23-a882801ca734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:09.820543 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c1e2c-f13c-4999-bc23-a882801ca734 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:09.820817 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c1e2c-f13c-4999-bc23-a882801ca734 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:09.821086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c1e2c-f13c-4999-bc23-a882801ca734 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:09.821740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c1e2c-f13c-4999-bc23-a882801ca734 None admin] RBAC: Adding query filter params (name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:09.822041 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c1e2c-f13c-4999-bc23-a882801ca734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:09.823423 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c1e2c-f13c-4999-bc23-a882801ca734 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:09.826062 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71586d81-87c5-4575-8b0b-fe1cd65f3cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:09.827521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71586d81-87c5-4575-8b0b-fe1cd65f3cda None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:09.831515 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 257/499] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:23:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:09.832299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c1e2c-f13c-4999-bc23-a882801ca734 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:09.843215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-71586d81-87c5-4575-8b0b-fe1cd65f3cda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:09.843215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:09.843215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:09.843215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:09.843215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:09.843215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:09.843215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:09.843215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:09.843215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:09.843215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:09.843215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:09.843215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:09.843215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:09.843215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:09.843215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:09.843215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:09.844171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:09.844171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:09.844171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:09.844171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:09.844171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:09.844171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:09.844171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:09.844171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:09.844171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:09.844171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:09.844171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:09.844171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:09.844171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:09.844171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:09.844171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:09.844171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:09.844171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:09.845675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:09.845675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:09.845675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:09.845675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 243/500] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:09.846771 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71586d81-87c5-4575-8b0b-fe1cd65f3cda None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:09.905879 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:09.915415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:09.932160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c1e2c-f13c-4999-bc23-a882801ca734 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:09.946014 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71586d81-87c5-4575-8b0b-fe1cd65f3cda None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:09.966250 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311ca5d-9041-49e8-88e5-d8cd8db4bd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:09.966867 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311ca5d-9041-49e8-88e5-d8cd8db4bd58 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:09.967148 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311ca5d-9041-49e8-88e5-d8cd8db4bd58 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:09.967417 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311ca5d-9041-49e8-88e5-d8cd8db4bd58 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:09.968068 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311ca5d-9041-49e8-88e5-d8cd8db4bd58 None admin] RBAC: Adding query filter params (name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:09.968369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311ca5d-9041-49e8-88e5-d8cd8db4bd58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:09.970250 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311ca5d-9041-49e8-88e5-d8cd8db4bd58 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:09.978065 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 258/501] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:23:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:09.979333 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66312d9b-f3d1-42f5-864d-dc9e0500fba1 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:09.979621 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66312d9b-f3d1-42f5-864d-dc9e0500fba1 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:09.979892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66312d9b-f3d1-42f5-864d-dc9e0500fba1 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:09.981085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 259/502] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:09.981760 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66312d9b-f3d1-42f5-864d-dc9e0500fba1 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:09.983438 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217b0af-5748-442b-88fd-80ad91062743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:09.984259 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217b0af-5748-442b-88fd-80ad91062743 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:09.984713 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217b0af-5748-442b-88fd-80ad91062743 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:09.985156 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217b0af-5748-442b-88fd-80ad91062743 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:10.052060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217b0af-5748-442b-88fd-80ad91062743 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:10.053451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217b0af-5748-442b-88fd-80ad91062743 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:10.082384 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66312d9b-f3d1-42f5-864d-dc9e0500fba1 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:10.116761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceebc1f-c73b-44bf-b130-225599c41d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:10.117387 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceebc1f-c73b-44bf-b130-225599c41d64 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:10.117663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceebc1f-c73b-44bf-b130-225599c41d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:10.117935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceebc1f-c73b-44bf-b130-225599c41d64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:10.120893 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:10.121150 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:10.130024 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceebc1f-c73b-44bf-b130-225599c41d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:10.131511 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceebc1f-c73b-44bf-b130-225599c41d64 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:10.145449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-7ceebc1f-c73b-44bf-b130-225599c41d64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:10.145449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:10.145449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:10.145449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:10.145449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:10.145449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:10.145449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:10.145449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:10.145449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:10.145449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:10.145449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:10.145449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:10.145449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:10.145449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:10.145449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:10.145449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:10.146539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:10.146539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:10.146539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:10.146539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:10.146539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:10.146539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:10.146539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:10.146539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:10.146539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:10.146539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:10.146539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:10.146539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:10.146539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:10.146539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:10.146539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:10.146539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:10.146539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:10.147580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:10.147580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:10.147580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:10.147580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 260/503] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:10.147580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceebc1f-c73b-44bf-b130-225599c41d64 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:10.158316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 244/504] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:23:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:23:10.158316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217b0af-5748-442b-88fd-80ad91062743 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:10.251234 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceebc1f-c73b-44bf-b130-225599c41d64 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:10.251759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217b0af-5748-442b-88fd-80ad91062743 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:10.284864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297569d-7396-47d0-aef7-02017e6ec4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:10.285463 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297569d-7396-47d0-aef7-02017e6ec4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:10.285745 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297569d-7396-47d0-aef7-02017e6ec4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:10.286022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297569d-7396-47d0-aef7-02017e6ec4c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:10.286195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4518ba3-df00-4561-a47e-5b5c5f837db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:10.286659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297569d-7396-47d0-aef7-02017e6ec4c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:10.286804 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4518ba3-df00-4561-a47e-5b5c5f837db2 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:10.287005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297569d-7396-47d0-aef7-02017e6ec4c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:10.287115 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4518ba3-df00-4561-a47e-5b5c5f837db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:10.287362 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4518ba3-df00-4561-a47e-5b5c5f837db2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:10.288379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297569d-7396-47d0-aef7-02017e6ec4c1 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:10.297179 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4518ba3-df00-4561-a47e-5b5c5f837db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:10.298795 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4518ba3-df00-4561-a47e-5b5c5f837db2 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:10.299793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 261/505] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:10.301040 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51d6de-b6f4-40ac-98f3-1bd134098212 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:10.301321 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51d6de-b6f4-40ac-98f3-1bd134098212 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:10.301586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51d6de-b6f4-40ac-98f3-1bd134098212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:10.313591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-a4518ba3-df00-4561-a47e-5b5c5f837db2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:10.313591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:10.313591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:10.313591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:10.313591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:10.313591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:10.313591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:10.313591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:10.313591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:10.313591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:10.313591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:10.313591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:10.313591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:10.313591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:10.313591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:10.313591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:10.314614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:10.314614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:10.314614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:10.314614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:10.314614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:10.314614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:10.314614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:10.314614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:10.314614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:10.314614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:10.314614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:10.314614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:10.314614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:10.314614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:10.314614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:10.314614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:10.314614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:10.315480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:10.315480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:10.315480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:10.315480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 245/506] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:10.315480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4518ba3-df00-4561-a47e-5b5c5f837db2 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:10.323597 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-aa51d6de-b6f4-40ac-98f3-1bd134098212 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:10.324782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-aa51d6de-b6f4-40ac-98f3-1bd134098212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:10.340954 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:10.368926 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:10.392888 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 262/507] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:10.394016 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51d6de-b6f4-40ac-98f3-1bd134098212 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:10.423182 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4518ba3-df00-4561-a47e-5b5c5f837db2 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:10.459073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1336489-6a39-484c-9609-264a1c0cd3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:10.459945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1336489-6a39-484c-9609-264a1c0cd3cc None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:10.460382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1336489-6a39-484c-9609-264a1c0cd3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:10.460737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1336489-6a39-484c-9609-264a1c0cd3cc None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:10.461370 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1336489-6a39-484c-9609-264a1c0cd3cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:10.461665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1336489-6a39-484c-9609-264a1c0cd3cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:10.463042 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1336489-6a39-484c-9609-264a1c0cd3cc None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:10.476125 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 246/508] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:10.476780 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1336489-6a39-484c-9609-264a1c0cd3cc None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:10.504070 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51d6de-b6f4-40ac-98f3-1bd134098212 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:10.542820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f88f8-0244-421d-9726-4cde5d8ad0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:10.543590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f88f8-0244-421d-9726-4cde5d8ad0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:10.543880 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f88f8-0244-421d-9726-4cde5d8ad0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:10.544155 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f88f8-0244-421d-9726-4cde5d8ad0b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:10.555033 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f88f8-0244-421d-9726-4cde5d8ad0b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:10.556384 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f88f8-0244-421d-9726-4cde5d8ad0b0 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:10.562509 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:10.573590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-653f88f8-0244-421d-9726-4cde5d8ad0b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:10.573590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:10.573590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:10.573590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:10.573590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:10.573590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:10.573590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:10.573590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:10.573590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:10.573590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:10.573590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:10.573590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:10.573590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:10.573590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:10.573590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:10.573590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:10.574508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:10.574508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:10.574508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:10.574508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:10.574508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:10.574508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:10.574508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:10.574508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:10.574508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:10.574508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:10.574508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:10.574508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:10.574508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:10.574508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:10.574508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:10.574508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:10.574508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:10.576157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:10.576157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:10.576157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:10.576157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 263/509] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:10.576157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f88f8-0244-421d-9726-4cde5d8ad0b0 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:10.587612 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1336489-6a39-484c-9609-264a1c0cd3cc None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:10.607727 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:10.631786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9349670-a9d9-41da-ac20-f69158e6401a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:10.632949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9349670-a9d9-41da-ac20-f69158e6401a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:10.633363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9349670-a9d9-41da-ac20-f69158e6401a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:10.633772 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9349670-a9d9-41da-ac20-f69158e6401a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:10.640944 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9349670-a9d9-41da-ac20-f69158e6401a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:10.642549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9349670-a9d9-41da-ac20-f69158e6401a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:10.655403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-b9349670-a9d9-41da-ac20-f69158e6401a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 01:23:10.655403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:10.655403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:10.655403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:10.655403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:10.655403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:10.655403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:10.655403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:10.655403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:10.655403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:10.655403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:10.655403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:10.655403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:10.655403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:10.655403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:10.655403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:10.656396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:10.656396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:10.656396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:10.656396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:10.656396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:10.656396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:10.656396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:10.656396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:10.656396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:10.656396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:10.656396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:10.656396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:10.656396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:10.656396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:10.656396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:10.656396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:10.656396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:10.656396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:10.657964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:10.657964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:10.657964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:10.657964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:10.657964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:10.657964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:10.657964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:10.657964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:10.657964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 01:23:10.657964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:10.659642 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 247/510] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:23:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:10.660548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9349670-a9d9-41da-ac20-f69158e6401a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:10.685535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f88f8-0244-421d-9726-4cde5d8ad0b0 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:10.718799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b618021-1c4b-4315-a1aa-54e55583f322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:10.719414 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b618021-1c4b-4315-a1aa-54e55583f322 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:10.720259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b618021-1c4b-4315-a1aa-54e55583f322 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:10.720644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b618021-1c4b-4315-a1aa-54e55583f322 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:10.721528 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b618021-1c4b-4315-a1aa-54e55583f322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:10.721843 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b618021-1c4b-4315-a1aa-54e55583f322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:10.723218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b618021-1c4b-4315-a1aa-54e55583f322 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:10.735183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 264/511] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:10.736705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b618021-1c4b-4315-a1aa-54e55583f322 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:10.761394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9349670-a9d9-41da-ac20-f69158e6401a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:10.794533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1a864-a79e-4b22-91dd-efb09b0c3bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:10.795182 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1a864-a79e-4b22-91dd-efb09b0c3bee None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:10.795455 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1a864-a79e-4b22-91dd-efb09b0c3bee None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:10.795724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1a864-a79e-4b22-91dd-efb09b0c3bee None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:10.803731 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1a864-a79e-4b22-91dd-efb09b0c3bee None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:10.805162 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1a864-a79e-4b22-91dd-efb09b0c3bee None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:10.816327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-f9a1a864-a79e-4b22-91dd-efb09b0c3bee None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 01:23:10.816327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:10.816327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:10.816327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:10.816327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:10.816327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:10.816327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:10.816327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:10.816327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:10.816327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:10.816327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:10.816327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:10.816327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:10.816327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:10.816327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:10.816327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:10.817271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:10.817271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:10.817271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:10.817271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:10.817271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:10.817271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:10.817271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:10.817271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:10.817271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:10.817271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:10.817271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:10.817271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:10.817271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:10.817271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:10.817271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:10.817271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:10.817271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:10.817271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:10.818172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:10.818172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:10.818172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:10.818172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:10.818172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:10.818172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:10.818172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:10.818172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:10.818172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 01:23:10.818172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:10.818172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 248/512] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:10.818172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1a864-a79e-4b22-91dd-efb09b0c3bee None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:10.822570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:10.832346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:10.842380 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b618021-1c4b-4315-a1aa-54e55583f322 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:10.878312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b12c8a-8b23-42f7-be5a-ab01e21c0287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:10.878944 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b12c8a-8b23-42f7-be5a-ab01e21c0287 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:10.879227 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b12c8a-8b23-42f7-be5a-ab01e21c0287 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:10.879499 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b12c8a-8b23-42f7-be5a-ab01e21c0287 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:10.880137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b12c8a-8b23-42f7-be5a-ab01e21c0287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:10.880438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b12c8a-8b23-42f7-be5a-ab01e21c0287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:10.881827 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b12c8a-8b23-42f7-be5a-ab01e21c0287 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:10.893781 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 265/513] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:10.894569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b12c8a-8b23-42f7-be5a-ab01e21c0287 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:10.918743 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1a864-a79e-4b22-91dd-efb09b0c3bee None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:10.952522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b406567-7de6-4ab8-8a78-7e70731de6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:10.953115 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b406567-7de6-4ab8-8a78-7e70731de6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:10.953390 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b406567-7de6-4ab8-8a78-7e70731de6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:10.953657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b406567-7de6-4ab8-8a78-7e70731de6e5 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:10.954923 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b406567-7de6-4ab8-8a78-7e70731de6e5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:10.955224 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b406567-7de6-4ab8-8a78-7e70731de6e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:10.956637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b406567-7de6-4ab8-8a78-7e70731de6e5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:10.992045 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 249/514] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Sep 26 01:23:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:10.992591 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b12c8a-8b23-42f7-be5a-ab01e21c0287 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:10.992852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b406567-7de6-4ab8-8a78-7e70731de6e5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:11.026455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7f124-7c99-4067-8f3e-963e50dfea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:11.027106 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7f124-7c99-4067-8f3e-963e50dfea65 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:11.027388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7f124-7c99-4067-8f3e-963e50dfea65 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:11.027664 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7f124-7c99-4067-8f3e-963e50dfea65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:11.038743 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7f124-7c99-4067-8f3e-963e50dfea65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:11.040199 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7f124-7c99-4067-8f3e-963e50dfea65 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:11.051595 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:11.054298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-2fa7f124-7c99-4067-8f3e-963e50dfea65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:11.054298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:11.054298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:11.054298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:11.054298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:11.054298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:11.054298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:11.054298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:11.054298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:11.054298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:11.054298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:11.054298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:11.054298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:11.054298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:11.054298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:11.054298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:11.055379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:11.055379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:11.055379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:11.055379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:11.055379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:11.055379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:11.055379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:11.055379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:11.055379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:11.055379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:11.055379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:11.055379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:11.055379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:11.055379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:11.055379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:11.055379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:11.055379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:11.056423 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:11.056423 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:11.056423 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:11.056423 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 266/515] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:11.056682 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7f124-7c99-4067-8f3e-963e50dfea65 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:11.059006 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:11.096411 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b406567-7de6-4ab8-8a78-7e70731de6e5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:11.128934 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2509b4-2d5a-49e2-b575-bd6ffaf0d75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:11.129555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2509b4-2d5a-49e2-b575-bd6ffaf0d75c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:11.129837 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2509b4-2d5a-49e2-b575-bd6ffaf0d75c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:11.130113 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2509b4-2d5a-49e2-b575-bd6ffaf0d75c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:11.137161 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2509b4-2d5a-49e2-b575-bd6ffaf0d75c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:11.138601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2509b4-2d5a-49e2-b575-bd6ffaf0d75c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:11.150692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-bd2509b4-2d5a-49e2-b575-bd6ffaf0d75c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 26 01:23:11.150692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:11.150692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:11.150692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:11.150692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:11.150692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:11.150692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:11.150692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:11.150692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:11.150692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:11.150692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:11.150692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:11.150692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:11.150692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:11.150692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:11.150692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:11.151636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:11.151636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:11.151636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:11.151636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:11.151636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:11.151636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:11.151636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:11.151636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:11.151636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:11.151636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:11.151636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:11.151636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:11.151636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:11.151636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:11.151636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:11.151636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:11.151636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:11.151636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:11.152512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:11.152512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:11.152512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:11.152512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:11.152512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:11.152512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:11.152512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:11.152512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:11.152512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 26 01:23:11.152512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:11.152512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 250/516] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:23:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:11.152512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2509b4-2d5a-49e2-b575-bd6ffaf0d75c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:11.160332 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7f124-7c99-4067-8f3e-963e50dfea65 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:11.193883 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d107da-8e69-4631-bb5a-d4ec815e0702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:11.194484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d107da-8e69-4631-bb5a-d4ec815e0702 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:11.194764 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d107da-8e69-4631-bb5a-d4ec815e0702 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:11.195331 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d107da-8e69-4631-bb5a-d4ec815e0702 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:11.196047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d107da-8e69-4631-bb5a-d4ec815e0702 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:11.196349 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d107da-8e69-4631-bb5a-d4ec815e0702 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:11.197781 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d107da-8e69-4631-bb5a-d4ec815e0702 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:11.215784 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 267/517] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Sep 26 01:23:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:11.216573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d107da-8e69-4631-bb5a-d4ec815e0702 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:11.259078 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2509b4-2d5a-49e2-b575-bd6ffaf0d75c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:11.276654 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:11.281275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:11.292820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d36539-23a7-426e-90a6-8655f2b29bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:11.293442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d36539-23a7-426e-90a6-8655f2b29bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:11.293722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d36539-23a7-426e-90a6-8655f2b29bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:11.293993 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d36539-23a7-426e-90a6-8655f2b29bb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:11.301205 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d36539-23a7-426e-90a6-8655f2b29bb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:11.302662 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d36539-23a7-426e-90a6-8655f2b29bb6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:11.314994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-40d36539-23a7-426e-90a6-8655f2b29bb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:11.314994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:11.314994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:11.314994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:11.314994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:11.314994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:11.314994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:11.314994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:11.314994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:11.314994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:11.314994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:11.314994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:11.314994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:11.314994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:11.314994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:11.315926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:11.315926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:11.315926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:11.315926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:11.315926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:11.315926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:11.315926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:11.315926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:11.315926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:11.315926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:11.315926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:11.315926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:11.315926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:11.315926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:11.315926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:11.315926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:11.315926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:11.316761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:11.316761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:11.316761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:11.316761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:11.316761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:11.316761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:11.316761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:11.316761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:11.316761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 251/518] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:11.317231 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d36539-23a7-426e-90a6-8655f2b29bb6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:11.317816 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d107da-8e69-4631-bb5a-d4ec815e0702 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:11.353286 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab7ba8-38ed-4f94-956f-0676b737d5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:11.353813 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab7ba8-38ed-4f94-956f-0676b737d5ab None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:11.354090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab7ba8-38ed-4f94-956f-0676b737d5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:11.354361 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab7ba8-38ed-4f94-956f-0676b737d5ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:11.414439 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d36539-23a7-426e-90a6-8655f2b29bb6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:11.421640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab7ba8-38ed-4f94-956f-0676b737d5ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:11.423725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab7ba8-38ed-4f94-956f-0676b737d5ab None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:11.449210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417f7f2-0843-4060-9a85-68b3a67348c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:11.449803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417f7f2-0843-4060-9a85-68b3a67348c2 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:11.450079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417f7f2-0843-4060-9a85-68b3a67348c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:11.450357 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417f7f2-0843-4060-9a85-68b3a67348c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:11.451016 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417f7f2-0843-4060-9a85-68b3a67348c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:11.451317 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417f7f2-0843-4060-9a85-68b3a67348c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:11.452672 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417f7f2-0843-4060-9a85-68b3a67348c2 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:11.464685 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 252/519] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:11.465473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417f7f2-0843-4060-9a85-68b3a67348c2 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:11.482620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:11.510249 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:11.525109 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 268/520] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:23:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:23:11.525934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab7ba8-38ed-4f94-956f-0676b737d5ab None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:11.572167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417f7f2-0843-4060-9a85-68b3a67348c2 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:11.605854 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec44bb-afe6-4b61-b673-cc978c32e005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:11.606467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec44bb-afe6-4b61-b673-cc978c32e005 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:11.606751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec44bb-afe6-4b61-b673-cc978c32e005 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:11.607053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec44bb-afe6-4b61-b673-cc978c32e005 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:11.607780 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec44bb-afe6-4b61-b673-cc978c32e005 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:11.608084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec44bb-afe6-4b61-b673-cc978c32e005 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:11.609520 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec44bb-afe6-4b61-b673-cc978c32e005 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:11.623981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab7ba8-38ed-4f94-956f-0676b737d5ab None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:11.627519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 253/521] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Sep 26 01:23:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:11.628316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec44bb-afe6-4b61-b673-cc978c32e005 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:11.658348 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff319429-643c-42d1-8d3e-a7511e61118a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:11.658970 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff319429-643c-42d1-8d3e-a7511e61118a None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:11.659248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff319429-643c-42d1-8d3e-a7511e61118a None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:11.659523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff319429-643c-42d1-8d3e-a7511e61118a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:11.685764 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:11.724139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:11.727237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec44bb-afe6-4b61-b673-cc978c32e005 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:11.727726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff319429-643c-42d1-8d3e-a7511e61118a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:11.729165 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff319429-643c-42d1-8d3e-a7511e61118a None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:11.762405 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c011e4e-2ccf-4723-9242-23b27570a324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:11.763027 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c011e4e-2ccf-4723-9242-23b27570a324 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:11.763308 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c011e4e-2ccf-4723-9242-23b27570a324 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:11.763580 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c011e4e-2ccf-4723-9242-23b27570a324 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:11.764265 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c011e4e-2ccf-4723-9242-23b27570a324 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:11.764571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c011e4e-2ccf-4723-9242-23b27570a324 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:11.765986 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c011e4e-2ccf-4723-9242-23b27570a324 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:11.784241 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 254/522] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:11.785023 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c011e4e-2ccf-4723-9242-23b27570a324 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:11.827936 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 269/523] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:23:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:23:11.828834 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff319429-643c-42d1-8d3e-a7511e61118a None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:11.886408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:11.887525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c011e4e-2ccf-4723-9242-23b27570a324 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:11.921320 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9e01e-7933-4548-ae6d-64c8aaa4884a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:11.921945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9e01e-7933-4548-ae6d-64c8aaa4884a None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:11.922223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9e01e-7933-4548-ae6d-64c8aaa4884a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:11.922493 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9e01e-7933-4548-ae6d-64c8aaa4884a None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:11.923189 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9e01e-7933-4548-ae6d-64c8aaa4884a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:11.924618 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9e01e-7933-4548-ae6d-64c8aaa4884a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:11.926923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff319429-643c-42d1-8d3e-a7511e61118a None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:11.944532 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 255/524] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 26 01:23:11 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:23:11.945676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9e01e-7933-4548-ae6d-64c8aaa4884a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:11.968807 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:11.972517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4b070-0a1b-4369-8786-80ab4fb3c7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:11.973168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4b070-0a1b-4369-8786-80ab4fb3c7fe None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:11.973467 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4b070-0a1b-4369-8786-80ab4fb3c7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:11.973753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4b070-0a1b-4369-8786-80ab4fb3c7fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:11.985759 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4b070-0a1b-4369-8786-80ab4fb3c7fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:11.987298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4b070-0a1b-4369-8786-80ab4fb3c7fe None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:12.003448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-1eb4b070-0a1b-4369-8786-80ab4fb3c7fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:12.003448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:12.003448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:12.003448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:12.003448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:12.003448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:12.003448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:12.003448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:12.003448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:12.003448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:12.003448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:12.003448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:12.003448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:12.003448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:12.003448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:12.003448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:12.004672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:12.004672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:12.004672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:12.004672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:12.004672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:12.004672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:12.004672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:12.004672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:12.004672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:12.004672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:12.004672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:12.004672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:12.004672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:12.004672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:12.004672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:12.004672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:12.004672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:12.005840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:12.005840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:12.005840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:12.005840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 270/525] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:12.005840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4b070-0a1b-4369-8786-80ab4fb3c7fe None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:12.075452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9e01e-7933-4548-ae6d-64c8aaa4884a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:12.114456 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687eab6-bff4-4353-881e-bb0c29ace607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:12.115195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687eab6-bff4-4353-881e-bb0c29ace607 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:12.115446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687eab6-bff4-4353-881e-bb0c29ace607 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:12.115646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687eab6-bff4-4353-881e-bb0c29ace607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:12.123896 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4b070-0a1b-4369-8786-80ab4fb3c7fe None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:12.137971 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:12.168857 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb4d84-9ec6-4017-847f-63bd5f506f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:12.169461 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb4d84-9ec6-4017-847f-63bd5f506f6d None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:12.169747 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb4d84-9ec6-4017-847f-63bd5f506f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:12.170048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb4d84-9ec6-4017-847f-63bd5f506f6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:12.170775 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb4d84-9ec6-4017-847f-63bd5f506f6d None admin] RBAC: Adding query filter params (role.id=8801886a5f4e4695a29b60c6eb347932, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=3d6eaeb6bced49afabc7bdaa5e7cecfb) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:12.171113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb4d84-9ec6-4017-847f-63bd5f506f6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:12.172538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb4d84-9ec6-4017-847f-63bd5f506f6d None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:12.180679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 271/526] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:23:12 2022] GET /identity/v3/role_assignments?user.id=3d6eaeb6bced49afabc7bdaa5e7cecfb&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=8801886a5f4e4695a29b60c6eb347932 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:12.180949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb4d84-9ec6-4017-847f-63bd5f506f6d None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:12.192840 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687eab6-bff4-4353-881e-bb0c29ace607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:12.195440 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687eab6-bff4-4353-881e-bb0c29ace607 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:12.223919 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:12.332852 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb4d84-9ec6-4017-847f-63bd5f506f6d None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:12.336401 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 256/527] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:23:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:23:12.337699 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687eab6-bff4-4353-881e-bb0c29ace607 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:12.387145 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88d95d-fc73-4430-b408-8db5648cfcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:12.387777 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88d95d-fc73-4430-b408-8db5648cfcdf None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:12.388104 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88d95d-fc73-4430-b408-8db5648cfcdf None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:12.388325 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88d95d-fc73-4430-b408-8db5648cfcdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:12.402871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88d95d-fc73-4430-b408-8db5648cfcdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:12.404385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88d95d-fc73-4430-b408-8db5648cfcdf None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:12.422471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-9a88d95d-fc73-4430-b408-8db5648cfcdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:12.422471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:12.422471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:12.422471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:12.422471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:12.422471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:12.422471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:12.422471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:12.422471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:12.422471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:12.422471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:12.422471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:12.422471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:12.422471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:12.422471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:12.422471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:12.424281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:12.424281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:12.424281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:12.424281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:12.424281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:12.424281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:12.424281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:12.424281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:12.424281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:12.424281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:12.424281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:12.424281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:12.424281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:12.424281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:12.424281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:12.424281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:12.424281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:12.425121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:12.425121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:12.425121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:12.429363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 272/528] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:12.430448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88d95d-fc73-4430-b408-8db5648cfcdf None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:12.467259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:12.475600 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687eab6-bff4-4353-881e-bb0c29ace607 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:12.498667 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:12.522672 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fdf99-2cad-4d6f-b14a-02f47432f165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:12.523357 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fdf99-2cad-4d6f-b14a-02f47432f165 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:12.523636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fdf99-2cad-4d6f-b14a-02f47432f165 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:12.523906 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fdf99-2cad-4d6f-b14a-02f47432f165 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:12.524554 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fdf99-2cad-4d6f-b14a-02f47432f165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:12.524871 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fdf99-2cad-4d6f-b14a-02f47432f165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:12.526225 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fdf99-2cad-4d6f-b14a-02f47432f165 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:12.541334 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 257/529] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:12.542420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fdf99-2cad-4d6f-b14a-02f47432f165 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:12.555934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88d95d-fc73-4430-b408-8db5648cfcdf None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:12.603599 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2373e-aa18-4a6b-94d1-bd30635e092f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:12.604814 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2373e-aa18-4a6b-94d1-bd30635e092f None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:12.605302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2373e-aa18-4a6b-94d1-bd30635e092f None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:12.606095 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2373e-aa18-4a6b-94d1-bd30635e092f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:12.621023 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2373e-aa18-4a6b-94d1-bd30635e092f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:12.623512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2373e-aa18-4a6b-94d1-bd30635e092f None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:12.642625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-94c2373e-aa18-4a6b-94d1-bd30635e092f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:12.642625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:12.642625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:12.642625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:12.642625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:12.642625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:12.642625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:12.642625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:12.642625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:12.642625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:12.642625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:12.642625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:12.642625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:12.642625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:12.642625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:12.642625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:12.643721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:12.643721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:12.643721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:12.643721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:12.643721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:12.643721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:12.643721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:12.643721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:12.643721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:12.643721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:12.643721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:12.643721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:12.643721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:12.643721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:12.643721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:12.643721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:12.643721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:12.644546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:12.644546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:12.644546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:12.644546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 273/530] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:12.644768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2373e-aa18-4a6b-94d1-bd30635e092f None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:12.667449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fdf99-2cad-4d6f-b14a-02f47432f165 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:12.715069 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fd50e-b918-4693-b8ce-e6f10b37ae50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:12.716586 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fd50e-b918-4693-b8ce-e6f10b37ae50 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:12.717010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fd50e-b918-4693-b8ce-e6f10b37ae50 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:12.717684 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fd50e-b918-4693-b8ce-e6f10b37ae50 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:12.718471 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fd50e-b918-4693-b8ce-e6f10b37ae50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:12.719211 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fd50e-b918-4693-b8ce-e6f10b37ae50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:12.721725 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fd50e-b918-4693-b8ce-e6f10b37ae50 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:12.740628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 258/531] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:12.742107 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fd50e-b918-4693-b8ce-e6f10b37ae50 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:12.745488 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:12.774746 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2373e-aa18-4a6b-94d1-bd30635e092f None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:12.780448 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:12.817494 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ff73a-0160-433c-8a58-8bab4171e65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:12.818491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ff73a-0160-433c-8a58-8bab4171e65a None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:12.818944 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ff73a-0160-433c-8a58-8bab4171e65a None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:12.819361 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ff73a-0160-433c-8a58-8bab4171e65a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:12.827271 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ff73a-0160-433c-8a58-8bab4171e65a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:12.829028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ff73a-0160-433c-8a58-8bab4171e65a None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:12.843989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-0a6ff73a-0160-433c-8a58-8bab4171e65a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:12.843989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:12.843989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:12.843989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:12.843989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:12.843989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:12.843989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:12.843989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:12.843989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:12.843989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:12.843989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:12.843989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:12.843989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:12.843989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:12.843989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:12.846121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:12.846121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:12.846121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:12.846121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:12.846121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:12.846121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:12.846121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:12.846121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:12.846121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:12.846121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:12.846121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:12.846121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:12.846121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:12.846121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:12.846121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:12.846121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:12.846121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:12.847236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:12.847236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:12.847236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:12.847236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:12.847236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:12.847236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:12.847236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:12.847236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:12.849218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 274/532] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:12.850217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ff73a-0160-433c-8a58-8bab4171e65a None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:12.850658 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fd50e-b918-4693-b8ce-e6f10b37ae50 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:12.885672 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8be564-3802-4469-8bcd-e87d9aae161b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:12.886360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8be564-3802-4469-8bcd-e87d9aae161b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:12.886706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8be564-3802-4469-8bcd-e87d9aae161b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:12.887074 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8be564-3802-4469-8bcd-e87d9aae161b None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:12.887784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8be564-3802-4469-8bcd-e87d9aae161b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:12.888153 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8be564-3802-4469-8bcd-e87d9aae161b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:12.889618 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8be564-3802-4469-8bcd-e87d9aae161b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:12.907789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 259/533] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:12.907789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8be564-3802-4469-8bcd-e87d9aae161b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:12.968415 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ff73a-0160-433c-8a58-8bab4171e65a None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:13.004106 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:13.010899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8be564-3802-4469-8bcd-e87d9aae161b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:13.015588 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd89446-45e8-47ba-9ff9-a2a8abf6ba2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:13.016224 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd89446-45e8-47ba-9ff9-a2a8abf6ba2e None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:13.016534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd89446-45e8-47ba-9ff9-a2a8abf6ba2e None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:13.017014 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd89446-45e8-47ba-9ff9-a2a8abf6ba2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:13.029001 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd89446-45e8-47ba-9ff9-a2a8abf6ba2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:13.030456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd89446-45e8-47ba-9ff9-a2a8abf6ba2e None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:13.034096 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:13.044125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-6cd89446-45e8-47ba-9ff9-a2a8abf6ba2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:13.044125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:13.044125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:13.044125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:13.044125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:13.044125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:13.044125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:13.044125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:13.044125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:13.044125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:13.044125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:13.044125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:13.044125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:13.044125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:13.044125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:13.045053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:13.045053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:13.045053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:13.045053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:13.045053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:13.045053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:13.045053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:13.045053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:13.045053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:13.045053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:13.045053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:13.045053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:13.045053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:13.045053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:13.045053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:13.045053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:13.045053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:13.045900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:13.045900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:13.045900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:13.045900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:13.045900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:13.045900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:13.045900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:13.045900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:13.051378 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 275/534] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:13.052248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd89446-45e8-47ba-9ff9-a2a8abf6ba2e None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:13.060404 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fa90c-cdce-492a-9174-a61395241006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:13.061442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fa90c-cdce-492a-9174-a61395241006 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:13.061933 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fa90c-cdce-492a-9174-a61395241006 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:13.062401 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fa90c-cdce-492a-9174-a61395241006 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:13.063576 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fa90c-cdce-492a-9174-a61395241006 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:13.064104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fa90c-cdce-492a-9174-a61395241006 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:13.066059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fa90c-cdce-492a-9174-a61395241006 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:13.080396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 260/535] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:13.081696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fa90c-cdce-492a-9174-a61395241006 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:13.161259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd89446-45e8-47ba-9ff9-a2a8abf6ba2e None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:13.196643 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fa90c-cdce-492a-9174-a61395241006 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:13.197897 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674e107-2b01-47b0-85e0-98a9e51b8040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:13.198525 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674e107-2b01-47b0-85e0-98a9e51b8040 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:13.198813 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674e107-2b01-47b0-85e0-98a9e51b8040 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:13.199137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674e107-2b01-47b0-85e0-98a9e51b8040 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:13.206812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674e107-2b01-47b0-85e0-98a9e51b8040 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:13.208296 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674e107-2b01-47b0-85e0-98a9e51b8040 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:13.221299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-2674e107-2b01-47b0-85e0-98a9e51b8040 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:13.221299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:13.221299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:13.221299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:13.221299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:13.221299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:13.221299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:13.221299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:13.221299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:13.221299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:13.221299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:13.221299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:13.221299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:13.221299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:13.221299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:13.222283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:13.222283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:13.222283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:13.222283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:13.222283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:13.222283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:13.222283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:13.222283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:13.222283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:13.222283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:13.222283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:13.222283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:13.222283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:13.222283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:13.222283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:13.222283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:13.222283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:13.223156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:13.223156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:13.223156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:13.223156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:13.223156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:13.223156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:13.223156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:13.223156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:13.227097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 276/536] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:13.227965 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674e107-2b01-47b0-85e0-98a9e51b8040 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:13.240887 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef7afe-b761-4242-b644-867142db7438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:13.241898 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef7afe-b761-4242-b644-867142db7438 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:13.242375 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef7afe-b761-4242-b644-867142db7438 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:13.242902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef7afe-b761-4242-b644-867142db7438 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:13.243931 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef7afe-b761-4242-b644-867142db7438 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:13.244468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef7afe-b761-4242-b644-867142db7438 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:13.246291 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef7afe-b761-4242-b644-867142db7438 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:13.259667 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 261/537] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:13.260925 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef7afe-b761-4242-b644-867142db7438 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:13.281391 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:13.293505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:13.338178 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674e107-2b01-47b0-85e0-98a9e51b8040 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:13.374216 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b45745-467b-441a-9fa0-05018cc447bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:13.374837 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b45745-467b-441a-9fa0-05018cc447bf None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:13.375131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b45745-467b-441a-9fa0-05018cc447bf None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:13.375407 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b45745-467b-441a-9fa0-05018cc447bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:13.376464 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef7afe-b761-4242-b644-867142db7438 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:13.376632 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b45745-467b-441a-9fa0-05018cc447bf None admin] RBAC: Adding query filter params (role.id=8801886a5f4e4695a29b60c6eb347932, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=eab8abb1394d41e3a30439699086da28) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:13.376940 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b45745-467b-441a-9fa0-05018cc447bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:13.378633 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b45745-467b-441a-9fa0-05018cc447bf None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:13.385054 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 277/538] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:23:13 2022] GET /identity/v3/role_assignments?user.id=eab8abb1394d41e3a30439699086da28&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=8801886a5f4e4695a29b60c6eb347932 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:13.385933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b45745-467b-441a-9fa0-05018cc447bf None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:13.427228 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bdee7-46f9-42d0-abcb-b1125ab2c131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:13.428164 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bdee7-46f9-42d0-abcb-b1125ab2c131 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:13.428696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bdee7-46f9-42d0-abcb-b1125ab2c131 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:13.429284 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bdee7-46f9-42d0-abcb-b1125ab2c131 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:13.430274 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133bdee7-46f9-42d0-abcb-b1125ab2c131 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:13.430792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133bdee7-46f9-42d0-abcb-b1125ab2c131 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:13.432450 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133bdee7-46f9-42d0-abcb-b1125ab2c131 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:13.446723 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 262/539] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:13.459213 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bdee7-46f9-42d0-abcb-b1125ab2c131 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:13.509313 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b45745-467b-441a-9fa0-05018cc447bf None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:13.536147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:13.549248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948e194-91b4-4c76-82ce-65006309538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:13.549877 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948e194-91b4-4c76-82ce-65006309538a None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:13.550258 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948e194-91b4-4c76-82ce-65006309538a None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:13.550477 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948e194-91b4-4c76-82ce-65006309538a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:13.551232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948e194-91b4-4c76-82ce-65006309538a None admin] RBAC: Adding query filter params (role.id=8801886a5f4e4695a29b60c6eb347932, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=80c1005979d04c55b8746c25b0994086) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:13.551543 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948e194-91b4-4c76-82ce-65006309538a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:13.558859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948e194-91b4-4c76-82ce-65006309538a None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:13.559716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 278/540] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:23:13 2022] GET /identity/v3/role_assignments?user.id=80c1005979d04c55b8746c25b0994086&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=8801886a5f4e4695a29b60c6eb347932 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:13.615846 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:13.644588 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bdee7-46f9-42d0-abcb-b1125ab2c131 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:13.684192 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c3884-9c02-48dc-ba9c-70a7258bce84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:13.685093 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c3884-9c02-48dc-ba9c-70a7258bce84 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:13.685516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c3884-9c02-48dc-ba9c-70a7258bce84 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:13.685957 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c3884-9c02-48dc-ba9c-70a7258bce84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:13.686899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c3884-9c02-48dc-ba9c-70a7258bce84 None admin] RBAC: Adding query filter params (role.id=8801886a5f4e4695a29b60c6eb347932, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=15538b95acef435798ff7651fc1710cb) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:13.687365 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c3884-9c02-48dc-ba9c-70a7258bce84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:13.689583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c3884-9c02-48dc-ba9c-70a7258bce84 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:13.697192 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 263/541] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:23:13 2022] GET /identity/v3/role_assignments?user.id=15538b95acef435798ff7651fc1710cb&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=8801886a5f4e4695a29b60c6eb347932 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:14.245472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f4a60-0bfb-45a7-8280-560f92ffe380 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:14.245850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f4a60-0bfb-45a7-8280-560f92ffe380 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:14.246027 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f4a60-0bfb-45a7-8280-560f92ffe380 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:14.247673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 279/542] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:14.263343 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83349c-c13f-4bfb-8eb9-5f2e22a8b218 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:14.263856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83349c-c13f-4bfb-8eb9-5f2e22a8b218 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:14.263944 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83349c-c13f-4bfb-8eb9-5f2e22a8b218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:14.284149 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-fd83349c-c13f-4bfb-8eb9-5f2e22a8b218 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:14.285331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-fd83349c-c13f-4bfb-8eb9-5f2e22a8b218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:14.383857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 264/543] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:14.665894 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f4a60-0bfb-45a7-8280-560f92ffe380 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:14.781371 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81183379-de18-4e38-b7ac-14f2f8d5a154 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:14.781746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81183379-de18-4e38-b7ac-14f2f8d5a154 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:14.781972 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81183379-de18-4e38-b7ac-14f2f8d5a154 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:14.783463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 265/544] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:14.794228 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ac18d-d76e-4bb1-ae1d-9fafed3e1a6b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:14.794510 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ac18d-d76e-4bb1-ae1d-9fafed3e1a6b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:14.794782 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ac18d-d76e-4bb1-ae1d-9fafed3e1a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:14.816907 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f4a60-0bfb-45a7-8280-560f92ffe380 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:14.827676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-1d6ac18d-d76e-4bb1-ae1d-9fafed3e1a6b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:14.829688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1d6ac18d-d76e-4bb1-ae1d-9fafed3e1a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:14.880017 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c03d72-5295-4968-ad04-bae48119eac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:14.880647 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c03d72-5295-4968-ad04-bae48119eac6 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:14.880925 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c03d72-5295-4968-ad04-bae48119eac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:14.881197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c03d72-5295-4968-ad04-bae48119eac6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:14.894329 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c03d72-5295-4968-ad04-bae48119eac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:14.899646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-d5c03d72-5295-4968-ad04-bae48119eac6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:14.899646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:14.899646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:14.899646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:14.899646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:14.899646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:14.899646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:14.899646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:14.899646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:14.899646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:14.899646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:14.899646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:14.899646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:14.899646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:14.899646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:14.899646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:14.900545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:14.900545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:14.900545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:14.900545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:14.900545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:14.900545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:14.900545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:14.900545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:14.900545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:14.900545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:14.900545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:14.900545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:14.900545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:14.900545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:14.900545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:14.900545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:14.901323 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:14.901323 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:14.901323 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:14.901323 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:14.901323 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:14.901323 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:14.901323 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:14.901323 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:14.901323 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:14.901323 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:14.901323 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:14.901323 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:14.901323 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 280/545] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:14.906690 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c03d72-5295-4968-ad04-bae48119eac6 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:14.942555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:14.953094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 266/546] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:23:15.003193 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:15.070681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c03d72-5295-4968-ad04-bae48119eac6 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:15.119459 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f08fb-72d9-4998-a1e1-2771b2ba34b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:15.120063 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f08fb-72d9-4998-a1e1-2771b2ba34b8 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:15.120346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f08fb-72d9-4998-a1e1-2771b2ba34b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:15.120623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f08fb-72d9-4998-a1e1-2771b2ba34b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:15.121281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f08fb-72d9-4998-a1e1-2771b2ba34b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:15.121580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f08fb-72d9-4998-a1e1-2771b2ba34b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:15.122948 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f08fb-72d9-4998-a1e1-2771b2ba34b8 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:15.133717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 281/547] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:23:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:23:15.139375 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ac18d-d76e-4bb1-ae1d-9fafed3e1a6b None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:15.240057 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f08fb-72d9-4998-a1e1-2771b2ba34b8 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:15.256878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ac18d-d76e-4bb1-ae1d-9fafed3e1a6b None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:15.328417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc96f2-2ef9-4ba0-8ce3-e8515051a4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:15.329281 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc96f2-2ef9-4ba0-8ce3-e8515051a4da None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:15.329442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc96f2-2ef9-4ba0-8ce3-e8515051a4da None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:15.329683 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc96f2-2ef9-4ba0-8ce3-e8515051a4da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:15.348773 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc96f2-2ef9-4ba0-8ce3-e8515051a4da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:15.350237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc96f2-2ef9-4ba0-8ce3-e8515051a4da None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:15.374697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-8dcc96f2-2ef9-4ba0-8ce3-e8515051a4da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:15.374697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:15.374697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:15.374697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:15.374697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:15.374697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:15.374697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:15.374697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:15.374697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:15.374697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:15.374697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:15.374697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:15.374697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:15.374697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:15.374697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:15.374697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:15.377379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:15.377379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:15.377379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:15.377379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:15.377379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:15.377379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:15.377379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:15.377379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:15.377379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:15.377379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:15.377379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:15.377379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:15.377379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:15.377379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:15.377379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:15.377379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:15.377379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:15.379478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:15.379478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:15.379478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:15.379478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 267/548] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:15.380109 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f08fb-72d9-4998-a1e1-2771b2ba34b8 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:15.384222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc96f2-2ef9-4ba0-8ce3-e8515051a4da None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:15.394480 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:15.421457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a6f83-a350-4a0a-adc0-6435bfc7d154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:15.422353 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a6f83-a350-4a0a-adc0-6435bfc7d154 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:15.423201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a6f83-a350-4a0a-adc0-6435bfc7d154 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:15.423554 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a6f83-a350-4a0a-adc0-6435bfc7d154 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:15.435496 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a6f83-a350-4a0a-adc0-6435bfc7d154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:15.442103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-a32a6f83-a350-4a0a-adc0-6435bfc7d154 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:15.442103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:15.442103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:15.442103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:15.442103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:15.442103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:15.442103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:15.442103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:15.442103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:15.442103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:15.442103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:15.442103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:15.442103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:15.442103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:15.442103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:15.442103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:15.444717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:15.444717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:15.444717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:15.444717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:15.444717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:15.444717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:15.444717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:15.444717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:15.444717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:15.444717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:15.444717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:15.444717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:15.444717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:15.444717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:15.444717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:15.444717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:15.447137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:15.447137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:15.447137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:15.447137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:15.447137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:15.447137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:15.447137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:15.447137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:15.447137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:15.447137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:15.447137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:15.447137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:15.447137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 282/549] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:15.454882 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a6f83-a350-4a0a-adc0-6435bfc7d154 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:15.516114 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:15.566595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a6f83-a350-4a0a-adc0-6435bfc7d154 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:15.614165 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4ab80-0c4a-4817-8b23-f18f5cb6f839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:15.614768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4ab80-0c4a-4817-8b23-f18f5cb6f839 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:15.615068 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4ab80-0c4a-4817-8b23-f18f5cb6f839 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:15.615339 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4ab80-0c4a-4817-8b23-f18f5cb6f839 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:15.618192 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4ab80-0c4a-4817-8b23-f18f5cb6f839 None admin] RBAC: Adding query filter params (name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:15.618501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4ab80-0c4a-4817-8b23-f18f5cb6f839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:15.621445 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc96f2-2ef9-4ba0-8ce3-e8515051a4da None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:15.623190 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4ab80-0c4a-4817-8b23-f18f5cb6f839 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:15.641866 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 283/550] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:23:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:15.647375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4ab80-0c4a-4817-8b23-f18f5cb6f839 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:15.692617 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fdc7c-87de-4cf2-8b53-b803e93d1c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:15.693222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fdc7c-87de-4cf2-8b53-b803e93d1c70 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:15.693496 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fdc7c-87de-4cf2-8b53-b803e93d1c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:15.693763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fdc7c-87de-4cf2-8b53-b803e93d1c70 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:15.694406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fdc7c-87de-4cf2-8b53-b803e93d1c70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:15.694702 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fdc7c-87de-4cf2-8b53-b803e93d1c70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:15.699138 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fdc7c-87de-4cf2-8b53-b803e93d1c70 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:15.701850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:15.727714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 268/551] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:15.736400 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fdc7c-87de-4cf2-8b53-b803e93d1c70 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:15.797087 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4ab80-0c4a-4817-8b23-f18f5cb6f839 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:15.835299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811d1c9-3244-449d-b85e-16eb05a387c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:15.835938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811d1c9-3244-449d-b85e-16eb05a387c5 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:15.836312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811d1c9-3244-449d-b85e-16eb05a387c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:15.836603 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811d1c9-3244-449d-b85e-16eb05a387c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:15.848953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811d1c9-3244-449d-b85e-16eb05a387c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:15.850428 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811d1c9-3244-449d-b85e-16eb05a387c5 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:15.862254 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fdc7c-87de-4cf2-8b53-b803e93d1c70 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:15.874430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-d811d1c9-3244-449d-b85e-16eb05a387c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:15.874430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:15.874430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:15.874430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:15.874430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:15.874430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:15.874430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:15.874430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:15.874430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:15.874430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:15.874430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:15.874430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:15.874430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:15.874430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:15.874430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:15.874430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:15.877259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:15.877259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:15.877259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:15.877259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:15.877259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:15.877259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:15.877259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:15.877259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:15.877259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:15.877259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:15.877259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:15.877259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:15.877259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:15.877259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:15.877259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:15.877259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:15.877259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:15.879347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:15.879347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:15.879347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:15.879347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 284/552] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:15.882952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811d1c9-3244-449d-b85e-16eb05a387c5 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:15.886212 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:15.955629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b3241-31ff-4048-8299-1de97c553c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:15.956173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b3241-31ff-4048-8299-1de97c553c24 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:15.956453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b3241-31ff-4048-8299-1de97c553c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:15.956723 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b3241-31ff-4048-8299-1de97c553c24 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:15.964252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b3241-31ff-4048-8299-1de97c553c24 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:15.965803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b3241-31ff-4048-8299-1de97c553c24 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:15.975207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:15.979029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-431b3241-31ff-4048-8299-1de97c553c24 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 01:23:15.979029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:15.979029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:15.979029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:15.979029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:15.979029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:15.979029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:15.979029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:15.979029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:15.979029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:15.979029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:15.979029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:15.979029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:15.979029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:15.979029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:15.979029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:15.982578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:15.982578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:15.982578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:15.982578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:15.982578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:15.982578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:15.982578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:15.982578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:15.982578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:15.982578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:15.982578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:15.982578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:15.982578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:15.982578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:15.982578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:15.982578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:15.982578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:15.982578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:15.985271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:15.985271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:15.985271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:15.985271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:15.985271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:15.985271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:15.985271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:15.985271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:15.985271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 01:23:15.985271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:15.985271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 269/553] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:23:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:15.985271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb15e7-2298-417f-aeb7-b9371cf349ff None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:15.985271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb15e7-2298-417f-aeb7-b9371cf349ff None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:15.986902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb15e7-2298-417f-aeb7-b9371cf349ff None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:15.990857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 270/554] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:15.990857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807390e-5cfd-45f2-a5a0-cb78cc43f882 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:15.990857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807390e-5cfd-45f2-a5a0-cb78cc43f882 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:15.990857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807390e-5cfd-45f2-a5a0-cb78cc43f882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:15.999105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811d1c9-3244-449d-b85e-16eb05a387c5 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:16.015387 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-3807390e-5cfd-45f2-a5a0-cb78cc43f882 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:16.016971 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3807390e-5cfd-45f2-a5a0-cb78cc43f882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:16.036005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b12f7-d8eb-4e22-b782-0d2e3b80891b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:16.036679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b12f7-d8eb-4e22-b782-0d2e3b80891b None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:16.036961 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b12f7-d8eb-4e22-b782-0d2e3b80891b None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:16.037240 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b12f7-d8eb-4e22-b782-0d2e3b80891b None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:16.037878 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b12f7-d8eb-4e22-b782-0d2e3b80891b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:16.038180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b12f7-d8eb-4e22-b782-0d2e3b80891b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:16.039970 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b12f7-d8eb-4e22-b782-0d2e3b80891b None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:16.057541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 285/555] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:16.058451 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b12f7-d8eb-4e22-b782-0d2e3b80891b None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:16.106929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 271/556] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:23:16.107865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807390e-5cfd-45f2-a5a0-cb78cc43f882 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:16.220012 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b12f7-d8eb-4e22-b782-0d2e3b80891b None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:16.294601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd1477-fe0a-4689-a1c7-f1aaa0f74956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:16.295750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd1477-fe0a-4689-a1c7-f1aaa0f74956 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:16.295750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd1477-fe0a-4689-a1c7-f1aaa0f74956 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:16.295917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd1477-fe0a-4689-a1c7-f1aaa0f74956 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:16.296721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd1477-fe0a-4689-a1c7-f1aaa0f74956 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:16.296842 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd1477-fe0a-4689-a1c7-f1aaa0f74956 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:16.299111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd1477-fe0a-4689-a1c7-f1aaa0f74956 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:16.302751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807390e-5cfd-45f2-a5a0-cb78cc43f882 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:16.304325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:16.327705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 286/557] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Sep 26 01:23:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:16.328954 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6e17f-c8b3-43c0-a730-a68a5c8a3e8f None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:16.329242 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6e17f-c8b3-43c0-a730-a68a5c8a3e8f None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:16.329515 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6e17f-c8b3-43c0-a730-a68a5c8a3e8f None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:16.331223 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 287/558] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:16.335785 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6e17f-c8b3-43c0-a730-a68a5c8a3e8f None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:16.339733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:16.355286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789226c4-63b5-423e-93f7-2bdfca95202d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:16.356767 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789226c4-63b5-423e-93f7-2bdfca95202d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:16.357673 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789226c4-63b5-423e-93f7-2bdfca95202d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:16.358283 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789226c4-63b5-423e-93f7-2bdfca95202d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:16.368976 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789226c4-63b5-423e-93f7-2bdfca95202d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:16.371620 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789226c4-63b5-423e-93f7-2bdfca95202d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:16.387392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-789226c4-63b5-423e-93f7-2bdfca95202d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 01:23:16.387392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:16.387392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:16.387392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:16.387392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:16.387392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:16.387392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:16.387392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:16.387392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:16.387392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:16.387392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:16.387392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:16.387392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:16.387392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:16.387392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:16.387392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:16.388449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:16.388449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:16.388449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:16.388449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:16.388449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:16.388449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:16.388449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:16.388449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:16.388449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:16.388449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:16.388449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:16.388449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:16.388449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:16.388449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:16.388449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:16.388449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:16.388449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:16.388449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:16.389396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:16.389396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:16.389396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:16.389396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:16.389396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:16.389396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:16.389396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:16.389396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:16.389396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 01:23:16.389396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:16.398545 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 272/559] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 26 01:23:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:16.400565 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a81627-f4d0-4a2e-86f0-7b8f997a0e46 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:16.401059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a81627-f4d0-4a2e-86f0-7b8f997a0e46 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:16.401742 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a81627-f4d0-4a2e-86f0-7b8f997a0e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:16.427886 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-48a81627-f4d0-4a2e-86f0-7b8f997a0e46 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:16.429353 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-48a81627-f4d0-4a2e-86f0-7b8f997a0e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:16.461894 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6e17f-c8b3-43c0-a730-a68a5c8a3e8f None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:16.498910 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227867b-31be-4a05-b2c2-649bd93084b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:16.499589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227867b-31be-4a05-b2c2-649bd93084b4 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:16.499806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227867b-31be-4a05-b2c2-649bd93084b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:16.500075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227867b-31be-4a05-b2c2-649bd93084b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:16.507030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 273/560] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:16.507030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a81627-f4d0-4a2e-86f0-7b8f997a0e46 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:16.593474 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227867b-31be-4a05-b2c2-649bd93084b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:16.596207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227867b-31be-4a05-b2c2-649bd93084b4 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:16.598308 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:16.634794 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:16.645647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a81627-f4d0-4a2e-86f0-7b8f997a0e46 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:16.687394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90872550-c4ff-4af2-81df-e3ade67d35f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:16.688882 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90872550-c4ff-4af2-81df-e3ade67d35f7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:16.689551 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90872550-c4ff-4af2-81df-e3ade67d35f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:16.689827 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90872550-c4ff-4af2-81df-e3ade67d35f7 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:16.690559 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90872550-c4ff-4af2-81df-e3ade67d35f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:16.690911 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90872550-c4ff-4af2-81df-e3ade67d35f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:16.692331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90872550-c4ff-4af2-81df-e3ade67d35f7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:16.718103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 288/561] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:23:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:23:16.718103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227867b-31be-4a05-b2c2-649bd93084b4 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:16.718710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 274/562] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 26 01:23:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:16.718710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab990041-056e-4157-8038-9f3a28a04c7d None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:16.718710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab990041-056e-4157-8038-9f3a28a04c7d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:16.718710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab990041-056e-4157-8038-9f3a28a04c7d None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:16.719247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 275/563] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:16.720146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab990041-056e-4157-8038-9f3a28a04c7d None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:16.826259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227867b-31be-4a05-b2c2-649bd93084b4 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:16.827812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:16.830256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab990041-056e-4157-8038-9f3a28a04c7d None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:16.861222 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e59728-7a7b-48f8-9c49-bfdff4b09a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:16.861774 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e59728-7a7b-48f8-9c49-bfdff4b09a59 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:16.862050 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e59728-7a7b-48f8-9c49-bfdff4b09a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:16.862320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e59728-7a7b-48f8-9c49-bfdff4b09a59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:16.862413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def948fc-b583-4e59-ad16-a44033e7fad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:16.863014 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def948fc-b583-4e59-ad16-a44033e7fad3 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:16.863287 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def948fc-b583-4e59-ad16-a44033e7fad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:16.863554 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def948fc-b583-4e59-ad16-a44033e7fad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:16.872177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e59728-7a7b-48f8-9c49-bfdff4b09a59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:16.874930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def948fc-b583-4e59-ad16-a44033e7fad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:16.877070 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def948fc-b583-4e59-ad16-a44033e7fad3 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:16.878015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-94e59728-7a7b-48f8-9c49-bfdff4b09a59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:16.878015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:16.878015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:16.878015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:16.878015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:16.878015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:16.878015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:16.878015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:16.878015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:16.878015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:16.878015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:16.878015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:16.878015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:16.878015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:16.878015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:16.878015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:16.879022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:16.879022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:16.879022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:16.879022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:16.879022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:16.879022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:16.879022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:16.879022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:16.879022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:16.879022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:16.879022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:16.879022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:16.879022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:16.879022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:16.879022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:16.879022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:16.879943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:16.879943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:16.879943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:16.879943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:16.879943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:16.879943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:16.879943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:16.879943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:16.879943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:16.879943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:16.879943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:16.879943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:16.879943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 289/564] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:16.879943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e59728-7a7b-48f8-9c49-bfdff4b09a59 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:16.892981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-def948fc-b583-4e59-ad16-a44033e7fad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:16.892981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:16.892981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:16.892981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:16.892981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:16.892981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:16.892981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:16.892981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:16.892981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:16.892981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:16.892981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:16.892981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:16.892981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:16.892981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:16.892981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:16.892981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:16.894142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:16.894142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:16.894142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:16.894142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:16.894142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:16.894142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:16.894142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:16.894142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:16.894142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:16.894142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:16.894142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:16.894142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:16.894142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:16.894142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:16.894142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:16.894142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:16.894142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:16.895273 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:16.895273 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:16.895273 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:16.896619 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 276/565] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:16.897886 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b1ffd-c285-4eb5-87f4-d99c495caa94 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:16.898171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b1ffd-c285-4eb5-87f4-d99c495caa94 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:16.898444 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b1ffd-c285-4eb5-87f4-d99c495caa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:16.904666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:16.917269 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-de1b1ffd-c285-4eb5-87f4-d99c495caa94 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:16.918452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-de1b1ffd-c285-4eb5-87f4-d99c495caa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:16.983059 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e59728-7a7b-48f8-9c49-bfdff4b09a59 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:16.984069 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 277/566] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:16.984886 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b1ffd-c285-4eb5-87f4-d99c495caa94 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:17.021109 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5013d-3750-4bdf-a096-d60b0b0094d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:17.021736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5013d-3750-4bdf-a096-d60b0b0094d4 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:17.022019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5013d-3750-4bdf-a096-d60b0b0094d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:17.022296 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5013d-3750-4bdf-a096-d60b0b0094d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:17.032341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5013d-3750-4bdf-a096-d60b0b0094d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:17.034333 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5013d-3750-4bdf-a096-d60b0b0094d4 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:17.050347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-b0e5013d-3750-4bdf-a096-d60b0b0094d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:17.050347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:17.050347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:17.050347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:17.050347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:17.050347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:17.050347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:17.050347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:17.050347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:17.050347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:17.050347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:17.050347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:17.050347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:17.050347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:17.050347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:17.050347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:17.051534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:17.051534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:17.051534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:17.051534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:17.051534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:17.051534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:17.051534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:17.051534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:17.051534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:17.051534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:17.051534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:17.051534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:17.051534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:17.051534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:17.051534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:17.051534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:17.051534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:17.052466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:17.052466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:17.052466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:17.052466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 290/567] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:17.052466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5013d-3750-4bdf-a096-d60b0b0094d4 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:17.070845 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:17.101745 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b1ffd-c285-4eb5-87f4-d99c495caa94 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:17.132055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:17.137633 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16442f51-7f0f-401a-a335-ea114a28e1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:17.138258 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16442f51-7f0f-401a-a335-ea114a28e1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:17.138782 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16442f51-7f0f-401a-a335-ea114a28e1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:17.138782 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16442f51-7f0f-401a-a335-ea114a28e1a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:17.149778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16442f51-7f0f-401a-a335-ea114a28e1a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:17.154555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-16442f51-7f0f-401a-a335-ea114a28e1a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:17.154555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:17.154555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:17.154555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:17.154555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:17.154555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:17.154555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:17.154555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:17.154555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:17.154555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:17.154555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:17.154555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:17.154555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:17.154555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:17.154555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:17.154555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:17.155484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:17.155484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:17.155484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:17.155484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:17.155484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:17.155484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:17.155484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:17.155484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:17.155484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:17.155484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:17.155484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:17.155484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:17.155484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:17.155484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:17.155484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:17.155484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:17.156325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:17.156325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:17.156325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:17.156325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:17.156325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:17.156325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:17.156325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:17.156325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:17.156325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:17.156325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:17.156325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:17.156325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:17.156325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 278/568] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:17.157598 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16442f51-7f0f-401a-a335-ea114a28e1a1 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:17.168865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5013d-3750-4bdf-a096-d60b0b0094d4 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:17.204712 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2097be-c26c-4afc-95b8-564898f7116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:17.205360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2097be-c26c-4afc-95b8-564898f7116c None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:17.205636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2097be-c26c-4afc-95b8-564898f7116c None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:17.205959 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2097be-c26c-4afc-95b8-564898f7116c None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:17.206611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2097be-c26c-4afc-95b8-564898f7116c None admin] RBAC: Adding query filter params (name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:17.206943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2097be-c26c-4afc-95b8-564898f7116c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:17.208291 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2097be-c26c-4afc-95b8-564898f7116c None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:17.216369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 291/569] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:23:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:17.217149 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2097be-c26c-4afc-95b8-564898f7116c None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:17.267399 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16442f51-7f0f-401a-a335-ea114a28e1a1 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:17.295541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:17.301791 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb2ec9-1221-4e23-88e9-13b19f134a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:17.302395 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb2ec9-1221-4e23-88e9-13b19f134a7b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:17.302673 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb2ec9-1221-4e23-88e9-13b19f134a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:17.302980 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb2ec9-1221-4e23-88e9-13b19f134a7b None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:17.303621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb2ec9-1221-4e23-88e9-13b19f134a7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:17.303925 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb2ec9-1221-4e23-88e9-13b19f134a7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:17.305283 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb2ec9-1221-4e23-88e9-13b19f134a7b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:17.317560 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 279/570] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:17.318349 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb2ec9-1221-4e23-88e9-13b19f134a7b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:17.320928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2097be-c26c-4afc-95b8-564898f7116c None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:17.354099 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe3848-a32c-491a-bcbc-a768c10280cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:17.354696 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe3848-a32c-491a-bcbc-a768c10280cc None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:17.355013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe3848-a32c-491a-bcbc-a768c10280cc None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:17.355300 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe3848-a32c-491a-bcbc-a768c10280cc None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:17.355935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe3848-a32c-491a-bcbc-a768c10280cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:17.356240 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe3848-a32c-491a-bcbc-a768c10280cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:17.357589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe3848-a32c-491a-bcbc-a768c10280cc None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:17.369705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 292/571] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:17.370660 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe3848-a32c-491a-bcbc-a768c10280cc None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:17.373497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:17.422096 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb2ec9-1221-4e23-88e9-13b19f134a7b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:17.457179 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269d26e-8322-496d-b5a5-ab930813eb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:17.457783 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269d26e-8322-496d-b5a5-ab930813eb19 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:17.458067 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269d26e-8322-496d-b5a5-ab930813eb19 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:17.458346 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269d26e-8322-496d-b5a5-ab930813eb19 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:17.459045 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269d26e-8322-496d-b5a5-ab930813eb19 None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:17.459350 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269d26e-8322-496d-b5a5-ab930813eb19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:17.460710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269d26e-8322-496d-b5a5-ab930813eb19 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:17.467711 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe3848-a32c-491a-bcbc-a768c10280cc None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:17.468470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 280/572] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:23:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:17.469247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269d26e-8322-496d-b5a5-ab930813eb19 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:17.506581 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ff054-9fba-47dd-ae52-754828c33fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:17.507221 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ff054-9fba-47dd-ae52-754828c33fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:17.507498 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ff054-9fba-47dd-ae52-754828c33fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:17.507766 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ff054-9fba-47dd-ae52-754828c33fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:17.510418 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:17.518298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ff054-9fba-47dd-ae52-754828c33fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:17.519761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ff054-9fba-47dd-ae52-754828c33fc3 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:17.534650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-f21ff054-9fba-47dd-ae52-754828c33fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:17.534650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:17.534650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:17.534650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:17.534650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:17.534650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:17.534650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:17.534650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:17.534650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:17.534650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:17.534650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:17.534650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:17.534650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:17.534650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:17.534650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:17.534650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:17.535637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:17.535637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:17.535637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:17.535637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:17.535637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:17.535637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:17.535637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:17.535637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:17.535637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:17.535637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:17.535637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:17.535637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:17.535637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:17.535637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:17.535637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:17.535637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:17.535637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:17.536629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:17.536629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:17.536629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:17.536629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 293/573] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:17.536629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ff054-9fba-47dd-ae52-754828c33fc3 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:17.571960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269d26e-8322-496d-b5a5-ab930813eb19 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:17.585194 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:17.605632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2221cc-15b3-4b2b-a087-f42e83fbbb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:17.606250 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2221cc-15b3-4b2b-a087-f42e83fbbb37 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:17.606525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2221cc-15b3-4b2b-a087-f42e83fbbb37 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:17.606793 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2221cc-15b3-4b2b-a087-f42e83fbbb37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:17.616715 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2221cc-15b3-4b2b-a087-f42e83fbbb37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:17.621855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-1d2221cc-15b3-4b2b-a087-f42e83fbbb37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:17.621855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:17.621855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:17.621855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:17.621855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:17.621855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:17.621855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:17.621855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:17.621855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:17.621855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:17.621855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:17.621855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:17.621855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:17.621855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:17.621855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:17.621855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:17.622734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:17.622734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:17.622734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:17.622734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:17.622734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:17.622734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:17.622734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:17.622734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:17.622734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:17.622734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:17.622734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:17.622734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:17.622734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:17.622734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:17.622734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:17.622734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:17.623606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:17.623606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:17.623606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:17.623606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:17.623606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:17.623606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:17.623606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:17.623606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:17.623606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:17.623606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:17.623606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:17.623606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:17.623606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 281/574] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:17.624635 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2221cc-15b3-4b2b-a087-f42e83fbbb37 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:17.641741 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ff054-9fba-47dd-ae52-754828c33fc3 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:17.675224 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15552971-7eeb-4267-bbfd-792eda72cf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:17.675779 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15552971-7eeb-4267-bbfd-792eda72cf8b None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:17.676060 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15552971-7eeb-4267-bbfd-792eda72cf8b None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:17.676331 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15552971-7eeb-4267-bbfd-792eda72cf8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:17.682933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15552971-7eeb-4267-bbfd-792eda72cf8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:17.684352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15552971-7eeb-4267-bbfd-792eda72cf8b None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:17.695649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-15552971-7eeb-4267-bbfd-792eda72cf8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:17.695649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:17.695649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:17.695649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:17.695649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:17.695649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:17.695649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:17.695649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:17.695649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:17.695649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:17.695649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:17.695649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:17.695649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:17.695649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:17.695649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:17.696514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:17.696514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:17.696514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:17.696514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:17.696514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:17.696514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:17.696514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:17.696514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:17.696514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:17.696514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:17.696514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:17.696514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:17.696514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:17.696514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:17.696514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:17.696514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:17.696514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:17.697383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:17.697383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:17.697383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:17.697383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:17.697383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:17.697383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:17.697383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:17.697383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:17.697383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 294/575] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:17.697865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15552971-7eeb-4267-bbfd-792eda72cf8b None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:17.723342 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2221cc-15b3-4b2b-a087-f42e83fbbb37 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:17.745139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:17.756187 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7c4ba-d468-480c-8933-cd8c6b561d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:17.756808 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7c4ba-d468-480c-8933-cd8c6b561d10 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:17.757088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7c4ba-d468-480c-8933-cd8c6b561d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:17.757360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7c4ba-d468-480c-8933-cd8c6b561d10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:17.764711 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7c4ba-d468-480c-8933-cd8c6b561d10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:17.766140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7c4ba-d468-480c-8933-cd8c6b561d10 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:17.778602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-bda7c4ba-d468-480c-8933-cd8c6b561d10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:17.778602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:17.778602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:17.778602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:17.778602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:17.778602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:17.778602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:17.778602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:17.778602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:17.778602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:17.778602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:17.778602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:17.778602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:17.778602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:17.778602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:17.779579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:17.779579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:17.779579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:17.779579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:17.779579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:17.779579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:17.779579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:17.779579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:17.779579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:17.779579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:17.779579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:17.779579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:17.779579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:17.779579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:17.779579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:17.779579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:17.779579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:17.780473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:17.780473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:17.780473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:17.780473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:17.780473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:17.780473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:17.780473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:17.780473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:17.780473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 282/576] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:17.780963 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7c4ba-d468-480c-8933-cd8c6b561d10 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:17.800457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15552971-7eeb-4267-bbfd-792eda72cf8b None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:17.824658 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:17.833798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ffebb-2e38-41f0-9352-76aaee39af33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:17.834421 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ffebb-2e38-41f0-9352-76aaee39af33 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:17.834695 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ffebb-2e38-41f0-9352-76aaee39af33 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:17.835002 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ffebb-2e38-41f0-9352-76aaee39af33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:17.846585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ffebb-2e38-41f0-9352-76aaee39af33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:17.848036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ffebb-2e38-41f0-9352-76aaee39af33 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:17.861612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-b23ffebb-2e38-41f0-9352-76aaee39af33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:17.861612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:17.861612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:17.861612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:17.861612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:17.861612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:17.861612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:17.861612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:17.861612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:17.861612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:17.861612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:17.861612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:17.861612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:17.861612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:17.861612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:17.861612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:17.862674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:17.862674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:17.862674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:17.862674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:17.862674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:17.862674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:17.862674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:17.862674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:17.862674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:17.862674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:17.862674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:17.862674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:17.862674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:17.862674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:17.862674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:17.862674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:17.862674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:17.863650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:17.863650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:17.863650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:17.863650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 295/577] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:17.863650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ffebb-2e38-41f0-9352-76aaee39af33 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:17.892408 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7c4ba-d468-480c-8933-cd8c6b561d10 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:17.925580 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdd216-c712-42cd-b337-5c8dc38da0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:17.926164 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdd216-c712-42cd-b337-5c8dc38da0ab None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:17.926381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdd216-c712-42cd-b337-5c8dc38da0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:17.926652 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdd216-c712-42cd-b337-5c8dc38da0ab None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:17.927316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cdd216-c712-42cd-b337-5c8dc38da0ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:17.927614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cdd216-c712-42cd-b337-5c8dc38da0ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:17.928971 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cdd216-c712-42cd-b337-5c8dc38da0ab None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:17.940439 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 283/578] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:17.941313 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdd216-c712-42cd-b337-5c8dc38da0ab None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:17.960874 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:17.963811 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ffebb-2e38-41f0-9352-76aaee39af33 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:17.998120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb28f30-3050-44bd-90ba-9b8868c1e1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:17.998692 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb28f30-3050-44bd-90ba-9b8868c1e1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:17.999000 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb28f30-3050-44bd-90ba-9b8868c1e1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:17.999271 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb28f30-3050-44bd-90ba-9b8868c1e1b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:17.999950 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb28f30-3050-44bd-90ba-9b8868c1e1b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:18.000246 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb28f30-3050-44bd-90ba-9b8868c1e1b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:18.001591 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb28f30-3050-44bd-90ba-9b8868c1e1b2 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:18.009538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 296/579] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:23:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:18.010320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb28f30-3050-44bd-90ba-9b8868c1e1b2 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:18.038172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:18.044667 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdd216-c712-42cd-b337-5c8dc38da0ab None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:18.079868 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1bfbf-daf5-401c-a9a9-e6326be5b155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:18.080479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1bfbf-daf5-401c-a9a9-e6326be5b155 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:18.080759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1bfbf-daf5-401c-a9a9-e6326be5b155 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:18.081033 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1bfbf-daf5-401c-a9a9-e6326be5b155 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:18.081718 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1bfbf-daf5-401c-a9a9-e6326be5b155 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:18.082023 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1bfbf-daf5-401c-a9a9-e6326be5b155 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:18.083491 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1bfbf-daf5-401c-a9a9-e6326be5b155 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:18.095199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 284/580] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:18.095981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1bfbf-daf5-401c-a9a9-e6326be5b155 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:18.111117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb28f30-3050-44bd-90ba-9b8868c1e1b2 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:18.144425 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681522a-207f-4aaf-8652-ac1db9861489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:18.145023 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681522a-207f-4aaf-8652-ac1db9861489 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:18.145300 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681522a-207f-4aaf-8652-ac1db9861489 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:18.145574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681522a-207f-4aaf-8652-ac1db9861489 None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:18.146252 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681522a-207f-4aaf-8652-ac1db9861489 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:18.146551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681522a-207f-4aaf-8652-ac1db9861489 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:18.147984 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681522a-207f-4aaf-8652-ac1db9861489 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:18.165572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 297/581] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:18.166362 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681522a-207f-4aaf-8652-ac1db9861489 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:18.192197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:18.196634 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1bfbf-daf5-401c-a9a9-e6326be5b155 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:18.229970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d9fed-6bd7-4c47-856d-93909c5d009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:18.230571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d9fed-6bd7-4c47-856d-93909c5d009a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:18.230874 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d9fed-6bd7-4c47-856d-93909c5d009a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:18.231151 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d9fed-6bd7-4c47-856d-93909c5d009a None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:18.231781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d9fed-6bd7-4c47-856d-93909c5d009a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:18.232083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d9fed-6bd7-4c47-856d-93909c5d009a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:18.233446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d9fed-6bd7-4c47-856d-93909c5d009a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:18.245417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 285/582] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:18.246194 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d9fed-6bd7-4c47-856d-93909c5d009a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:18.260959 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:18.268024 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681522a-207f-4aaf-8652-ac1db9861489 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:18.302374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c6d9b-e4b2-413e-9b90-ddd8845feb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:18.303018 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c6d9b-e4b2-413e-9b90-ddd8845feb6c None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:18.303294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c6d9b-e4b2-413e-9b90-ddd8845feb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:18.303562 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c6d9b-e4b2-413e-9b90-ddd8845feb6c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:18.310374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c6d9b-e4b2-413e-9b90-ddd8845feb6c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:18.311805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c6d9b-e4b2-413e-9b90-ddd8845feb6c None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:18.323519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-105c6d9b-e4b2-413e-9b90-ddd8845feb6c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 01:23:18.323519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:18.323519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:18.323519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:18.323519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:18.323519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:18.323519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:18.323519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:18.323519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:18.323519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:18.323519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:18.323519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:18.323519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:18.323519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:18.323519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:18.323519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:18.324617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:18.324617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:18.324617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:18.324617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:18.324617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:18.324617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:18.324617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:18.324617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:18.324617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:18.324617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:18.324617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:18.324617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:18.324617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:18.324617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:18.324617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:18.324617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:18.324617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:18.324617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:18.325763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:18.325763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:18.325763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:18.325763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:18.325763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:18.325763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:18.325763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:18.325763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:18.325763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 01:23:18.325763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:18.325763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 298/583] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:18.325763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c6d9b-e4b2-413e-9b90-ddd8845feb6c None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:18.348349 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d9fed-6bd7-4c47-856d-93909c5d009a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:18.381296 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc679e3-8502-454b-ade4-225edea9279b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:18.381894 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc679e3-8502-454b-ade4-225edea9279b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:18.382170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc679e3-8502-454b-ade4-225edea9279b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:18.382440 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc679e3-8502-454b-ade4-225edea9279b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:18.392341 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc679e3-8502-454b-ade4-225edea9279b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:18.393777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc679e3-8502-454b-ade4-225edea9279b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:18.409079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-8cc679e3-8502-454b-ade4-225edea9279b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:18.409079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:18.409079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:18.409079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:18.409079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:18.409079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:18.409079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:18.409079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:18.409079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:18.409079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:18.409079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:18.409079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:18.409079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:18.409079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:18.409079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:18.409079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:18.410159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:18.410159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:18.410159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:18.410159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:18.410159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:18.410159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:18.410159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:18.410159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:18.410159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:18.410159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:18.410159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:18.410159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:18.410159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:18.410159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:18.410159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:18.410159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:18.410159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:18.411075 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:18.411075 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:18.411075 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:18.412204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:18.414922 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 286/584] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:18.415743 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc679e3-8502-454b-ade4-225edea9279b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:18.432652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c6d9b-e4b2-413e-9b90-ddd8845feb6c None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:18.470662 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80018e6-74c3-49d5-b295-971b84c9b53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:18.471345 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80018e6-74c3-49d5-b295-971b84c9b53a None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:18.471621 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80018e6-74c3-49d5-b295-971b84c9b53a None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:18.471897 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80018e6-74c3-49d5-b295-971b84c9b53a None admin] PATH_INFO: `/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/3d6eaeb6bced49afabc7bdaa5e7cecfb/roles/8801886a5f4e4695a29b60c6eb347932` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:18.482648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:18.486650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80018e6-74c3-49d5-b295-971b84c9b53a None admin] RBAC: Authorizing `identity:create_grant(project_id=0fda1727cc3d47b9a1fae73c74f32c27, user_id=3d6eaeb6bced49afabc7bdaa5e7cecfb, role_id=8801886a5f4e4695a29b60c6eb347932)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:18.488108 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80018e6-74c3-49d5-b295-971b84c9b53a None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:18.500843 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 299/585] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:23:18 2022] PUT /identity/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/3d6eaeb6bced49afabc7bdaa5e7cecfb/roles/8801886a5f4e4695a29b60c6eb347932 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:23:18.501760 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80018e6-74c3-49d5-b295-971b84c9b53a None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:18.534782 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc679e3-8502-454b-ade4-225edea9279b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:18.573992 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a08a5-18ac-4191-bc2f-26ff60c7e176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:18.574726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a08a5-18ac-4191-bc2f-26ff60c7e176 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:18.575033 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a08a5-18ac-4191-bc2f-26ff60c7e176 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:18.575309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a08a5-18ac-4191-bc2f-26ff60c7e176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:18.576137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a08a5-18ac-4191-bc2f-26ff60c7e176 None admin] RBAC: Adding query filter params (role.id=8801886a5f4e4695a29b60c6eb347932, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=c924da83d1a94c49814d2e7b5969c8e9) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:18.576452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a08a5-18ac-4191-bc2f-26ff60c7e176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:18.578055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a08a5-18ac-4191-bc2f-26ff60c7e176 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:18.584986 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 287/586] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:23:18 2022] GET /identity/v3/role_assignments?user.id=c924da83d1a94c49814d2e7b5969c8e9&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=8801886a5f4e4695a29b60c6eb347932 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:18.585823 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a08a5-18ac-4191-bc2f-26ff60c7e176 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:18.647583 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80018e6-74c3-49d5-b295-971b84c9b53a None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:18.695573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:18.713207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd71b0-0e7e-491f-8dcc-7d37a1d925c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:18.713933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd71b0-0e7e-491f-8dcc-7d37a1d925c0 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:18.714205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd71b0-0e7e-491f-8dcc-7d37a1d925c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:18.714476 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd71b0-0e7e-491f-8dcc-7d37a1d925c0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:18.724455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd71b0-0e7e-491f-8dcc-7d37a1d925c0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:18.725849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd71b0-0e7e-491f-8dcc-7d37a1d925c0 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:18.730870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a08a5-18ac-4191-bc2f-26ff60c7e176 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:18.741289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-53fd71b0-0e7e-491f-8dcc-7d37a1d925c0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 01:23:18.741289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:18.741289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:18.741289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:18.741289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:18.741289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:18.741289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:18.741289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:18.741289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:18.741289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:18.741289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:18.741289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:18.741289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:18.741289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:18.741289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:18.741289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:18.742298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:18.742298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:18.742298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:18.742298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:18.742298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:18.742298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:18.742298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:18.742298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:18.742298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:18.742298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:18.742298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:18.742298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:18.742298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:18.742298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:18.742298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:18.742298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:18.742298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:18.742298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:18.743675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:18.743675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:18.743675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:18.743675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:18.743675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:18.743675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:18.743675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:18.743675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:18.743675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 01:23:18.743675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:18.743675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 300/587] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:23:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:18.743675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd71b0-0e7e-491f-8dcc-7d37a1d925c0 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:18.777049 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:18.787435 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89072b93-6a74-43b4-8df4-e6f93d88db8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:18.788521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89072b93-6a74-43b4-8df4-e6f93d88db8f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:18.789056 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89072b93-6a74-43b4-8df4-e6f93d88db8f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:18.789573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89072b93-6a74-43b4-8df4-e6f93d88db8f None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:18.790481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89072b93-6a74-43b4-8df4-e6f93d88db8f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:18.791030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89072b93-6a74-43b4-8df4-e6f93d88db8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:18.792626 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89072b93-6a74-43b4-8df4-e6f93d88db8f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:18.811156 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 288/588] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Sep 26 01:23:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:18.812393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89072b93-6a74-43b4-8df4-e6f93d88db8f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:18.879549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd71b0-0e7e-491f-8dcc-7d37a1d925c0 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:18.921135 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89072b93-6a74-43b4-8df4-e6f93d88db8f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:18.924599 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77187de6-1ed0-45ee-b032-72d06897ed15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:18.925408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77187de6-1ed0-45ee-b032-72d06897ed15 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:18.925840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77187de6-1ed0-45ee-b032-72d06897ed15 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:18.926253 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77187de6-1ed0-45ee-b032-72d06897ed15 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:18.927052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77187de6-1ed0-45ee-b032-72d06897ed15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:18.927493 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77187de6-1ed0-45ee-b032-72d06897ed15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:18.928996 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77187de6-1ed0-45ee-b032-72d06897ed15 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:18.950725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 301/589] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:18.952426 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77187de6-1ed0-45ee-b032-72d06897ed15 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:18.960613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7cbe5-898e-483f-abed-8efe8b09b4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:18.961306 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7cbe5-898e-483f-abed-8efe8b09b4ae None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:18.961652 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7cbe5-898e-483f-abed-8efe8b09b4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:18.961990 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7cbe5-898e-483f-abed-8efe8b09b4ae None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:18.962855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7cbe5-898e-483f-abed-8efe8b09b4ae None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:18.963440 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7cbe5-898e-483f-abed-8efe8b09b4ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:18.964878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7cbe5-898e-483f-abed-8efe8b09b4ae None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:18.986093 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 289/590] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Sep 26 01:23:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:18.991539 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7cbe5-898e-483f-abed-8efe8b09b4ae None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:19.022530 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:19.053706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:19.092171 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77187de6-1ed0-45ee-b032-72d06897ed15 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:19.113842 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7cbe5-898e-483f-abed-8efe8b09b4ae None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:19.139129 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868d7da-5fa8-4e91-a7b2-54c5fd32f947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:19.139778 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868d7da-5fa8-4e91-a7b2-54c5fd32f947 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:19.140055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868d7da-5fa8-4e91-a7b2-54c5fd32f947 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:19.140326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868d7da-5fa8-4e91-a7b2-54c5fd32f947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:19.154433 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868d7da-5fa8-4e91-a7b2-54c5fd32f947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:19.155904 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868d7da-5fa8-4e91-a7b2-54c5fd32f947 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:19.159419 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e8e85-08c2-4aaf-b83e-e260d5e0d6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:19.160286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e8e85-08c2-4aaf-b83e-e260d5e0d6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:19.160760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e8e85-08c2-4aaf-b83e-e260d5e0d6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:19.161238 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e8e85-08c2-4aaf-b83e-e260d5e0d6a1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:19.170242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e8e85-08c2-4aaf-b83e-e260d5e0d6a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:19.171569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-a868d7da-5fa8-4e91-a7b2-54c5fd32f947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:19.171569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:19.171569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:19.171569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:19.171569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:19.171569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:19.171569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:19.171569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:19.171569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:19.171569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:19.171569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:19.171569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:19.171569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:19.171569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:19.171569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:19.171569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:19.172536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:19.172536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:19.172536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:19.172536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:19.172536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:19.172536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:19.172536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:19.172536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:19.172536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:19.172536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:19.172536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:19.172536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:19.172536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:19.172536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:19.172536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:19.172536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:19.172536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:19.173932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:19.173932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:19.173932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:19.173932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 302/591] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:19.174193 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868d7da-5fa8-4e91-a7b2-54c5fd32f947 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:19.175483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e8e85-08c2-4aaf-b83e-e260d5e0d6a1 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:19.191028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-3a3e8e85-08c2-4aaf-b83e-e260d5e0d6a1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 26 01:23:19.191028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:19.191028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:19.191028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:19.191028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:19.191028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:19.191028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:19.191028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:19.191028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:19.191028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:19.191028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:19.191028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:19.191028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:19.191028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:19.191028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:19.191028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:19.192018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:19.192018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:19.192018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:19.192018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:19.192018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:19.192018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:19.192018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:19.192018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:19.192018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:19.192018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:19.192018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:19.192018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:19.192018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:19.192018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:19.192018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:19.192018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:19.192018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:19.192018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:19.192970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:19.192970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:19.192970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:19.192970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:19.192970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:19.192970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:19.192970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:19.192970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:19.192970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 26 01:23:19.192970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:19.200419 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 290/592] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:23:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:19.200419 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e8e85-08c2-4aaf-b83e-e260d5e0d6a1 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:19.305458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868d7da-5fa8-4e91-a7b2-54c5fd32f947 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:19.308645 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:19.325959 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e8e85-08c2-4aaf-b83e-e260d5e0d6a1 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:19.336220 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:19.346472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7caab86-fc8b-433c-8f2f-970745094e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:19.347606 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7caab86-fc8b-433c-8f2f-970745094e0f None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:19.347606 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7caab86-fc8b-433c-8f2f-970745094e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:19.347975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7caab86-fc8b-433c-8f2f-970745094e0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:19.359579 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7caab86-fc8b-433c-8f2f-970745094e0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:19.361749 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7caab86-fc8b-433c-8f2f-970745094e0f None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:19.372790 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2a4e4-1381-4fdb-b225-24b380a2c03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:19.373628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2a4e4-1381-4fdb-b225-24b380a2c03a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:19.374082 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2a4e4-1381-4fdb-b225-24b380a2c03a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:19.374527 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2a4e4-1381-4fdb-b225-24b380a2c03a None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:19.375363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2a4e4-1381-4fdb-b225-24b380a2c03a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:19.376415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2a4e4-1381-4fdb-b225-24b380a2c03a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:19.377977 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2a4e4-1381-4fdb-b225-24b380a2c03a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:19.378337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-e7caab86-fc8b-433c-8f2f-970745094e0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:19.378337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:19.378337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:19.378337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:19.378337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:19.378337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:19.378337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:19.378337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:19.378337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:19.378337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:19.378337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:19.378337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:19.378337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:19.378337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:19.378337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:19.378337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:19.379405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:19.379405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:19.379405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:19.379405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:19.379405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:19.379405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:19.379405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:19.379405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:19.379405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:19.379405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:19.379405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:19.379405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:19.379405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:19.379405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:19.379405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:19.379405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:19.379405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:19.380495 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:19.380495 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:19.380495 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:19.385910 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 303/593] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:19.386891 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7caab86-fc8b-433c-8f2f-970745094e0f None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:19.399818 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 291/594] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:19.401493 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2a4e4-1381-4fdb-b225-24b380a2c03a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:19.510057 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7caab86-fc8b-433c-8f2f-970745094e0f None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:19.538472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2a4e4-1381-4fdb-b225-24b380a2c03a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:19.546153 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6ed37-5edb-400b-8823-18eae8e189c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:19.547048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6ed37-5edb-400b-8823-18eae8e189c9 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:19.548025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6ed37-5edb-400b-8823-18eae8e189c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:19.548607 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6ed37-5edb-400b-8823-18eae8e189c9 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:19.549530 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6ed37-5edb-400b-8823-18eae8e189c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:19.550032 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6ed37-5edb-400b-8823-18eae8e189c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:19.551676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6ed37-5edb-400b-8823-18eae8e189c9 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:19.579638 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 304/595] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Sep 26 01:23:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:19.579638 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6ed37-5edb-400b-8823-18eae8e189c9 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:19.582246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bac942-2a85-4a92-896c-b968fddfc42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:19.583140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bac942-2a85-4a92-896c-b968fddfc42c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:19.583619 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bac942-2a85-4a92-896c-b968fddfc42c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:19.584105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bac942-2a85-4a92-896c-b968fddfc42c None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:19.584959 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bac942-2a85-4a92-896c-b968fddfc42c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:19.585472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bac942-2a85-4a92-896c-b968fddfc42c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:19.587189 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bac942-2a85-4a92-896c-b968fddfc42c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:19.592636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:19.605994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 292/596] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:19.607309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bac942-2a85-4a92-896c-b968fddfc42c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:19.637284 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:19.704104 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6ed37-5edb-400b-8823-18eae8e189c9 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:19.717299 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bac942-2a85-4a92-896c-b968fddfc42c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:19.749091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c195bb-4ffc-466f-b6ea-9984538e5251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:19.749964 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c195bb-4ffc-466f-b6ea-9984538e5251 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:19.750244 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c195bb-4ffc-466f-b6ea-9984538e5251 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:19.750512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c195bb-4ffc-466f-b6ea-9984538e5251 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:19.756913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffc58c-be77-449c-978f-0836f55d2956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:19.757785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffc58c-be77-449c-978f-0836f55d2956 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:19.758275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffc58c-be77-449c-978f-0836f55d2956 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:19.758789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffc58c-be77-449c-978f-0836f55d2956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:19.759344 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c195bb-4ffc-466f-b6ea-9984538e5251 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:19.761188 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c195bb-4ffc-466f-b6ea-9984538e5251 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:19.771624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffc58c-be77-449c-978f-0836f55d2956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:19.773069 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffc58c-be77-449c-978f-0836f55d2956 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:19.778261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-02c195bb-4ffc-466f-b6ea-9984538e5251 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:19.778261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:19.778261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:19.778261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:19.778261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:19.778261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:19.778261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:19.778261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:19.778261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:19.778261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:19.778261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:19.778261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:19.778261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:19.778261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:19.778261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:19.779160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:19.779160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:19.779160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:19.779160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:19.779160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:19.779160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:19.779160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:19.779160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:19.779160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:19.779160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:19.779160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:19.779160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:19.779160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:19.779160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:19.779160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:19.779160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:19.779160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:19.780075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:19.780075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:19.780075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:19.780075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:19.780075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:19.780075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:19.780075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:19.780075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:19.783415 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 305/597] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:19.784414 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c195bb-4ffc-466f-b6ea-9984538e5251 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:19.793749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-96ffc58c-be77-449c-978f-0836f55d2956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:19.793749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:19.793749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:19.793749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:19.793749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:19.793749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:19.793749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:19.793749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:19.793749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:19.793749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:19.793749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:19.793749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:19.793749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:19.793749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:19.793749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:19.793749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:19.794988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:19.794988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:19.794988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:19.794988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:19.794988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:19.794988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:19.794988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:19.794988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:19.794988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:19.794988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:19.794988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:19.794988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:19.794988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:19.794988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:19.794988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:19.794988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:19.794988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:19.796085 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:19.796085 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:19.796085 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:19.801842 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 293/598] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:19.802864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffc58c-be77-449c-978f-0836f55d2956 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:19.886508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:19.887049 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:19.915835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c195bb-4ffc-466f-b6ea-9984538e5251 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:19.919748 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffc58c-be77-449c-978f-0836f55d2956 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:19.956748 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999e2e9-13ac-42fc-a78c-9ef775a31588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:19.957334 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999e2e9-13ac-42fc-a78c-9ef775a31588 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:19.957625 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999e2e9-13ac-42fc-a78c-9ef775a31588 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:19.957885 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999e2e9-13ac-42fc-a78c-9ef775a31588 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:19.958567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999e2e9-13ac-42fc-a78c-9ef775a31588 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:19.958891 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999e2e9-13ac-42fc-a78c-9ef775a31588 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:19.960303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999e2e9-13ac-42fc-a78c-9ef775a31588 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:19.961949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d756e-378d-4d57-ac33-d32256818cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:19.963186 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d756e-378d-4d57-ac33-d32256818cce None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:19.963609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d756e-378d-4d57-ac33-d32256818cce None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:19.964038 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d756e-378d-4d57-ac33-d32256818cce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:19.972397 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d756e-378d-4d57-ac33-d32256818cce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:19.973050 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 294/599] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:19.973994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999e2e9-13ac-42fc-a78c-9ef775a31588 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:19.974573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d756e-378d-4d57-ac33-d32256818cce None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:19.989413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-3b8d756e-378d-4d57-ac33-d32256818cce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:19.989413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:19.989413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:19.989413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:19.989413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:19.989413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:19.989413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:19.989413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:19.989413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:19.989413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:19.989413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:19.989413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:19.989413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:19.989413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:19.989413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:19.990310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:19.990310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:19.990310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:19.990310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:19.990310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:19.990310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:19.990310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:19.990310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:19.990310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:19.990310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:19.990310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:19.990310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:19.990310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:19.990310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:19.990310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:19.990310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:19.990310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:19.991233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:19.991233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:19.991233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:19.991233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:19.991233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:19.991233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:19.991233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:19.991233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:19.991233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 306/600] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:19.991233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d756e-378d-4d57-ac33-d32256818cce None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:20.096800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999e2e9-13ac-42fc-a78c-9ef775a31588 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:20.124201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d756e-378d-4d57-ac33-d32256818cce None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:20.133223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b4b84-b42d-4957-86d0-eb9c8c5ae65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:20.133888 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b4b84-b42d-4957-86d0-eb9c8c5ae65d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:20.134216 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b4b84-b42d-4957-86d0-eb9c8c5ae65d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:20.134494 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b4b84-b42d-4957-86d0-eb9c8c5ae65d None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:20.135177 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b4b84-b42d-4957-86d0-eb9c8c5ae65d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:20.135478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b4b84-b42d-4957-86d0-eb9c8c5ae65d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:20.136896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b4b84-b42d-4957-86d0-eb9c8c5ae65d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:20.144111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:20.150071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 295/601] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:20.151243 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b4b84-b42d-4957-86d0-eb9c8c5ae65d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:20.178643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815a7a8-bbcf-4d02-b5a2-b0e77ff6dad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:20.179610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815a7a8-bbcf-4d02-b5a2-b0e77ff6dad7 None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:20.180284 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815a7a8-bbcf-4d02-b5a2-b0e77ff6dad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:20.180704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815a7a8-bbcf-4d02-b5a2-b0e77ff6dad7 None admin] PATH_INFO: `/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/80c1005979d04c55b8746c25b0994086/roles/8801886a5f4e4695a29b60c6eb347932` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:20.184689 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:20.203713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815a7a8-bbcf-4d02-b5a2-b0e77ff6dad7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fda1727cc3d47b9a1fae73c74f32c27, user_id=80c1005979d04c55b8746c25b0994086, role_id=8801886a5f4e4695a29b60c6eb347932)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:20.205715 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815a7a8-bbcf-4d02-b5a2-b0e77ff6dad7 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:20.226028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 307/602] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:23:19 2022] PUT /identity/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/80c1005979d04c55b8746c25b0994086/roles/8801886a5f4e4695a29b60c6eb347932 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:23:20.227176 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815a7a8-bbcf-4d02-b5a2-b0e77ff6dad7 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:20.270522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b4b84-b42d-4957-86d0-eb9c8c5ae65d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:20.311548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab11b8-6449-4ac6-a426-770cba76c6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:20.312445 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab11b8-6449-4ac6-a426-770cba76c6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:20.312888 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab11b8-6449-4ac6-a426-770cba76c6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:20.313534 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab11b8-6449-4ac6-a426-770cba76c6a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:20.314364 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab11b8-6449-4ac6-a426-770cba76c6a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:20.314809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab11b8-6449-4ac6-a426-770cba76c6a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:20.316559 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab11b8-6449-4ac6-a426-770cba76c6a7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:20.335447 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 296/603] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:20.341866 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab11b8-6449-4ac6-a426-770cba76c6a7 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:20.365626 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815a7a8-bbcf-4d02-b5a2-b0e77ff6dad7 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:20.413150 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7102f-3f44-4a16-81c1-9c6b109eab55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:20.414141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7102f-3f44-4a16-81c1-9c6b109eab55 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:20.414572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7102f-3f44-4a16-81c1-9c6b109eab55 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:20.419261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7102f-3f44-4a16-81c1-9c6b109eab55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:20.427673 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:20.439636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7102f-3f44-4a16-81c1-9c6b109eab55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:20.441126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7102f-3f44-4a16-81c1-9c6b109eab55 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:20.457820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-65b7102f-3f44-4a16-81c1-9c6b109eab55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:20.457820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:20.457820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:20.457820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:20.457820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:20.457820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:20.457820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:20.457820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:20.457820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:20.457820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:20.457820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:20.457820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:20.457820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:20.457820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:20.457820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:20.458862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:20.458862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:20.458862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:20.458862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:20.458862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:20.458862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:20.458862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:20.458862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:20.458862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:20.458862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:20.458862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:20.458862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:20.458862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:20.458862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:20.458862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:20.458862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:20.458862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:20.459869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:20.459869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:20.459869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:20.459869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:20.459869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:20.459869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:20.459869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:20.459869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:20.463838 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 308/604] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:20.471229 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7102f-3f44-4a16-81c1-9c6b109eab55 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:20.521969 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:20.529393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab11b8-6449-4ac6-a426-770cba76c6a7 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:20.579224 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb960aca-1558-4b13-8ae3-2c5a6b159939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:20.580255 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb960aca-1558-4b13-8ae3-2c5a6b159939 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:20.580542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb960aca-1558-4b13-8ae3-2c5a6b159939 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:20.580817 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb960aca-1558-4b13-8ae3-2c5a6b159939 None admin] PATH_INFO: `/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/eab8abb1394d41e3a30439699086da28/roles/8801886a5f4e4695a29b60c6eb347932` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:20.590014 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7102f-3f44-4a16-81c1-9c6b109eab55 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:20.602866 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb960aca-1558-4b13-8ae3-2c5a6b159939 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fda1727cc3d47b9a1fae73c74f32c27, user_id=eab8abb1394d41e3a30439699086da28, role_id=8801886a5f4e4695a29b60c6eb347932)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:20.603385 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb960aca-1558-4b13-8ae3-2c5a6b159939 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:20.623552 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 297/605] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:23:20 2022] PUT /identity/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/eab8abb1394d41e3a30439699086da28/roles/8801886a5f4e4695a29b60c6eb347932 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:23:20.642173 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67442efb-0a18-4c1f-83a4-01e88daf292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:20.643002 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67442efb-0a18-4c1f-83a4-01e88daf292a None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:20.643401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67442efb-0a18-4c1f-83a4-01e88daf292a None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:20.643745 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67442efb-0a18-4c1f-83a4-01e88daf292a None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:20.644535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67442efb-0a18-4c1f-83a4-01e88daf292a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:20.644908 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67442efb-0a18-4c1f-83a4-01e88daf292a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:20.646462 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67442efb-0a18-4c1f-83a4-01e88daf292a None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:20.661044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 309/606] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:20.667336 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb960aca-1558-4b13-8ae3-2c5a6b159939 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:20.743527 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26600b1f-d1d6-453f-a409-acd6614580c9 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:20.743838 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26600b1f-d1d6-453f-a409-acd6614580c9 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:20.744077 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26600b1f-d1d6-453f-a409-acd6614580c9 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:20.745852 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 310/607] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:20.751744 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f4cd1-a52a-4254-8905-415f53b54815 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:20.751947 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f4cd1-a52a-4254-8905-415f53b54815 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:20.752186 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f4cd1-a52a-4254-8905-415f53b54815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:20.772578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-a95f4cd1-a52a-4254-8905-415f53b54815 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:20.773786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a95f4cd1-a52a-4254-8905-415f53b54815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:20.793533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb960aca-1558-4b13-8ae3-2c5a6b159939 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:20.808638 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:20.847140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abedaff-b323-45f2-9399-db22e4b0b0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:20.848161 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abedaff-b323-45f2-9399-db22e4b0b0d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:20.848614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abedaff-b323-45f2-9399-db22e4b0b0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:20.849080 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abedaff-b323-45f2-9399-db22e4b0b0d9 None admin] PATH_INFO: `/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/15538b95acef435798ff7651fc1710cb/roles/8801886a5f4e4695a29b60c6eb347932` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:20.861649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 311/608] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:23:20.873769 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abedaff-b323-45f2-9399-db22e4b0b0d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fda1727cc3d47b9a1fae73c74f32c27, user_id=15538b95acef435798ff7651fc1710cb, role_id=8801886a5f4e4695a29b60c6eb347932)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:20.875737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abedaff-b323-45f2-9399-db22e4b0b0d9 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:20.895604 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 298/609] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:23:20 2022] PUT /identity/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/15538b95acef435798ff7651fc1710cb/roles/8801886a5f4e4695a29b60c6eb347932 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:23:21.096966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e75ffa-923a-403c-a388-4e9fba1c2738 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:21.097944 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e75ffa-923a-403c-a388-4e9fba1c2738 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:21.098417 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e75ffa-923a-403c-a388-4e9fba1c2738 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:21.100304 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 312/610] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:21.105417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31265fb6-592f-442d-87cf-796964e108b0 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:21.105779 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31265fb6-592f-442d-87cf-796964e108b0 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:21.105973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31265fb6-592f-442d-87cf-796964e108b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:21.126460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-31265fb6-592f-442d-87cf-796964e108b0 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:21.127700 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-31265fb6-592f-442d-87cf-796964e108b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:21.182663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e75ffa-923a-403c-a388-4e9fba1c2738 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:21.203516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 299/611] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:21.241810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:21.335713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e75ffa-923a-403c-a388-4e9fba1c2738 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:21.383436 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42623c-03ca-44c7-8ce9-376cae09d0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:21.383936 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42623c-03ca-44c7-8ce9-376cae09d0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:21.384213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42623c-03ca-44c7-8ce9-376cae09d0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:21.384482 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42623c-03ca-44c7-8ce9-376cae09d0a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:21.408698 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42623c-03ca-44c7-8ce9-376cae09d0a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:21.414859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-4c42623c-03ca-44c7-8ce9-376cae09d0a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:21.414859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:21.414859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:21.414859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:21.414859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:21.414859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:21.414859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:21.414859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:21.414859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:21.414859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:21.414859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:21.414859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:21.414859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:21.414859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:21.414859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:21.414859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:21.415805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:21.415805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:21.415805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:21.415805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:21.415805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:21.415805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:21.415805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:21.415805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:21.415805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:21.415805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:21.415805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:21.415805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:21.415805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:21.415805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:21.415805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:21.415805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:21.416670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:21.416670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:21.416670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:21.416670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:21.416670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:21.416670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:21.416670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:21.416670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:21.416670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:21.416670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:21.416670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:21.416670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:21.416670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 313/612] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:21.420378 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31265fb6-592f-442d-87cf-796964e108b0 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:21.506764 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42623c-03ca-44c7-8ce9-376cae09d0a3 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:21.591033 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:21.606517 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31265fb6-592f-442d-87cf-796964e108b0 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:21.675733 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93b153-e71e-474e-bd7a-0d4ca4f8703c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:21.676272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93b153-e71e-474e-bd7a-0d4ca4f8703c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:21.676549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93b153-e71e-474e-bd7a-0d4ca4f8703c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:21.676818 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93b153-e71e-474e-bd7a-0d4ca4f8703c None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:21.677482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93b153-e71e-474e-bd7a-0d4ca4f8703c None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:21.677879 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93b153-e71e-474e-bd7a-0d4ca4f8703c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:21.679283 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93b153-e71e-474e-bd7a-0d4ca4f8703c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:21.690738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42623c-03ca-44c7-8ce9-376cae09d0a3 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:21.692300 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:21.697783 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 300/613] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:23:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:21.703485 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93b153-e71e-474e-bd7a-0d4ca4f8703c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:21.764500 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc9ea8-0825-4a5b-b138-f69c456d2c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:21.765197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc9ea8-0825-4a5b-b138-f69c456d2c00 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:21.765477 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc9ea8-0825-4a5b-b138-f69c456d2c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:21.765747 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc9ea8-0825-4a5b-b138-f69c456d2c00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:21.782896 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc9ea8-0825-4a5b-b138-f69c456d2c00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:21.787643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-20cc9ea8-0825-4a5b-b138-f69c456d2c00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:21.787643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:21.787643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:21.787643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:21.787643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:21.787643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:21.787643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:21.787643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:21.787643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:21.787643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:21.787643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:21.787643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:21.787643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:21.787643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:21.787643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:21.787643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:21.788559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:21.788559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:21.788559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:21.788559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:21.788559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:21.788559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:21.788559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:21.788559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:21.788559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:21.788559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:21.788559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:21.788559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:21.788559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:21.788559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:21.788559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:21.788559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:21.789410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:21.789410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:21.789410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:21.789410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:21.789410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:21.789410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:21.789410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:21.789410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:21.789410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:21.789410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:21.789410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:21.789410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:21.795272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 314/614] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:21.801388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc9ea8-0825-4a5b-b138-f69c456d2c00 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:21.813987 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93b153-e71e-474e-bd7a-0d4ca4f8703c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:21.860263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2204967-871c-4842-82f5-a830eda1388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:21.861048 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2204967-871c-4842-82f5-a830eda1388b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:21.861328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2204967-871c-4842-82f5-a830eda1388b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:21.861598 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2204967-871c-4842-82f5-a830eda1388b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:21.880183 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2204967-871c-4842-82f5-a830eda1388b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:21.881711 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2204967-871c-4842-82f5-a830eda1388b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:21.905141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-e2204967-871c-4842-82f5-a830eda1388b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:21.905141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:21.905141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:21.905141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:21.905141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:21.905141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:21.905141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:21.905141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:21.905141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:21.905141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:21.905141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:21.905141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:21.905141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:21.905141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:21.905141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:21.905141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:21.907577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:21.907577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:21.907577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:21.907577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:21.907577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:21.907577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:21.907577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:21.907577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:21.907577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:21.907577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:21.907577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:21.907577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:21.907577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:21.907577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:21.907577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:21.907577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:21.907577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:21.909799 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:21.909799 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:21.909799 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:21.909799 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 301/615] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:21.916035 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2204967-871c-4842-82f5-a830eda1388b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:21.925490 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:21.949441 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc9ea8-0825-4a5b-b138-f69c456d2c00 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:22.008947 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d276f-a872-478f-b012-6a979cb2ec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:22.009548 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d276f-a872-478f-b012-6a979cb2ec65 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:22.009824 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d276f-a872-478f-b012-6a979cb2ec65 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:22.010095 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d276f-a872-478f-b012-6a979cb2ec65 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:22.010757 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d276f-a872-478f-b012-6a979cb2ec65 None admin] RBAC: Adding query filter params (name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:22.011086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d276f-a872-478f-b012-6a979cb2ec65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:22.012450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d276f-a872-478f-b012-6a979cb2ec65 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:22.030090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 315/616] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:23:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:23:22.036472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d276f-a872-478f-b012-6a979cb2ec65 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:22.071770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:22.114480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2204967-871c-4842-82f5-a830eda1388b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:22.184780 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39586a0c-2f25-4c68-b249-4a3265fc460e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:22.185787 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39586a0c-2f25-4c68-b249-4a3265fc460e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:22.186453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39586a0c-2f25-4c68-b249-4a3265fc460e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:22.187701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39586a0c-2f25-4c68-b249-4a3265fc460e None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:22.188918 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39586a0c-2f25-4c68-b249-4a3265fc460e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:22.191954 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39586a0c-2f25-4c68-b249-4a3265fc460e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:22.193551 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39586a0c-2f25-4c68-b249-4a3265fc460e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:22.218930 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d276f-a872-478f-b012-6a979cb2ec65 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:22.223913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 302/617] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:22.229622 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39586a0c-2f25-4c68-b249-4a3265fc460e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:22.292148 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2f298-fd02-418b-92e4-dc10999ee0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:22.294116 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2f298-fd02-418b-92e4-dc10999ee0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:22.295768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2f298-fd02-418b-92e4-dc10999ee0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:22.296396 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2f298-fd02-418b-92e4-dc10999ee0d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:22.327676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2f298-fd02-418b-92e4-dc10999ee0d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:22.329856 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2f298-fd02-418b-92e4-dc10999ee0d6 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:22.363206 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:22.374593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-a6b2f298-fd02-418b-92e4-dc10999ee0d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:22.374593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:22.374593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:22.374593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:22.374593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:22.374593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:22.374593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:22.374593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:22.374593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:22.374593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:22.374593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:22.374593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:22.374593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:22.374593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:22.374593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:22.374593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:22.376278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:22.376278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:22.376278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:22.376278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:22.376278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:22.376278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:22.376278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:22.376278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:22.376278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:22.376278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:22.376278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:22.376278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:22.376278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:22.376278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:22.376278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:22.376278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:22.376278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:22.377183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:22.377183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:22.377183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:22.379285 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 316/618] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:22.387796 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2f298-fd02-418b-92e4-dc10999ee0d6 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:22.388079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39586a0c-2f25-4c68-b249-4a3265fc460e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:22.435739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bded441-afb1-4ff7-8094-b80093a30eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:22.436623 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bded441-afb1-4ff7-8094-b80093a30eed None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:22.436901 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bded441-afb1-4ff7-8094-b80093a30eed None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:22.437160 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bded441-afb1-4ff7-8094-b80093a30eed None admin] PATH_INFO: `/v3/users/nova` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:22.446100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bded441-afb1-4ff7-8094-b80093a30eed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:22.447575 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bded441-afb1-4ff7-8094-b80093a30eed None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:22.461381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-9bded441-afb1-4ff7-8094-b80093a30eed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 01:23:22.461381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:22.461381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:22.461381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:22.461381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:22.461381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:22.461381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:22.461381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:22.461381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:22.461381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:22.461381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:22.461381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:22.461381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:22.461381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:22.461381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:22.461381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:22.462705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:22.462705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:22.462705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:22.462705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:22.462705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:22.462705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:22.462705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:22.462705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:22.462705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:22.462705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:22.462705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:22.462705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:22.462705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:22.462705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:22.462705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:22.462705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:22.462705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:22.462705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:22.463717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:22.463717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:22.463717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:22.463717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:22.463717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:22.463717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:22.463717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:22.463717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:22.463717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 01:23:22.463717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:22.463717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 303/619] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 26 01:23:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:22.470691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bded441-afb1-4ff7-8094-b80093a30eed None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:22.531020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:22.572437 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2f298-fd02-418b-92e4-dc10999ee0d6 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:22.613144 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec0d7c-5bf4-433d-9def-2d417dbf9798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:22.613758 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec0d7c-5bf4-433d-9def-2d417dbf9798 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:22.614042 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec0d7c-5bf4-433d-9def-2d417dbf9798 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:22.614313 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec0d7c-5bf4-433d-9def-2d417dbf9798 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:22.614993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec0d7c-5bf4-433d-9def-2d417dbf9798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:22.615296 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec0d7c-5bf4-433d-9def-2d417dbf9798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:22.616713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec0d7c-5bf4-433d-9def-2d417dbf9798 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:22.630651 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 317/620] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:22.635996 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec0d7c-5bf4-433d-9def-2d417dbf9798 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:22.736882 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bded441-afb1-4ff7-8094-b80093a30eed None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:22.758000 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec0d7c-5bf4-433d-9def-2d417dbf9798 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:22.789395 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:22.795732 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:22.800207 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb7e8c-bfd6-43d8-bec3-3ddaa95f4a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:22.800538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8c4bb-78ad-4715-996a-7a1e1787d21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:22.800821 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb7e8c-bfd6-43d8-bec3-3ddaa95f4a1a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:22.801106 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb7e8c-bfd6-43d8-bec3-3ddaa95f4a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:22.801224 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c4bb-78ad-4715-996a-7a1e1787d21c None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:22.801403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb7e8c-bfd6-43d8-bec3-3ddaa95f4a1a None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:22.801505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c4bb-78ad-4715-996a-7a1e1787d21c None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:22.801691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c4bb-78ad-4715-996a-7a1e1787d21c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:22.802098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb7e8c-bfd6-43d8-bec3-3ddaa95f4a1a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:22.802406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb7e8c-bfd6-43d8-bec3-3ddaa95f4a1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:22.803863 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb7e8c-bfd6-43d8-bec3-3ddaa95f4a1a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:22.811906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8c4bb-78ad-4715-996a-7a1e1787d21c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:22.814737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8c4bb-78ad-4715-996a-7a1e1787d21c None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:22.825801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 304/621] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 26 01:23:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:22.827107 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6463ddf-2726-4e2e-a934-29d593474610 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:22.827400 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6463ddf-2726-4e2e-a934-29d593474610 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:22.827585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-e6d8c4bb-78ad-4715-996a-7a1e1787d21c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 01:23:22.827585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:22.827585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:22.827585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:22.827585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:22.827585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:22.827585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:22.827585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:22.827585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:22.827585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:22.827585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:22.827585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:22.827585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:22.827585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:22.827585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:22.827585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:22.828484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:22.828484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:22.828484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:22.828484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:22.828484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:22.828484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:22.828484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:22.828484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:22.828484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:22.828484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:22.828484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:22.828484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:22.828484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:22.828484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:22.828484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:22.828484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:22.828484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:22.828484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:22.829539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:22.829539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:22.829539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:22.829539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:22.829539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:22.829539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:22.829539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:22.829539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:22.829539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 01:23:22.829539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:22.830071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6463ddf-2726-4e2e-a934-29d593474610 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:22.830149 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 318/623] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:23:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:22.830225 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 305/623] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:22.834404 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8c4bb-78ad-4715-996a-7a1e1787d21c None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:22.835717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6463ddf-2726-4e2e-a934-29d593474610 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:22.940066 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6463ddf-2726-4e2e-a934-29d593474610 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:22.960000 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8c4bb-78ad-4715-996a-7a1e1787d21c None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:22.991920 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cf022-04e4-4f7d-9a49-cc2f19ec8c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:22.992494 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cf022-04e4-4f7d-9a49-cc2f19ec8c83 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:22.992788 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cf022-04e4-4f7d-9a49-cc2f19ec8c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:22.993485 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cf022-04e4-4f7d-9a49-cc2f19ec8c83 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:22.994586 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cf022-04e4-4f7d-9a49-cc2f19ec8c83 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:22.994967 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cf022-04e4-4f7d-9a49-cc2f19ec8c83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:22.997077 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cf022-04e4-4f7d-9a49-cc2f19ec8c83 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:23.002439 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcead6c2-6abf-420f-a41b-f392f72dab4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:23.003357 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcead6c2-6abf-420f-a41b-f392f72dab4e None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:23.003883 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcead6c2-6abf-420f-a41b-f392f72dab4e None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:23.004357 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcead6c2-6abf-420f-a41b-f392f72dab4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:23.022930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 306/624] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Sep 26 01:23:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:23.024552 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bc005-55c3-42ba-bdd7-7d272e66f020 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:23.025084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bc005-55c3-42ba-bdd7-7d272e66f020 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:23.025551 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bc005-55c3-42ba-bdd7-7d272e66f020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:23.044219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-457bc005-55c3-42ba-bdd7-7d272e66f020 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:23.045726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-457bc005-55c3-42ba-bdd7-7d272e66f020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:23.079495 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:23.082170 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:23.098502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcead6c2-6abf-420f-a41b-f392f72dab4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:23.100562 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcead6c2-6abf-420f-a41b-f392f72dab4e None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:23.131218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 307/625] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:23.132616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bc005-55c3-42ba-bdd7-7d272e66f020 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:23.224893 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 319/626] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:23:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:23:23.230164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcead6c2-6abf-420f-a41b-f392f72dab4e None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:23.326333 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bc005-55c3-42ba-bdd7-7d272e66f020 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:23.343266 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:23.361412 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcead6c2-6abf-420f-a41b-f392f72dab4e None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:23.399087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876d518-e9da-44fb-9583-0bd34fdb8513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:23.399908 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876d518-e9da-44fb-9583-0bd34fdb8513 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:23.400188 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876d518-e9da-44fb-9583-0bd34fdb8513 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:23.400459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876d518-e9da-44fb-9583-0bd34fdb8513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:23.418545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a288317-ba77-41e5-91b8-d2d3ffc1338d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:23.419474 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a288317-ba77-41e5-91b8-d2d3ffc1338d None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:23.420463 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a288317-ba77-41e5-91b8-d2d3ffc1338d None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:23.420934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a288317-ba77-41e5-91b8-d2d3ffc1338d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:23.422079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876d518-e9da-44fb-9583-0bd34fdb8513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:23.424638 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876d518-e9da-44fb-9583-0bd34fdb8513 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:23.433652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a288317-ba77-41e5-91b8-d2d3ffc1338d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:23.435512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a288317-ba77-41e5-91b8-d2d3ffc1338d None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:23.444710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-4876d518-e9da-44fb-9583-0bd34fdb8513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:23.444710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:23.444710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:23.444710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:23.444710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:23.444710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:23.444710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:23.444710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:23.444710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:23.444710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:23.444710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:23.444710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:23.444710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:23.444710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:23.444710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:23.444710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:23.445949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:23.445949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:23.445949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:23.445949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:23.445949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:23.445949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:23.445949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:23.445949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:23.445949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:23.445949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:23.445949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:23.445949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:23.445949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:23.445949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:23.445949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:23.445949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:23.445949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:23.446903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:23.446903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:23.446903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:23.446903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 308/627] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:23.451964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a71df-f0a3-4132-9322-606d0a511237 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:23.453353 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a71df-f0a3-4132-9322-606d0a511237 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:23.454125 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a71df-f0a3-4132-9322-606d0a511237 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:23.456238 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 309/628] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:23.460876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a71df-f0a3-4132-9322-606d0a511237 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:23.461691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-6a288317-ba77-41e5-91b8-d2d3ffc1338d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:23.461691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:23.461691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:23.461691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:23.461691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:23.461691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:23.461691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:23.461691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:23.461691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:23.461691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:23.461691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:23.461691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:23.461691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:23.461691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:23.461691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:23.461691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:23.462595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:23.462595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:23.462595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:23.462595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:23.462595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:23.462595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:23.462595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:23.462595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:23.462595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:23.462595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:23.462595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:23.462595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:23.462595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:23.462595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:23.462595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:23.462595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:23.462595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:23.463612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:23.463612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:23.463612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:23.463612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 320/629] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:23.464215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a288317-ba77-41e5-91b8-d2d3ffc1338d None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:23.487708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:23.576145 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a71df-f0a3-4132-9322-606d0a511237 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:23.576653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a288317-ba77-41e5-91b8-d2d3ffc1338d None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:23.612698 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a42d48-d295-475b-85fe-305035000dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:23.613372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a42d48-d295-475b-85fe-305035000dbc None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:23.613657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a42d48-d295-475b-85fe-305035000dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:23.613785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e6ba1-8eab-4622-8db2-230498ffe7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:23.613973 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a42d48-d295-475b-85fe-305035000dbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:23.614371 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e6ba1-8eab-4622-8db2-230498ffe7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:23.614625 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e6ba1-8eab-4622-8db2-230498ffe7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:23.614927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e6ba1-8eab-4622-8db2-230498ffe7a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:23.615565 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e6ba1-8eab-4622-8db2-230498ffe7a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:23.615869 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e6ba1-8eab-4622-8db2-230498ffe7a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:23.617226 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e6ba1-8eab-4622-8db2-230498ffe7a4 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:23.622193 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:23.626421 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a42d48-d295-475b-85fe-305035000dbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:23.629601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 310/630] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:23.630790 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f5724-6453-4a31-a704-d71f3918b4a1 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:23.631116 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f5724-6453-4a31-a704-d71f3918b4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:23.631389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f5724-6453-4a31-a704-d71f3918b4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:23.631501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-e0a42d48-d295-475b-85fe-305035000dbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:23.631501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:23.631501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:23.631501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:23.631501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:23.631501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:23.631501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:23.631501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:23.631501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:23.631501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:23.631501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:23.631501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:23.631501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:23.631501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:23.631501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:23.631501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:23.632366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:23.632366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:23.632366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:23.632366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:23.632366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:23.632366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:23.632366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:23.632366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:23.632366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:23.632366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:23.632366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:23.632366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:23.632366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:23.632366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:23.632366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:23.632366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:23.633212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:23.633212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:23.633212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:23.633212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:23.633212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:23.633212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:23.633212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:23.633212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:23.633212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:23.633212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:23.633212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:23.633212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:23.633212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 321/631] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:23.633922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a42d48-d295-475b-85fe-305035000dbc None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:23.653520 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-375f5724-6453-4a31-a704-d71f3918b4a1 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:23.654782 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-375f5724-6453-4a31-a704-d71f3918b4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:23.723185 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 311/632] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:23.724662 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50168f-e3bd-412a-aaa0-b38e6acc61ba None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:23.724950 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50168f-e3bd-412a-aaa0-b38e6acc61ba None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:23.725230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50168f-e3bd-412a-aaa0-b38e6acc61ba None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:23.726453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 312/633] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:23.727173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50168f-e3bd-412a-aaa0-b38e6acc61ba None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:23.738162 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a42d48-d295-475b-85fe-305035000dbc None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:23.746415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:23.776277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7e882-382f-4d88-9801-6fe0b14f8b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:23.776884 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7e882-382f-4d88-9801-6fe0b14f8b62 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:23.777159 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7e882-382f-4d88-9801-6fe0b14f8b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:23.777428 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7e882-382f-4d88-9801-6fe0b14f8b62 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:23.778063 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7e882-382f-4d88-9801-6fe0b14f8b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:23.778359 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7e882-382f-4d88-9801-6fe0b14f8b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:23.779735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7e882-382f-4d88-9801-6fe0b14f8b62 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:23.792791 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 322/634] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:23.794527 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7e882-382f-4d88-9801-6fe0b14f8b62 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:23.848713 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50168f-e3bd-412a-aaa0-b38e6acc61ba None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:23.859269 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:23.881693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0c897-d7ee-47dc-9082-b133a6191186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:23.882318 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0c897-d7ee-47dc-9082-b133a6191186 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:23.882596 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0c897-d7ee-47dc-9082-b133a6191186 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:23.882903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0c897-d7ee-47dc-9082-b133a6191186 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:23.889371 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0c897-d7ee-47dc-9082-b133a6191186 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:23.890790 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0c897-d7ee-47dc-9082-b133a6191186 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:23.902230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-15d0c897-d7ee-47dc-9082-b133a6191186 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:23.902230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:23.902230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:23.902230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:23.902230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:23.902230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:23.902230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:23.902230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:23.902230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:23.902230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:23.902230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:23.902230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:23.902230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:23.902230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:23.902230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:23.903327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:23.903327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:23.903327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:23.903327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:23.903327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:23.903327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:23.903327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:23.903327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:23.903327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:23.903327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:23.903327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:23.903327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:23.903327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:23.903327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:23.903327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:23.903327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:23.903327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:23.904223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:23.904223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:23.904223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:23.904223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:23.904223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:23.904223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:23.904223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:23.904223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:23.904223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 313/635] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:23.904734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72e174-8f58-48e3-98c8-044433c44c74 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:23.904734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72e174-8f58-48e3-98c8-044433c44c74 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:23.904987 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72e174-8f58-48e3-98c8-044433c44c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:23.905734 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7e882-382f-4d88-9801-6fe0b14f8b62 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:23.923141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-6b72e174-8f58-48e3-98c8-044433c44c74 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:23.924316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6b72e174-8f58-48e3-98c8-044433c44c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:23.943307 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc11ef-d3fb-4c35-9eda-4a0c159645b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:23.943900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc11ef-d3fb-4c35-9eda-4a0c159645b6 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:23.944175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc11ef-d3fb-4c35-9eda-4a0c159645b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:23.944444 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc11ef-d3fb-4c35-9eda-4a0c159645b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:23.945346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc11ef-d3fb-4c35-9eda-4a0c159645b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:23.945643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc11ef-d3fb-4c35-9eda-4a0c159645b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:23.947016 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc11ef-d3fb-4c35-9eda-4a0c159645b6 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:23.955602 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 323/636] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:23:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:23.955602 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc11ef-d3fb-4c35-9eda-4a0c159645b6 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:23.993940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:23.999620 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 314/637] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:23.999773 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72e174-8f58-48e3-98c8-044433c44c74 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:24.064348 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc11ef-d3fb-4c35-9eda-4a0c159645b6 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:24.090513 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:24.106043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72e174-8f58-48e3-98c8-044433c44c74 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:24.106475 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefaa4ab-c2cf-406c-a3ff-f8d039cea8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:24.107469 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefaa4ab-c2cf-406c-a3ff-f8d039cea8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:24.107925 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefaa4ab-c2cf-406c-a3ff-f8d039cea8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:24.108341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefaa4ab-c2cf-406c-a3ff-f8d039cea8a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:24.118714 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefaa4ab-c2cf-406c-a3ff-f8d039cea8a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:24.121386 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefaa4ab-c2cf-406c-a3ff-f8d039cea8a1 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:24.138327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-aefaa4ab-c2cf-406c-a3ff-f8d039cea8a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:24.138327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:24.138327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:24.138327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:24.138327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:24.138327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:24.138327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:24.138327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:24.138327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:24.138327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:24.138327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:24.138327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:24.138327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:24.138327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:24.138327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:24.139578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:24.139578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:24.139578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:24.139578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:24.139578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:24.139578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:24.139578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:24.139578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:24.139578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:24.139578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:24.139578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:24.139578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:24.139578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:24.139578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:24.139578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:24.139578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:24.139578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:24.147835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:24.147835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:24.147835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:24.147835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:24.147835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:24.147835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:24.147835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:24.147835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:24.147835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 324/638] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:24.147835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefaa4ab-c2cf-406c-a3ff-f8d039cea8a1 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:24.159170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b725dc7-6c3c-413d-8ad8-7dc6e1a4c7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:24.159790 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b725dc7-6c3c-413d-8ad8-7dc6e1a4c7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:24.160069 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b725dc7-6c3c-413d-8ad8-7dc6e1a4c7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:24.160338 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b725dc7-6c3c-413d-8ad8-7dc6e1a4c7b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:24.161028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b725dc7-6c3c-413d-8ad8-7dc6e1a4c7b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:24.161440 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b725dc7-6c3c-413d-8ad8-7dc6e1a4c7b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:24.162750 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b725dc7-6c3c-413d-8ad8-7dc6e1a4c7b1 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:24.174765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 315/639] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:24.175591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b725dc7-6c3c-413d-8ad8-7dc6e1a4c7b1 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:24.235579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:24.269043 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefaa4ab-c2cf-406c-a3ff-f8d039cea8a1 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:24.278382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b725dc7-6c3c-413d-8ad8-7dc6e1a4c7b1 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:24.302342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840c4c6-0520-4dd1-812a-932dcd99ce7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:24.302988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840c4c6-0520-4dd1-812a-932dcd99ce7a None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:24.303268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840c4c6-0520-4dd1-812a-932dcd99ce7a None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:24.303539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840c4c6-0520-4dd1-812a-932dcd99ce7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:24.311426 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28ca48-2e22-489b-8f4a-787f446b60a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:24.312044 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28ca48-2e22-489b-8f4a-787f446b60a1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:24.312315 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28ca48-2e22-489b-8f4a-787f446b60a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:24.312582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28ca48-2e22-489b-8f4a-787f446b60a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:24.314011 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840c4c6-0520-4dd1-812a-932dcd99ce7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:24.315478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840c4c6-0520-4dd1-812a-932dcd99ce7a None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:24.322879 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28ca48-2e22-489b-8f4a-787f446b60a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:24.328021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-ff28ca48-2e22-489b-8f4a-787f446b60a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:24.328021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:24.328021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:24.328021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:24.328021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:24.328021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:24.328021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:24.328021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:24.328021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:24.328021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:24.328021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:24.328021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:24.328021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:24.328021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:24.328021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:24.328021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:24.329516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:24.329516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:24.329516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:24.329516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:24.329516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:24.329516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:24.329516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:24.329516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:24.329516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:24.329516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:24.329516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:24.329516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:24.329516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:24.329516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:24.329516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:24.329516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:24.330536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:24.330536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:24.330536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:24.330536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:24.330536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:24.330536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:24.330536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:24.330536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:24.330536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:24.330536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:24.330536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:24.330536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:24.330536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 316/640] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:24.330536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28ca48-2e22-489b-8f4a-787f446b60a1 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:24.331514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-e840c4c6-0520-4dd1-812a-932dcd99ce7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:24.331514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:24.331514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:24.331514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:24.331514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:24.331514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:24.331514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:24.331514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:24.331514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:24.331514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:24.331514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:24.331514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:24.331514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:24.331514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:24.331514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:24.331514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:24.332558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:24.332558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:24.332558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:24.332558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:24.332558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:24.332558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:24.332558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:24.332558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:24.332558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:24.332558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:24.332558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:24.332558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:24.332558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:24.332558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:24.332558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:24.332558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:24.332558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:24.333737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:24.333737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:24.333737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:24.333737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 325/641] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:24.333737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840c4c6-0520-4dd1-812a-932dcd99ce7a None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:24.368298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:24.434605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28ca48-2e22-489b-8f4a-787f446b60a1 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:24.436494 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840c4c6-0520-4dd1-812a-932dcd99ce7a None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:24.455153 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:24.470023 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea4228-20c5-469b-bbc8-2334b139bcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:24.470726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea4228-20c5-469b-bbc8-2334b139bcab None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:24.470852 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49901d-8575-4b0e-b05e-d07a5d9ce668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:24.471036 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea4228-20c5-469b-bbc8-2334b139bcab None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:24.471310 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea4228-20c5-469b-bbc8-2334b139bcab None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:24.471488 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49901d-8575-4b0e-b05e-d07a5d9ce668 None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:24.471769 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49901d-8575-4b0e-b05e-d07a5d9ce668 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:24.471989 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea4228-20c5-469b-bbc8-2334b139bcab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:24.472082 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49901d-8575-4b0e-b05e-d07a5d9ce668 None admin] PATH_INFO: `/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/c924da83d1a94c49814d2e7b5969c8e9/roles/8801886a5f4e4695a29b60c6eb347932` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:24.472294 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea4228-20c5-469b-bbc8-2334b139bcab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:24.473723 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea4228-20c5-469b-bbc8-2334b139bcab None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:24.487520 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49901d-8575-4b0e-b05e-d07a5d9ce668 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fda1727cc3d47b9a1fae73c74f32c27, user_id=c924da83d1a94c49814d2e7b5969c8e9, role_id=8801886a5f4e4695a29b60c6eb347932)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:24.487892 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 317/642] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:24.488705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea4228-20c5-469b-bbc8-2334b139bcab None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:24.488954 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49901d-8575-4b0e-b05e-d07a5d9ce668 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:24.502017 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 326/643] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:23:24 2022] PUT /identity/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/c924da83d1a94c49814d2e7b5969c8e9/roles/8801886a5f4e4695a29b60c6eb347932 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:23:24.502809 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49901d-8575-4b0e-b05e-d07a5d9ce668 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:24.602364 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:24.608212 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea4228-20c5-469b-bbc8-2334b139bcab None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:24.622715 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49901d-8575-4b0e-b05e-d07a5d9ce668 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:24.650216 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437042f-8a8b-4c68-adfa-35493311aa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:24.651000 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437042f-8a8b-4c68-adfa-35493311aa76 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:24.651284 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437042f-8a8b-4c68-adfa-35493311aa76 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:24.651552 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437042f-8a8b-4c68-adfa-35493311aa76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:24.662298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82de14f-5296-4533-a158-b207511a5cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:24.662952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82de14f-5296-4533-a158-b207511a5cdd None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:24.663230 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82de14f-5296-4533-a158-b207511a5cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:24.663665 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82de14f-5296-4533-a158-b207511a5cdd None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:24.664325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437042f-8a8b-4c68-adfa-35493311aa76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:24.664527 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82de14f-5296-4533-a158-b207511a5cdd None admin] RBAC: Adding query filter params (name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:24.664835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82de14f-5296-4533-a158-b207511a5cdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:24.666196 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82de14f-5296-4533-a158-b207511a5cdd None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:24.669174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-0437042f-8a8b-4c68-adfa-35493311aa76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:24.669174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:24.669174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:24.669174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:24.669174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:24.669174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:24.669174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:24.669174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:24.669174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:24.669174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:24.669174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:24.669174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:24.669174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:24.669174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:24.669174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:24.669174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:24.678636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:24.678636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:24.678636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:24.678636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:24.678636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:24.678636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:24.678636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:24.678636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:24.678636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:24.678636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:24.678636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:24.678636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:24.678636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:24.678636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:24.678636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:24.678636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:24.679657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:24.679657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:24.679657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:24.679657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:24.679657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:24.679657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:24.679657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:24.679657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:24.679657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:24.679657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:24.679657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:24.679657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:24.679657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 318/644] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:24.679657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437042f-8a8b-4c68-adfa-35493311aa76 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:24.680637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 327/645] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:23:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:24.680637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82de14f-5296-4533-a158-b207511a5cdd None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:24.724993 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:24.787351 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82de14f-5296-4533-a158-b207511a5cdd None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:24.795382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437042f-8a8b-4c68-adfa-35493311aa76 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:24.824335 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7055b8-29fd-4c3d-90ea-00692d9058e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:24.824942 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7055b8-29fd-4c3d-90ea-00692d9058e3 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:24.825220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7055b8-29fd-4c3d-90ea-00692d9058e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:24.825504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7055b8-29fd-4c3d-90ea-00692d9058e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:24.826227 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7055b8-29fd-4c3d-90ea-00692d9058e3 None admin] RBAC: Adding query filter params (role.id=8801886a5f4e4695a29b60c6eb347932, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=3d6eaeb6bced49afabc7bdaa5e7cecfb) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:24.826538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7055b8-29fd-4c3d-90ea-00692d9058e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:24.827988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7055b8-29fd-4c3d-90ea-00692d9058e3 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:24.832276 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f3139-b9ec-4e60-9eb7-45e7086dd0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:24.832879 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f3139-b9ec-4e60-9eb7-45e7086dd0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:24.833155 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f3139-b9ec-4e60-9eb7-45e7086dd0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:24.833424 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f3139-b9ec-4e60-9eb7-45e7086dd0f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:24.834061 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f3139-b9ec-4e60-9eb7-45e7086dd0f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:24.834362 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f3139-b9ec-4e60-9eb7-45e7086dd0f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:24.835192 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 328/646] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:23:24 2022] GET /identity/v3/role_assignments?user.id=3d6eaeb6bced49afabc7bdaa5e7cecfb&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=8801886a5f4e4695a29b60c6eb347932 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:24.835737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f3139-b9ec-4e60-9eb7-45e7086dd0f7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:24.836289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7055b8-29fd-4c3d-90ea-00692d9058e3 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:24.858581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 319/647] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:24.858581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f3139-b9ec-4e60-9eb7-45e7086dd0f7 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:24.864990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:24.972218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7055b8-29fd-4c3d-90ea-00692d9058e3 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:24.994074 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:24.998884 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f3139-b9ec-4e60-9eb7-45e7086dd0f7 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:25.012494 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b906b-1d4a-446d-8a51-0b6ae55df756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:25.013458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b906b-1d4a-446d-8a51-0b6ae55df756 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:25.013878 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b906b-1d4a-446d-8a51-0b6ae55df756 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:25.014293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b906b-1d4a-446d-8a51-0b6ae55df756 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:25.015130 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b906b-1d4a-446d-8a51-0b6ae55df756 None admin] RBAC: Adding query filter params (name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:25.015586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b906b-1d4a-446d-8a51-0b6ae55df756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:25.017141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b906b-1d4a-446d-8a51-0b6ae55df756 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:25.038733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 329/648] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:23:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:25.038733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b906b-1d4a-446d-8a51-0b6ae55df756 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:25.053120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cbd5d-c1ca-45f9-b6fb-e7a8b9e77fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:25.054807 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cbd5d-c1ca-45f9-b6fb-e7a8b9e77fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:25.055263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cbd5d-c1ca-45f9-b6fb-e7a8b9e77fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:25.055677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cbd5d-c1ca-45f9-b6fb-e7a8b9e77fc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:25.067785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cbd5d-c1ca-45f9-b6fb-e7a8b9e77fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:25.069422 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cbd5d-c1ca-45f9-b6fb-e7a8b9e77fc9 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:25.090469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-d29cbd5d-c1ca-45f9-b6fb-e7a8b9e77fc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:25.090469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:25.090469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:25.090469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:25.090469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:25.090469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:25.090469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:25.090469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:25.090469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:25.090469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:25.090469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:25.090469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:25.090469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:25.090469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:25.090469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:25.090469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:25.091676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:25.091676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:25.091676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:25.091676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:25.091676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:25.091676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:25.091676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:25.091676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:25.091676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:25.091676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:25.091676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:25.091676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:25.091676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:25.091676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:25.091676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:25.091676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:25.091676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:25.092759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:25.092759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:25.092759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:25.095484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 320/649] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:25.096693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cbd5d-c1ca-45f9-b6fb-e7a8b9e77fc9 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:25.131891 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:25.175622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b906b-1d4a-446d-8a51-0b6ae55df756 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:25.220240 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aaa9b-1c81-4c14-9dd0-fc69c0d57a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:25.221230 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aaa9b-1c81-4c14-9dd0-fc69c0d57a45 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:25.221693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aaa9b-1c81-4c14-9dd0-fc69c0d57a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:25.222161 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aaa9b-1c81-4c14-9dd0-fc69c0d57a45 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:25.228381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cbd5d-c1ca-45f9-b6fb-e7a8b9e77fc9 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:25.231645 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913aaa9b-1c81-4c14-9dd0-fc69c0d57a45 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:25.233349 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913aaa9b-1c81-4c14-9dd0-fc69c0d57a45 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:25.247375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-913aaa9b-1c81-4c14-9dd0-fc69c0d57a45 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 01:23:25.247375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:25.247375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:25.247375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:25.247375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:25.247375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:25.247375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:25.247375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:25.247375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:25.247375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:25.247375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:25.247375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:25.247375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:25.247375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:25.247375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:25.247375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:25.248609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:25.248609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:25.248609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:25.248609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:25.248609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:25.248609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:25.248609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:25.248609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:25.248609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:25.248609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:25.248609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:25.248609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:25.248609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:25.248609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:25.248609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:25.248609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:25.248609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:25.248609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:25.249748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:25.249748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:25.249748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:25.249748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:25.249748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:25.249748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:25.249748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:25.249748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:25.249748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 01:23:25.249748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:25.252086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 330/650] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:25.253085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aaa9b-1c81-4c14-9dd0-fc69c0d57a45 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:25.269684 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d5a9d-628b-4340-ad7e-af4b9563cee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:25.270315 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d5a9d-628b-4340-ad7e-af4b9563cee3 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:25.270595 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d5a9d-628b-4340-ad7e-af4b9563cee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:25.270891 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d5a9d-628b-4340-ad7e-af4b9563cee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:25.285264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d5a9d-628b-4340-ad7e-af4b9563cee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:25.286997 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d5a9d-628b-4340-ad7e-af4b9563cee3 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:25.306248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-a11d5a9d-628b-4340-ad7e-af4b9563cee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:25.306248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:25.306248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:25.306248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:25.306248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:25.306248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:25.306248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:25.306248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:25.306248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:25.306248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:25.306248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:25.306248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:25.306248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:25.306248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:25.306248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:25.306248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:25.307461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:25.307461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:25.307461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:25.307461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:25.307461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:25.307461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:25.307461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:25.307461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:25.307461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:25.307461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:25.307461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:25.307461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:25.307461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:25.307461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:25.307461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:25.307461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:25.307461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:25.308569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:25.308569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:25.308569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:25.310902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 321/651] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:25.311845 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d5a9d-628b-4340-ad7e-af4b9563cee3 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:25.317914 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:25.378068 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aaa9b-1c81-4c14-9dd0-fc69c0d57a45 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:25.411291 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:25.422066 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49900171-0ad4-4ff6-9e55-786e7c82106e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:25.423461 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49900171-0ad4-4ff6-9e55-786e7c82106e None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:25.423905 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49900171-0ad4-4ff6-9e55-786e7c82106e None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:25.424324 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49900171-0ad4-4ff6-9e55-786e7c82106e None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:25.425220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49900171-0ad4-4ff6-9e55-786e7c82106e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:25.425667 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49900171-0ad4-4ff6-9e55-786e7c82106e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:25.427327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49900171-0ad4-4ff6-9e55-786e7c82106e None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:25.442778 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 331/652] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:25.444659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49900171-0ad4-4ff6-9e55-786e7c82106e None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:25.454485 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d5a9d-628b-4340-ad7e-af4b9563cee3 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:25.497038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70579531-1ded-4ebf-a9ad-b738a4fb6c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:25.497578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70579531-1ded-4ebf-a9ad-b738a4fb6c5d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:25.497853 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70579531-1ded-4ebf-a9ad-b738a4fb6c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:25.498172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70579531-1ded-4ebf-a9ad-b738a4fb6c5d None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:25.498960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70579531-1ded-4ebf-a9ad-b738a4fb6c5d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:25.499313 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70579531-1ded-4ebf-a9ad-b738a4fb6c5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:25.502357 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70579531-1ded-4ebf-a9ad-b738a4fb6c5d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:25.525092 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 322/653] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Sep 26 01:23:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:25.525655 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70579531-1ded-4ebf-a9ad-b738a4fb6c5d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:25.561466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49900171-0ad4-4ff6-9e55-786e7c82106e None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:25.596942 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299993d4-981b-4867-b641-fb62858453e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:25.597535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299993d4-981b-4867-b641-fb62858453e6 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:25.597820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299993d4-981b-4867-b641-fb62858453e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:25.598099 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299993d4-981b-4867-b641-fb62858453e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:25.598815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299993d4-981b-4867-b641-fb62858453e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:25.599145 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299993d4-981b-4867-b641-fb62858453e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:25.600490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299993d4-981b-4867-b641-fb62858453e6 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:25.604217 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:25.613312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 332/654] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:25.614095 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299993d4-981b-4867-b641-fb62858453e6 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:25.652662 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70579531-1ded-4ebf-a9ad-b738a4fb6c5d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:25.678263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:25.688875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cd5ac-c659-4512-85ac-f1a6474df1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:25.689559 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cd5ac-c659-4512-85ac-f1a6474df1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:25.689842 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cd5ac-c659-4512-85ac-f1a6474df1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:25.690110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cd5ac-c659-4512-85ac-f1a6474df1c8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:25.697655 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cd5ac-c659-4512-85ac-f1a6474df1c8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:25.699203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cd5ac-c659-4512-85ac-f1a6474df1c8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:25.711521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-d15cd5ac-c659-4512-85ac-f1a6474df1c8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 01:23:25.711521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:25.711521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:25.711521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:25.711521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:25.711521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:25.711521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:25.711521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:25.711521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:25.711521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:25.711521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:25.711521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:25.711521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:25.711521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:25.711521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:25.711521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:25.712546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:25.712546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:25.712546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:25.712546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:25.712546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:25.712546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:25.712546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:25.712546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:25.712546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:25.712546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:25.712546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:25.712546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:25.712546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:25.712546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:25.712546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:25.712546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:25.712546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:25.712546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:25.713479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:25.713479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:25.713479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:25.713479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:25.713479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:25.713479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:25.713479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:25.713479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:25.713479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 01:23:25.713479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:25.717276 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 323/655] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:23:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:25.718127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cd5ac-c659-4512-85ac-f1a6474df1c8 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:25.755708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299993d4-981b-4867-b641-fb62858453e6 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:25.804398 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df4a7c-b7e4-43f3-bf34-12f0b69317f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:25.805500 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df4a7c-b7e4-43f3-bf34-12f0b69317f8 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:25.805948 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df4a7c-b7e4-43f3-bf34-12f0b69317f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:25.806620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df4a7c-b7e4-43f3-bf34-12f0b69317f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:25.827003 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cd5ac-c659-4512-85ac-f1a6474df1c8 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:25.851829 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:25.868432 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb178f-038b-461f-a643-8f64ce255c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:25.869415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb178f-038b-461f-a643-8f64ce255c08 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:25.869840 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb178f-038b-461f-a643-8f64ce255c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:25.870510 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb178f-038b-461f-a643-8f64ce255c08 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:25.881256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb178f-038b-461f-a643-8f64ce255c08 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:25.883598 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb178f-038b-461f-a643-8f64ce255c08 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:25.895592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df4a7c-b7e4-43f3-bf34-12f0b69317f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:25.897095 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df4a7c-b7e4-43f3-bf34-12f0b69317f8 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:25.898716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-e2bb178f-038b-461f-a643-8f64ce255c08 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 26 01:23:25.898716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:25.898716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:25.898716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:25.898716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:25.898716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:25.898716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:25.898716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:25.898716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:25.898716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:25.898716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:25.898716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:25.898716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:25.898716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:25.898716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:25.898716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:25.899858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:25.899858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:25.899858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:25.899858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:25.899858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:25.899858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:25.899858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:25.899858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:25.899858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:25.899858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:25.899858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:25.899858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:25.899858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:25.899858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:25.899858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:25.899858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:25.899858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:25.899858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:25.901031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:25.901031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:25.901031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:25.901031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:25.901031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:25.901031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:25.901031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:25.901031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:25.901031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 26 01:23:25.901031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:25.904155 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 324/656] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:23:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:25.905076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb178f-038b-461f-a643-8f64ce255c08 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:25.959027 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:26.023822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 333/657] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:23:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:23:26.025124 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df4a7c-b7e4-43f3-bf34-12f0b69317f8 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:26.030124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb178f-038b-461f-a643-8f64ce255c08 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:26.067559 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742706c-6bee-4148-8091-788529a11f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:26.068309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742706c-6bee-4148-8091-788529a11f8a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:26.068686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742706c-6bee-4148-8091-788529a11f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:26.069057 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742706c-6bee-4148-8091-788529a11f8a None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:26.069892 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742706c-6bee-4148-8091-788529a11f8a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:26.070575 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742706c-6bee-4148-8091-788529a11f8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:26.072472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742706c-6bee-4148-8091-788529a11f8a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:26.094159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 325/658] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Sep 26 01:23:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:26.100271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742706c-6bee-4148-8091-788529a11f8a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:26.146729 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:26.159130 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df4a7c-b7e4-43f3-bf34-12f0b69317f8 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:26.207935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15c947-6710-4692-905a-400d46cd1ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:26.209403 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15c947-6710-4692-905a-400d46cd1ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:26.209835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15c947-6710-4692-905a-400d46cd1ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:26.210507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15c947-6710-4692-905a-400d46cd1ca0 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:26.211410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15c947-6710-4692-905a-400d46cd1ca0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:26.211858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15c947-6710-4692-905a-400d46cd1ca0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:26.212568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742706c-6bee-4148-8091-788529a11f8a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:26.213587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15c947-6710-4692-905a-400d46cd1ca0 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:26.237915 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 334/659] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Sep 26 01:23:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:26.238995 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15c947-6710-4692-905a-400d46cd1ca0 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:26.255481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937726f-dbb2-4d0a-8623-7448aaef9202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:26.257429 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937726f-dbb2-4d0a-8623-7448aaef9202 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:26.258302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937726f-dbb2-4d0a-8623-7448aaef9202 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:26.259138 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:26.260537 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937726f-dbb2-4d0a-8623-7448aaef9202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:26.273712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937726f-dbb2-4d0a-8623-7448aaef9202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:26.275252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937726f-dbb2-4d0a-8623-7448aaef9202 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:26.291140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-d937726f-dbb2-4d0a-8623-7448aaef9202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:26.291140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:26.291140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:26.291140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:26.291140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:26.291140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:26.291140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:26.291140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:26.291140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:26.291140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:26.291140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:26.291140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:26.291140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:26.291140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:26.291140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:26.291140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:26.292119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:26.292119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:26.292119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:26.292119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:26.292119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:26.292119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:26.292119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:26.292119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:26.292119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:26.292119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:26.292119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:26.292119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:26.292119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:26.292119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:26.292119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:26.292119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:26.292119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:26.293014 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:26.293014 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:26.293014 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:26.297223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 326/660] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:26.298669 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937726f-dbb2-4d0a-8623-7448aaef9202 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:26.381992 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15c947-6710-4692-905a-400d46cd1ca0 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:26.402079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:26.418374 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937726f-dbb2-4d0a-8623-7448aaef9202 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:26.426676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf09cf2-c980-4a7d-bbe7-e90086dc80ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:26.427534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf09cf2-c980-4a7d-bbe7-e90086dc80ea None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:26.427973 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf09cf2-c980-4a7d-bbe7-e90086dc80ea None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:26.428383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf09cf2-c980-4a7d-bbe7-e90086dc80ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:26.463133 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd51fc-945f-4310-8497-560bbcd37f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:26.464204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd51fc-945f-4310-8497-560bbcd37f50 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:26.464890 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd51fc-945f-4310-8497-560bbcd37f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:26.465309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd51fc-945f-4310-8497-560bbcd37f50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:26.523438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf09cf2-c980-4a7d-bbe7-e90086dc80ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:26.525865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf09cf2-c980-4a7d-bbe7-e90086dc80ea None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:26.540374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:26.558037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd51fc-945f-4310-8497-560bbcd37f50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:26.560649 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd51fc-945f-4310-8497-560bbcd37f50 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:26.646451 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 335/661] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:23:26.647550 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf09cf2-c980-4a7d-bbe7-e90086dc80ea None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:26.680101 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:26.696053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 327/662] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:23:26.697147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd51fc-945f-4310-8497-560bbcd37f50 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:26.765431 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf09cf2-c980-4a7d-bbe7-e90086dc80ea None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:26.776563 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:26.799877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd51fc-945f-4310-8497-560bbcd37f50 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:26.803167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eca512-a042-4694-b554-a1424b489d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:26.803765 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eca512-a042-4694-b554-a1424b489d87 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:26.804040 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eca512-a042-4694-b554-a1424b489d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:26.804308 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eca512-a042-4694-b554-a1424b489d87 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:26.804939 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eca512-a042-4694-b554-a1424b489d87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:26.805236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eca512-a042-4694-b554-a1424b489d87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:26.806566 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eca512-a042-4694-b554-a1424b489d87 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:26.825169 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 336/663] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:26.825169 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eca512-a042-4694-b554-a1424b489d87 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:26.838729 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf271f0-6199-400c-8104-58e222583795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:26.839393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf271f0-6199-400c-8104-58e222583795 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:26.839669 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf271f0-6199-400c-8104-58e222583795 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:26.839938 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf271f0-6199-400c-8104-58e222583795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:26.850268 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf271f0-6199-400c-8104-58e222583795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:26.851729 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf271f0-6199-400c-8104-58e222583795 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:26.866940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-daf271f0-6199-400c-8104-58e222583795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:26.866940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:26.866940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:26.866940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:26.866940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:26.866940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:26.866940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:26.866940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:26.866940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:26.866940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:26.866940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:26.866940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:26.866940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:26.866940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:26.866940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:26.866940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:26.868120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:26.868120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:26.868120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:26.868120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:26.868120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:26.868120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:26.868120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:26.868120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:26.868120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:26.868120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:26.868120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:26.868120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:26.868120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:26.868120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:26.868120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:26.868120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:26.868120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:26.869011 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:26.869011 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:26.869011 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:26.869011 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 328/664] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:26.869237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be51bc-0891-41a1-97af-14f56cba8bac None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:26.869665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be51bc-0891-41a1-97af-14f56cba8bac None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:26.869764 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be51bc-0891-41a1-97af-14f56cba8bac None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:26.875143 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 329/665] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:26.876990 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be51bc-0891-41a1-97af-14f56cba8bac None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:26.927077 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:26.933184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eca512-a042-4694-b554-a1424b489d87 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:26.971398 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102af18d-aecc-4b4a-ba56-cc4265a4e578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:26.972020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102af18d-aecc-4b4a-ba56-cc4265a4e578 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:26.972295 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102af18d-aecc-4b4a-ba56-cc4265a4e578 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:26.972562 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102af18d-aecc-4b4a-ba56-cc4265a4e578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:26.985621 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102af18d-aecc-4b4a-ba56-cc4265a4e578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:26.987177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102af18d-aecc-4b4a-ba56-cc4265a4e578 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:26.987755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be51bc-0891-41a1-97af-14f56cba8bac None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:27.003052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-102af18d-aecc-4b4a-ba56-cc4265a4e578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:27.003052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:27.003052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:27.003052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:27.003052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:27.003052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:27.003052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:27.003052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:27.003052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:27.003052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:27.003052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:27.003052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:27.003052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:27.003052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:27.003052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:27.003052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:27.004166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:27.004166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:27.004166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:27.004166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:27.004166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:27.004166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:27.004166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:27.004166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:27.004166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:27.004166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:27.004166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:27.004166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:27.004166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:27.004166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:27.004166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:27.004166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:27.004166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:27.005047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:27.005047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:27.005047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:27.005047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 337/666] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:27.005047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102af18d-aecc-4b4a-ba56-cc4265a4e578 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:27.030384 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:27.030633 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5061784-63af-4233-b3be-fda893790cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:27.033421 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5061784-63af-4233-b3be-fda893790cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:27.033882 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5061784-63af-4233-b3be-fda893790cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:27.035098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5061784-63af-4233-b3be-fda893790cc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:27.044740 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5061784-63af-4233-b3be-fda893790cc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:27.046186 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5061784-63af-4233-b3be-fda893790cc8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:27.057483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-f5061784-63af-4233-b3be-fda893790cc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:27.057483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:27.057483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:27.057483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:27.057483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:27.057483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:27.057483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:27.057483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:27.057483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:27.057483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:27.057483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:27.057483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:27.057483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:27.057483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:27.057483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:27.058377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:27.058377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:27.058377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:27.058377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:27.058377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:27.058377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:27.058377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:27.058377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:27.058377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:27.058377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:27.058377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:27.058377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:27.058377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:27.058377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:27.058377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:27.058377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:27.058377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:27.065090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:27.065090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:27.065090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:27.065090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:27.065090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:27.065090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:27.065090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:27.065090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:27.065090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 330/667] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:27.065090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3ec55-177e-4991-9f79-5a39afe5475a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:27.065090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3ec55-177e-4991-9f79-5a39afe5475a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:27.065696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3ec55-177e-4991-9f79-5a39afe5475a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:27.081150 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-a9a3ec55-177e-4991-9f79-5a39afe5475a None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:27.082365 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a9a3ec55-177e-4991-9f79-5a39afe5475a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:27.116636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102af18d-aecc-4b4a-ba56-cc4265a4e578 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:27.154289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d4d56-efa4-4ce9-8221-e32d3f6cff96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:27.154932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d4d56-efa4-4ce9-8221-e32d3f6cff96 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:27.155212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d4d56-efa4-4ce9-8221-e32d3f6cff96 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:27.155485 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d4d56-efa4-4ce9-8221-e32d3f6cff96 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:27.155856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 331/668] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:27.157054 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3ec55-177e-4991-9f79-5a39afe5475a None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:27.167681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d4d56-efa4-4ce9-8221-e32d3f6cff96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:27.168872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d4d56-efa4-4ce9-8221-e32d3f6cff96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:27.171223 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d4d56-efa4-4ce9-8221-e32d3f6cff96 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:27.190713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 338/669] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:27.191917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d4d56-efa4-4ce9-8221-e32d3f6cff96 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:27.197859 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:27.278243 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3ec55-177e-4991-9f79-5a39afe5475a None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:27.292896 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:27.312481 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d4d56-efa4-4ce9-8221-e32d3f6cff96 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:27.315581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed90e90-9d36-4a28-8a9d-cec01b330ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:27.316391 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed90e90-9d36-4a28-8a9d-cec01b330ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:27.316668 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed90e90-9d36-4a28-8a9d-cec01b330ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:27.316932 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed90e90-9d36-4a28-8a9d-cec01b330ac5 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:27.317563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed90e90-9d36-4a28-8a9d-cec01b330ac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:27.317860 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed90e90-9d36-4a28-8a9d-cec01b330ac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:27.319270 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed90e90-9d36-4a28-8a9d-cec01b330ac5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:27.335661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 332/670] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:27.335661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed90e90-9d36-4a28-8a9d-cec01b330ac5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:27.355371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7eca9-c1fa-4350-bcf1-ddd4edf03c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:27.356428 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7eca9-c1fa-4350-bcf1-ddd4edf03c95 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:27.356428 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7eca9-c1fa-4350-bcf1-ddd4edf03c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:27.356726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7eca9-c1fa-4350-bcf1-ddd4edf03c95 None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:27.357413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7eca9-c1fa-4350-bcf1-ddd4edf03c95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:27.357717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7eca9-c1fa-4350-bcf1-ddd4edf03c95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:27.359320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7eca9-c1fa-4350-bcf1-ddd4edf03c95 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:27.376821 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 339/671] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:27.376821 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f0d5b-6b03-4211-b143-8047bc343f88 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:27.376821 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f0d5b-6b03-4211-b143-8047bc343f88 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:27.376821 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f0d5b-6b03-4211-b143-8047bc343f88 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:27.376821 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 340/672] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:27.376821 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f0d5b-6b03-4211-b143-8047bc343f88 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:27.442789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:27.450273 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed90e90-9d36-4a28-8a9d-cec01b330ac5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:27.484271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89768b92-4c8d-483e-b380-987700c4ce11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:27.484916 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89768b92-4c8d-483e-b380-987700c4ce11 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:27.485192 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89768b92-4c8d-483e-b380-987700c4ce11 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:27.485476 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89768b92-4c8d-483e-b380-987700c4ce11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:27.486621 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f0d5b-6b03-4211-b143-8047bc343f88 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:27.491961 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89768b92-4c8d-483e-b380-987700c4ce11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:27.493389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89768b92-4c8d-483e-b380-987700c4ce11 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:27.504616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-89768b92-4c8d-483e-b380-987700c4ce11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:27.504616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:27.504616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:27.504616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:27.504616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:27.504616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:27.504616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:27.504616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:27.504616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:27.504616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:27.504616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:27.504616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:27.504616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:27.504616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:27.504616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:27.505666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:27.505666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:27.505666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:27.505666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:27.505666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:27.505666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:27.505666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:27.505666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:27.505666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:27.505666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:27.505666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:27.505666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:27.505666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:27.505666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:27.505666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:27.505666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:27.505666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:27.507139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:27.507139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:27.507139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:27.507139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:27.507139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:27.507139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:27.507139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:27.507139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:27.507139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 333/673] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:27.507139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89768b92-4c8d-483e-b380-987700c4ce11 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:27.524309 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7140c-5e3b-4b18-b4f2-b06d90276395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:27.524922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7140c-5e3b-4b18-b4f2-b06d90276395 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:27.525194 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7140c-5e3b-4b18-b4f2-b06d90276395 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:27.525460 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7140c-5e3b-4b18-b4f2-b06d90276395 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:27.532586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7140c-5e3b-4b18-b4f2-b06d90276395 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:27.533984 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7140c-5e3b-4b18-b4f2-b06d90276395 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:27.544810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-dac7140c-5e3b-4b18-b4f2-b06d90276395 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:27.544810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:27.544810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:27.544810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:27.544810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:27.544810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:27.544810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:27.544810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:27.544810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:27.544810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:27.544810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:27.544810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:27.544810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:27.544810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:27.544810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:27.545829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:27.545829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:27.545829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:27.545829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:27.545829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:27.545829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:27.545829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:27.545829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:27.545829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:27.545829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:27.545829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:27.545829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:27.545829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:27.545829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:27.545829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:27.545829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:27.545829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:27.546952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:27.546952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:27.546952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:27.546952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:27.546952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:27.546952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:27.546952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:27.546952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:27.550499 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 341/674] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:27.551599 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9e7cb-4478-48ad-b1f1-34766f42d5e7 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:27.551876 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9e7cb-4478-48ad-b1f1-34766f42d5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:27.552145 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9e7cb-4478-48ad-b1f1-34766f42d5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:27.558243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:27.570846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-b8a9e7cb-4478-48ad-b1f1-34766f42d5e7 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:27.572093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b8a9e7cb-4478-48ad-b1f1-34766f42d5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:27.605967 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89768b92-4c8d-483e-b380-987700c4ce11 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:27.636811 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 342/675] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:27.637639 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9e7cb-4478-48ad-b1f1-34766f42d5e7 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:27.644493 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ea8a4-0131-4eba-be2c-8267a576623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:27.645095 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ea8a4-0131-4eba-be2c-8267a576623a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:27.645379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ea8a4-0131-4eba-be2c-8267a576623a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:27.645657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ea8a4-0131-4eba-be2c-8267a576623a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:27.646376 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ea8a4-0131-4eba-be2c-8267a576623a None admin] RBAC: Adding query filter params (role.id=8801886a5f4e4695a29b60c6eb347932, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=80c1005979d04c55b8746c25b0994086) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:27.646690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ea8a4-0131-4eba-be2c-8267a576623a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:27.648163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ea8a4-0131-4eba-be2c-8267a576623a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:27.654318 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 334/676] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:23:27 2022] GET /identity/v3/role_assignments?user.id=80c1005979d04c55b8746c25b0994086&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=8801886a5f4e4695a29b60c6eb347932 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:27.654972 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ea8a4-0131-4eba-be2c-8267a576623a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:27.686567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:27.780460 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9e7cb-4478-48ad-b1f1-34766f42d5e7 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:27.781458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ea8a4-0131-4eba-be2c-8267a576623a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:27.826797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:27.828140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885bb73-4edc-4c00-b7bb-2b6520a73bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:27.828858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885bb73-4edc-4c00-b7bb-2b6520a73bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:27.829140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885bb73-4edc-4c00-b7bb-2b6520a73bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:27.829553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885bb73-4edc-4c00-b7bb-2b6520a73bf5 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:27.830401 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885bb73-4edc-4c00-b7bb-2b6520a73bf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:27.830713 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885bb73-4edc-4c00-b7bb-2b6520a73bf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:27.832187 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885bb73-4edc-4c00-b7bb-2b6520a73bf5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:27.838320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078e376-fb40-4da6-a6fa-406b4bcea7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:27.839245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078e376-fb40-4da6-a6fa-406b4bcea7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:27.839684 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078e376-fb40-4da6-a6fa-406b4bcea7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:27.840084 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078e376-fb40-4da6-a6fa-406b4bcea7b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:27.849303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 335/677] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:27.850188 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885bb73-4edc-4c00-b7bb-2b6520a73bf5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:27.855318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078e376-fb40-4da6-a6fa-406b4bcea7b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:27.862115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-a078e376-fb40-4da6-a6fa-406b4bcea7b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:27.862115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:27.862115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:27.862115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:27.862115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:27.862115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:27.862115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:27.862115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:27.862115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:27.862115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:27.862115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:27.862115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:27.862115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:27.862115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:27.862115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:27.862115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:27.863128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:27.863128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:27.863128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:27.863128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:27.863128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:27.863128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:27.863128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:27.863128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:27.863128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:27.863128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:27.863128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:27.863128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:27.863128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:27.863128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:27.863128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:27.863128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:27.863953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:27.863953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:27.863953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:27.863953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:27.863953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:27.863953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:27.863953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:27.863953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:27.863953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:27.863953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:27.863953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:27.863953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:27.867056 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 343/678] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:27.867731 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078e376-fb40-4da6-a6fa-406b4bcea7b7 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:27.945567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:27.975446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885bb73-4edc-4c00-b7bb-2b6520a73bf5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:27.986307 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078e376-fb40-4da6-a6fa-406b4bcea7b7 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:28.012282 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7ee88-0e9c-48ef-804f-6b2856fed345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:28.012889 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7ee88-0e9c-48ef-804f-6b2856fed345 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:28.013167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7ee88-0e9c-48ef-804f-6b2856fed345 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:28.013435 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7ee88-0e9c-48ef-804f-6b2856fed345 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:28.014124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7ee88-0e9c-48ef-804f-6b2856fed345 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:28.014427 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7ee88-0e9c-48ef-804f-6b2856fed345 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:28.015889 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7ee88-0e9c-48ef-804f-6b2856fed345 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:28.022379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da9a1a-1c40-4e66-9a65-71e27de80f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:28.023253 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da9a1a-1c40-4e66-9a65-71e27de80f1f None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:28.023538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da9a1a-1c40-4e66-9a65-71e27de80f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:28.023871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da9a1a-1c40-4e66-9a65-71e27de80f1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:28.024888 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da9a1a-1c40-4e66-9a65-71e27de80f1f None admin] RBAC: Adding query filter params (role.id=8801886a5f4e4695a29b60c6eb347932, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=eab8abb1394d41e3a30439699086da28) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:28.024888 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da9a1a-1c40-4e66-9a65-71e27de80f1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:28.026300 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da9a1a-1c40-4e66-9a65-71e27de80f1f None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:28.028265 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 336/679] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:28.029093 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7ee88-0e9c-48ef-804f-6b2856fed345 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:28.046857 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 344/680] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:23:27 2022] GET /identity/v3/role_assignments?user.id=eab8abb1394d41e3a30439699086da28&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=8801886a5f4e4695a29b60c6eb347932 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:28.046857 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da9a1a-1c40-4e66-9a65-71e27de80f1f None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:28.119845 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:28.170260 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7ee88-0e9c-48ef-804f-6b2856fed345 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:28.172518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da9a1a-1c40-4e66-9a65-71e27de80f1f None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:28.209455 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28f190-fb01-49bb-988e-4e4552909262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:28.210179 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28f190-fb01-49bb-988e-4e4552909262 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:28.210624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28f190-fb01-49bb-988e-4e4552909262 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:28.211026 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28f190-fb01-49bb-988e-4e4552909262 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:28.211132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc547d6-a721-4b6d-89e9-1729b5abad19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:28.211817 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc547d6-a721-4b6d-89e9-1729b5abad19 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:28.211938 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28f190-fb01-49bb-988e-4e4552909262 None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:28.212221 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc547d6-a721-4b6d-89e9-1729b5abad19 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:28.212323 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28f190-fb01-49bb-988e-4e4552909262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:28.212616 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc547d6-a721-4b6d-89e9-1729b5abad19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:28.213834 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28f190-fb01-49bb-988e-4e4552909262 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:28.220221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:28.226757 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 337/681] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:23:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:28.227297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc547d6-a721-4b6d-89e9-1729b5abad19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:28.232865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28f190-fb01-49bb-988e-4e4552909262 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:28.233069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-bbc547d6-a721-4b6d-89e9-1729b5abad19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:23:28.233069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:28.233069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:28.233069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:28.233069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:28.233069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:28.233069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:28.233069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:28.233069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:28.233069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:28.233069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:28.233069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:28.233069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:28.233069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:28.233069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:28.233069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:28.233951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:28.233951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:28.233951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:28.233951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:28.233951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:28.233951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:28.233951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:28.233951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:28.233951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:28.233951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:28.233951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:28.233951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:28.233951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:28.233951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:28.233951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:28.233951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:28.235360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:28.235360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:28.235360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:28.235360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:28.235360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:28.235360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:28.235360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:28.235360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:28.235360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:28.235360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:28.235360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:23:28.235360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:28.235360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 345/682] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:23:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:28.236563 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc547d6-a721-4b6d-89e9-1729b5abad19 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:28.358864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc547d6-a721-4b6d-89e9-1729b5abad19 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:28.359608 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28f190-fb01-49bb-988e-4e4552909262 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:28.379984 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:28.402872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be2698-dc94-447d-833f-63a23c7da8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:28.403524 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be2698-dc94-447d-833f-63a23c7da8ea None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:28.403808 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be2698-dc94-447d-833f-63a23c7da8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:28.404083 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be2698-dc94-447d-833f-63a23c7da8ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:28.408594 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8aed4c-6edb-4777-8217-287243136b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:28.409495 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8aed4c-6edb-4777-8217-287243136b34 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:28.410003 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8aed4c-6edb-4777-8217-287243136b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:28.410474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8aed4c-6edb-4777-8217-287243136b34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:28.411698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8aed4c-6edb-4777-8217-287243136b34 None admin] RBAC: Adding query filter params (role.id=8801886a5f4e4695a29b60c6eb347932, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=15538b95acef435798ff7651fc1710cb) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:28.412239 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8aed4c-6edb-4777-8217-287243136b34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:28.413879 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8aed4c-6edb-4777-8217-287243136b34 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:28.416377 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be2698-dc94-447d-833f-63a23c7da8ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:28.417806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be2698-dc94-447d-833f-63a23c7da8ea None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:28.421525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 338/683] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:23:28 2022] GET /identity/v3/role_assignments?user.id=15538b95acef435798ff7651fc1710cb&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=8801886a5f4e4695a29b60c6eb347932 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:28.423256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8aed4c-6edb-4777-8217-287243136b34 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:28.434036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-22be2698-dc94-447d-833f-63a23c7da8ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:28.434036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:28.434036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:28.434036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:28.434036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:28.434036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:28.434036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:28.434036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:28.434036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:28.434036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:28.434036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:28.434036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:28.434036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:28.434036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:28.434036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:28.434036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:28.435103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:28.435103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:28.435103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:28.435103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:28.435103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:28.435103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:28.435103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:28.435103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:28.435103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:28.435103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:28.435103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:28.435103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:28.435103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:28.435103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:28.435103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:28.435103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:28.435103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:28.436523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:28.436523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:28.436523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:28.436523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 346/684] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:28.445791 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be2698-dc94-447d-833f-63a23c7da8ea None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:28.500116 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:28.544088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8aed4c-6edb-4777-8217-287243136b34 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:28.583050 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975e972-8e7e-4dd4-8579-16332ab9d6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:28.583925 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975e972-8e7e-4dd4-8579-16332ab9d6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:28.584384 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975e972-8e7e-4dd4-8579-16332ab9d6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:28.584811 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975e972-8e7e-4dd4-8579-16332ab9d6e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:28.585720 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975e972-8e7e-4dd4-8579-16332ab9d6e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:28.586168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975e972-8e7e-4dd4-8579-16332ab9d6e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:28.587730 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975e972-8e7e-4dd4-8579-16332ab9d6e5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:28.598380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 339/685] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:23:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:28.603777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975e972-8e7e-4dd4-8579-16332ab9d6e5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:28.711901 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be2698-dc94-447d-833f-63a23c7da8ea None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:28.734120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975e972-8e7e-4dd4-8579-16332ab9d6e5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:28.764144 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa5fad-cb5c-4ef5-83d0-3260dc1553e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:28.765216 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:28.766368 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa5fad-cb5c-4ef5-83d0-3260dc1553e3 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:28.766661 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa5fad-cb5c-4ef5-83d0-3260dc1553e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:28.767021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa5fad-cb5c-4ef5-83d0-3260dc1553e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:28.768513 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa5fad-cb5c-4ef5-83d0-3260dc1553e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:28.768832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa5fad-cb5c-4ef5-83d0-3260dc1553e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:28.770342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa5fad-cb5c-4ef5-83d0-3260dc1553e3 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:28.777023 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0030da5-386c-4ddf-bf51-bea775a5768e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:28.778073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0030da5-386c-4ddf-bf51-bea775a5768e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:28.778445 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0030da5-386c-4ddf-bf51-bea775a5768e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:28.778813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0030da5-386c-4ddf-bf51-bea775a5768e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:28.785366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 347/686] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:23:28.790518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa5fad-cb5c-4ef5-83d0-3260dc1553e3 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:28.791523 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0030da5-386c-4ddf-bf51-bea775a5768e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:28.793089 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0030da5-386c-4ddf-bf51-bea775a5768e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:28.808497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-c0030da5-386c-4ddf-bf51-bea775a5768e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:28.808497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:28.808497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:28.808497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:28.808497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:28.808497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:28.808497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:28.808497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:28.808497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:28.808497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:28.808497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:28.808497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:28.808497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:28.808497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:28.808497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:28.808497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:28.809712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:28.809712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:28.809712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:28.809712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:28.809712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:28.809712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:28.809712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:28.809712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:28.809712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:28.809712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:28.809712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:28.809712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:28.809712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:28.809712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:28.809712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:28.809712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:28.809712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:28.810841 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:28.810841 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:28.810841 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:28.812103 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 340/687] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:28.818533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0030da5-386c-4ddf-bf51-bea775a5768e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:28.835305 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:28.927092 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa5fad-cb5c-4ef5-83d0-3260dc1553e3 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:28.952803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0030da5-386c-4ddf-bf51-bea775a5768e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:28.982939 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e62f3d-c80d-4080-bc48-87b383f01a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:28.986203 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e62f3d-c80d-4080-bc48-87b383f01a8b None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:28.986584 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e62f3d-c80d-4080-bc48-87b383f01a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:28.986990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e62f3d-c80d-4080-bc48-87b383f01a8b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:28.997913 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e62f3d-c80d-4080-bc48-87b383f01a8b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:29.000148 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e62f3d-c80d-4080-bc48-87b383f01a8b None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:29.018019 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd96c7-7ce8-425e-a405-ec9cc1caddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:29.018792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd96c7-7ce8-425e-a405-ec9cc1caddfc None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:29.019189 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd96c7-7ce8-425e-a405-ec9cc1caddfc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:29.019552 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd96c7-7ce8-425e-a405-ec9cc1caddfc None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:29.020293 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd96c7-7ce8-425e-a405-ec9cc1caddfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:29.024476 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd96c7-7ce8-425e-a405-ec9cc1caddfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:29.025945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd96c7-7ce8-425e-a405-ec9cc1caddfc None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:29.028650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-39e62f3d-c80d-4080-bc48-87b383f01a8b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 01:23:29.028650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:29.028650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:29.028650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:29.028650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:29.028650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:29.028650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:29.028650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:29.028650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:29.028650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:29.028650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:29.028650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:29.028650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:29.028650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:29.028650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:29.028650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:29.029771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:29.029771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:29.029771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:29.029771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:29.029771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:29.029771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:29.029771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:29.029771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:29.029771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:29.029771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:29.029771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:29.029771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:29.029771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:29.029771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:29.029771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:29.029771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:29.029771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:29.029771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:29.030991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:29.030991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:29.030991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:29.030991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:29.030991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:29.030991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:29.030991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:29.030991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:29.030991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 01:23:29.030991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:29.038637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 348/688] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:23:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:29.039529 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e62f3d-c80d-4080-bc48-87b383f01a8b None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:29.055775 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 341/689] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:29.065004 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd96c7-7ce8-425e-a405-ec9cc1caddfc None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:29.113043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:29.204203 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:29.217609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e62f3d-c80d-4080-bc48-87b383f01a8b None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:29.227807 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd96c7-7ce8-425e-a405-ec9cc1caddfc None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:29.257143 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ee6c7-0deb-43cc-936a-0f76951df212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:29.257673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ee6c7-0deb-43cc-936a-0f76951df212 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:29.257953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ee6c7-0deb-43cc-936a-0f76951df212 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:29.258285 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ee6c7-0deb-43cc-936a-0f76951df212 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:29.259092 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ee6c7-0deb-43cc-936a-0f76951df212 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:29.259438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ee6c7-0deb-43cc-936a-0f76951df212 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:29.261317 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ee6c7-0deb-43cc-936a-0f76951df212 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:29.273257 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1838b1-1475-452b-8e4c-1c1fbf1758a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:29.274231 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1838b1-1475-452b-8e4c-1c1fbf1758a7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:29.274708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1838b1-1475-452b-8e4c-1c1fbf1758a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:29.275202 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1838b1-1475-452b-8e4c-1c1fbf1758a7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:29.282657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 349/690] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Sep 26 01:23:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:29.283837 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1838b1-1475-452b-8e4c-1c1fbf1758a7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:29.285281 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1838b1-1475-452b-8e4c-1c1fbf1758a7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:29.287905 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ee6c7-0deb-43cc-936a-0f76951df212 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:29.297569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-7b1838b1-1475-452b-8e4c-1c1fbf1758a7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 01:23:29.297569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:29.297569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:29.297569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:29.297569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:29.297569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:29.297569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:29.297569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:29.297569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:29.297569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:29.297569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:29.297569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:29.297569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:29.297569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:29.297569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:29.297569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:29.298563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:29.298563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:29.298563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:29.298563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:29.298563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:29.298563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:29.298563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:29.298563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:29.298563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:29.298563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:29.298563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:29.298563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:29.298563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:29.298563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:29.298563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:29.298563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:29.298563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:29.298563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:29.299610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:29.299610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:29.299610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:29.299610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:29.299610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:29.299610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:29.299610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:29.299610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:29.299610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 01:23:29.299610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:29.302941 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 342/691] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 26 01:23:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:29.304508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1838b1-1475-452b-8e4c-1c1fbf1758a7 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:29.415572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ee6c7-0deb-43cc-936a-0f76951df212 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:29.417822 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:29.430815 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1838b1-1475-452b-8e4c-1c1fbf1758a7 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:29.455391 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009c421-49d5-41eb-9af7-31d0d3e26354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:29.456412 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009c421-49d5-41eb-9af7-31d0d3e26354 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:29.456888 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009c421-49d5-41eb-9af7-31d0d3e26354 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:29.457397 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009c421-49d5-41eb-9af7-31d0d3e26354 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:29.470784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d85cc-1034-4739-bda5-fdc35fb36758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:29.471703 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d85cc-1034-4739-bda5-fdc35fb36758 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:29.471703 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d85cc-1034-4739-bda5-fdc35fb36758 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:29.471957 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d85cc-1034-4739-bda5-fdc35fb36758 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:29.472676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d85cc-1034-4739-bda5-fdc35fb36758 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:29.472984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d85cc-1034-4739-bda5-fdc35fb36758 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:29.474417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d85cc-1034-4739-bda5-fdc35fb36758 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:29.477818 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:29.498938 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 343/692] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 26 01:23:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:29.500668 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d85cc-1034-4739-bda5-fdc35fb36758 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:29.573704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009c421-49d5-41eb-9af7-31d0d3e26354 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:29.575897 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009c421-49d5-41eb-9af7-31d0d3e26354 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:29.676478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d85cc-1034-4739-bda5-fdc35fb36758 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:29.729090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 350/693] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:23:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 01:23:29.730601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009c421-49d5-41eb-9af7-31d0d3e26354 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:29.743264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1817bc-3df1-4097-b485-fb3483cbca63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:29.744199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1817bc-3df1-4097-b485-fb3483cbca63 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:29.744673 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1817bc-3df1-4097-b485-fb3483cbca63 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:29.745135 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1817bc-3df1-4097-b485-fb3483cbca63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:29.795302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:29.825260 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1817bc-3df1-4097-b485-fb3483cbca63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:29.827069 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1817bc-3df1-4097-b485-fb3483cbca63 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:29.832422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:29.925016 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009c421-49d5-41eb-9af7-31d0d3e26354 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:29.935049 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 344/694] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:23:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 01:23:29.945649 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1817bc-3df1-4097-b485-fb3483cbca63 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:29.969206 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455fae3-b3aa-45ca-ab55-67f0db6350ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:29.970329 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455fae3-b3aa-45ca-ab55-67f0db6350ec None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:29.970607 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455fae3-b3aa-45ca-ab55-67f0db6350ec None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:29.974872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455fae3-b3aa-45ca-ab55-67f0db6350ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:29.981077 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455fae3-b3aa-45ca-ab55-67f0db6350ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:29.982651 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455fae3-b3aa-45ca-ab55-67f0db6350ec None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:29.997592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-c455fae3-b3aa-45ca-ab55-67f0db6350ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:29.997592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:29.997592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:29.997592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:29.997592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:29.997592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:29.997592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:29.997592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:29.997592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:29.997592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:29.997592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:29.997592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:29.997592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:29.997592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:29.997592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:29.997592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:29.998556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:29.998556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:29.998556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:29.998556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:29.998556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:29.998556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:29.998556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:29.998556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:29.998556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:29.998556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:29.998556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:29.998556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:29.998556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:29.998556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:29.998556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:29.998556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:29.998556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:29.999538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:29.999538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:29.999538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:29.999538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 351/695] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:30.004145 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455fae3-b3aa-45ca-ab55-67f0db6350ec None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:30.078245 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:30.127916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:30.135375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455fae3-b3aa-45ca-ab55-67f0db6350ec None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:30.182704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1817bc-3df1-4097-b485-fb3483cbca63 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:30.211228 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36f292-41bc-4b80-aba0-5930824e6d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:30.211835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36f292-41bc-4b80-aba0-5930824e6d62 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:30.212113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36f292-41bc-4b80-aba0-5930824e6d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:30.212383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36f292-41bc-4b80-aba0-5930824e6d62 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:30.213020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36f292-41bc-4b80-aba0-5930824e6d62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:30.213319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36f292-41bc-4b80-aba0-5930824e6d62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:30.214683 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36f292-41bc-4b80-aba0-5930824e6d62 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:30.228317 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 352/696] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:30.233901 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36f292-41bc-4b80-aba0-5930824e6d62 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:30.256220 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cef029-17ea-4c5d-892b-4a1cb6df6590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:30.256853 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cef029-17ea-4c5d-892b-4a1cb6df6590 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:30.257181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cef029-17ea-4c5d-892b-4a1cb6df6590 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:30.257551 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cef029-17ea-4c5d-892b-4a1cb6df6590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:30.269762 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cef029-17ea-4c5d-892b-4a1cb6df6590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:30.271395 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cef029-17ea-4c5d-892b-4a1cb6df6590 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:30.287872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-41cef029-17ea-4c5d-892b-4a1cb6df6590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:30.287872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:30.287872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:30.287872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:30.287872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:30.287872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:30.287872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:30.287872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:30.287872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:30.287872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:30.287872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:30.287872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:30.287872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:30.287872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:30.287872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:30.287872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:30.288877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:30.288877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:30.288877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:30.288877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:30.288877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:30.288877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:30.288877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:30.288877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:30.288877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:30.288877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:30.288877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:30.288877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:30.288877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:30.288877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:30.288877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:30.288877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:30.288877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:30.289772 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:30.289772 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:30.289772 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:30.293595 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 345/697] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:30.294997 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300cd7d-b1f8-452e-8059-cf99fd31d4f9 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:30.295290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300cd7d-b1f8-452e-8059-cf99fd31d4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:30.295565 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300cd7d-b1f8-452e-8059-cf99fd31d4f9 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:30.301758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 346/698] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:30.302596 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300cd7d-b1f8-452e-8059-cf99fd31d4f9 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:30.341045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36f292-41bc-4b80-aba0-5930824e6d62 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:30.378462 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77388710-fe46-49a1-90f1-00c0f9d33708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:30.379113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77388710-fe46-49a1-90f1-00c0f9d33708 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:30.379393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77388710-fe46-49a1-90f1-00c0f9d33708 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:30.379666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77388710-fe46-49a1-90f1-00c0f9d33708 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:30.387469 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77388710-fe46-49a1-90f1-00c0f9d33708 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:30.388896 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77388710-fe46-49a1-90f1-00c0f9d33708 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:30.405039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-77388710-fe46-49a1-90f1-00c0f9d33708 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:30.405039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:30.405039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:30.405039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:30.405039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:30.405039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:30.405039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:30.405039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:30.405039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:30.405039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:30.405039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:30.405039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:30.405039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:30.405039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:30.405039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:30.407644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:30.407644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:30.407644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:30.407644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:30.407644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:30.407644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:30.407644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:30.407644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:30.407644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:30.407644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:30.407644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:30.407644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:30.407644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:30.407644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:30.407644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:30.407644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:30.407644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:30.409740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:30.409740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:30.409740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:30.409740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:30.409740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:30.409740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:30.409740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:30.409740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:30.411969 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 353/699] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:30.413549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f374a5-a905-4632-a65e-19e161333984 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:30.413846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f374a5-a905-4632-a65e-19e161333984 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:30.414126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f374a5-a905-4632-a65e-19e161333984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:30.427910 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300cd7d-b1f8-452e-8059-cf99fd31d4f9 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:30.434597 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-b3f374a5-a905-4632-a65e-19e161333984 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:30.436258 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b3f374a5-a905-4632-a65e-19e161333984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:30.437961 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:30.452605 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:30.469506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacc1b1-26ac-4930-a0a7-3916926d93f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:30.470508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacc1b1-26ac-4930-a0a7-3916926d93f9 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:30.470961 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacc1b1-26ac-4930-a0a7-3916926d93f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:30.471440 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacc1b1-26ac-4930-a0a7-3916926d93f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:30.472222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacc1b1-26ac-4930-a0a7-3916926d93f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:30.472666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacc1b1-26ac-4930-a0a7-3916926d93f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:30.474439 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacc1b1-26ac-4930-a0a7-3916926d93f9 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:30.493364 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 347/700] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:30.495632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacc1b1-26ac-4930-a0a7-3916926d93f9 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:30.512582 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 354/701] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:30.513732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f374a5-a905-4632-a65e-19e161333984 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:30.620278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f374a5-a905-4632-a65e-19e161333984 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:30.671862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231ed38-fc70-4e30-8122-8f71fc3bf8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:30.673019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231ed38-fc70-4e30-8122-8f71fc3bf8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:30.673331 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231ed38-fc70-4e30-8122-8f71fc3bf8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:30.673900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231ed38-fc70-4e30-8122-8f71fc3bf8b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:30.693711 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231ed38-fc70-4e30-8122-8f71fc3bf8b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:30.699261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231ed38-fc70-4e30-8122-8f71fc3bf8b6 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:30.717822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-0231ed38-fc70-4e30-8122-8f71fc3bf8b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:30.717822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:30.717822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:30.717822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:30.717822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:30.717822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:30.717822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:30.717822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:30.717822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:30.717822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:30.717822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:30.717822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:30.717822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:30.717822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:30.717822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:30.718909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:30.718909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:30.718909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:30.718909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:30.718909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:30.718909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:30.718909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:30.718909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:30.718909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:30.718909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:30.718909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:30.718909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:30.718909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:30.718909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:30.718909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:30.718909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:30.718909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:30.719899 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:30.719899 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:30.719899 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:30.719899 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:30.719899 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:30.719899 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:30.719899 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:30.719899 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:30.726705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 355/702] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:30.728181 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231ed38-fc70-4e30-8122-8f71fc3bf8b6 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:30.741097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:30.756777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacc1b1-26ac-4930-a0a7-3916926d93f9 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:30.829547 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e839f9b-b860-423e-b788-7cac4e6e4f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:30.830404 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e839f9b-b860-423e-b788-7cac4e6e4f00 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:30.831420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e839f9b-b860-423e-b788-7cac4e6e4f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:30.831845 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e839f9b-b860-423e-b788-7cac4e6e4f00 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:30.833016 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e839f9b-b860-423e-b788-7cac4e6e4f00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:30.833484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e839f9b-b860-423e-b788-7cac4e6e4f00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:30.836012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e839f9b-b860-423e-b788-7cac4e6e4f00 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:30.843539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231ed38-fc70-4e30-8122-8f71fc3bf8b6 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:30.849848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 348/703] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:30.854683 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd8bc6-949f-48b0-b0a8-63ec008307b7 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:30.854683 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd8bc6-949f-48b0-b0a8-63ec008307b7 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:30.854683 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd8bc6-949f-48b0-b0a8-63ec008307b7 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:30.854683 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 349/704] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:30.854683 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd8bc6-949f-48b0-b0a8-63ec008307b7 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:30.884021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4743d19-85c6-464a-af48-de7b6754945c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:30.884546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4743d19-85c6-464a-af48-de7b6754945c None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:30.884817 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4743d19-85c6-464a-af48-de7b6754945c None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:30.885051 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:30.885167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4743d19-85c6-464a-af48-de7b6754945c None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:30.885753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4743d19-85c6-464a-af48-de7b6754945c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:30.886055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4743d19-85c6-464a-af48-de7b6754945c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:30.887670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4743d19-85c6-464a-af48-de7b6754945c None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:30.901415 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 356/705] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:30.902220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4743d19-85c6-464a-af48-de7b6754945c None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:30.971408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:30.976714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd8bc6-949f-48b0-b0a8-63ec008307b7 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:31.007584 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4743d19-85c6-464a-af48-de7b6754945c None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:31.014146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a999f40-1196-4f8e-82dd-67b26ec74a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:31.014778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a999f40-1196-4f8e-82dd-67b26ec74a1e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:31.015374 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a999f40-1196-4f8e-82dd-67b26ec74a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:31.015374 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a999f40-1196-4f8e-82dd-67b26ec74a1e None admin] PATH_INFO: `/v3/services/network` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:31.015941 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a999f40-1196-4f8e-82dd-67b26ec74a1e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:31.017333 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a999f40-1196-4f8e-82dd-67b26ec74a1e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:31.028503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-4a999f40-1196-4f8e-82dd-67b26ec74a1e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 01:23:31.028503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:31.028503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:23:31.028503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:23:31.028503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:23:31.028503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:23:31.028503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:23:31.028503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:31.028503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 01:23:31.028503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:31.028503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:23:31.028503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:31.028503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:31.028503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:31.028503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:31.028503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:31.028503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:31.029792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:31.029792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:31.029792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:31.029792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:31.029792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:31.029792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:31.029792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:23:31.029792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:23:31.029792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:23:31.029792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:23:31.029792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:31.029792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:31.029792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:31.029792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:31.029792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:31.029792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:31.030809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:31.030809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:31.030809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:31.030809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:31.030809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:31.030809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:31.030809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:31.030809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:31.030809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:31.030809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:31.030809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:23:31.030809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:31.030809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 01:23:31.030809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:31.030809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 350/706] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:30 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:31.032213 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8025c7-8fda-4f1e-a892-6cae54749a65 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:31.032213 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8025c7-8fda-4f1e-a892-6cae54749a65 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:31.032213 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8025c7-8fda-4f1e-a892-6cae54749a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:31.052821 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-eb8025c7-8fda-4f1e-a892-6cae54749a65 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:31.053061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7da73-b22d-40f3-b154-850a7d3b0b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:31.053550 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7da73-b22d-40f3-b154-850a7d3b0b38 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:31.053823 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7da73-b22d-40f3-b154-850a7d3b0b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:31.054051 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-eb8025c7-8fda-4f1e-a892-6cae54749a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:31.054151 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7da73-b22d-40f3-b154-850a7d3b0b38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:31.054872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7da73-b22d-40f3-b154-850a7d3b0b38 None admin] RBAC: Adding query filter params (role.id=8801886a5f4e4695a29b60c6eb347932, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=c924da83d1a94c49814d2e7b5969c8e9) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:31.055176 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7da73-b22d-40f3-b154-850a7d3b0b38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:31.056631 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7da73-b22d-40f3-b154-850a7d3b0b38 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:31.074860 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 357/707] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:23:30 2022] GET /identity/v3/role_assignments?user.id=c924da83d1a94c49814d2e7b5969c8e9&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=8801886a5f4e4695a29b60c6eb347932 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:31.074860 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7da73-b22d-40f3-b154-850a7d3b0b38 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:31.142522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 351/708] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:31.143462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8025c7-8fda-4f1e-a892-6cae54749a65 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:31.172887 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:31.216190 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7da73-b22d-40f3-b154-850a7d3b0b38 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:31.258354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8025c7-8fda-4f1e-a892-6cae54749a65 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:31.259131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:31.268852 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805acd8b-208b-49c1-991a-9d192e7842a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:31.269578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805acd8b-208b-49c1-991a-9d192e7842a4 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:31.270398 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805acd8b-208b-49c1-991a-9d192e7842a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:31.270755 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805acd8b-208b-49c1-991a-9d192e7842a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:31.272027 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805acd8b-208b-49c1-991a-9d192e7842a4 None admin] RBAC: Adding query filter params (role.id=50adf18edc1a47b2bae0876828a88dbf, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=3d6eaeb6bced49afabc7bdaa5e7cecfb) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:31.272415 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805acd8b-208b-49c1-991a-9d192e7842a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:31.274550 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805acd8b-208b-49c1-991a-9d192e7842a4 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:31.290278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 358/709] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:23:31 2022] GET /identity/v3/role_assignments?user.id=3d6eaeb6bced49afabc7bdaa5e7cecfb&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:31.290278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6abbee-ec50-4a56-92ae-8920900dfc52 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:31.290278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6abbee-ec50-4a56-92ae-8920900dfc52 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:31.290278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6abbee-ec50-4a56-92ae-8920900dfc52 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:31.290278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 359/710] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:31.296375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e805f72-17e7-48b1-aede-b97795a4c1be None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:31.296649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e805f72-17e7-48b1-aede-b97795a4c1be None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:31.296920 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e805f72-17e7-48b1-aede-b97795a4c1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:31.316595 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268932e-bd51-4969-b1c8-44855c87db9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:31.317760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268932e-bd51-4969-b1c8-44855c87db9b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:31.318188 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268932e-bd51-4969-b1c8-44855c87db9b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:31.318653 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268932e-bd51-4969-b1c8-44855c87db9b None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:31.319486 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268932e-bd51-4969-b1c8-44855c87db9b None admin] RBAC: Adding query filter params (name=network) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:31.319938 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268932e-bd51-4969-b1c8-44855c87db9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:31.322860 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268932e-bd51-4969-b1c8-44855c87db9b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:31.323063 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-5e805f72-17e7-48b1-aede-b97795a4c1be None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:31.324283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-5e805f72-17e7-48b1-aede-b97795a4c1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:31.331169 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 352/711] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 26 01:23:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:31.336184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268932e-bd51-4969-b1c8-44855c87db9b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:31.436020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 360/712] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:31.438697 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e805f72-17e7-48b1-aede-b97795a4c1be None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:31.483957 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:31.509449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268932e-bd51-4969-b1c8-44855c87db9b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:31.557784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a7c67-08a1-473f-a190-03081421e1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:31.558742 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a7c67-08a1-473f-a190-03081421e1fc None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:31.559188 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a7c67-08a1-473f-a190-03081421e1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:31.559602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a7c67-08a1-473f-a190-03081421e1fc None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:31.560436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a7c67-08a1-473f-a190-03081421e1fc None admin] RBAC: Adding query filter params (type=network) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:31.560933 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a7c67-08a1-473f-a190-03081421e1fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:31.562565 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a7c67-08a1-473f-a190-03081421e1fc None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:31.574712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 353/713] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 26 01:23:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:23:31.578418 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e805f72-17e7-48b1-aede-b97795a4c1be None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:31.613915 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:31.624549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6c78f-6c99-41d9-9f83-4fba91e5c454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:31.625375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6c78f-6c99-41d9-9f83-4fba91e5c454 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:31.625658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6c78f-6c99-41d9-9f83-4fba91e5c454 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:31.625931 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6c78f-6c99-41d9-9f83-4fba91e5c454 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:31.626529 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6c78f-6c99-41d9-9f83-4fba91e5c454 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:31.628158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6c78f-6c99-41d9-9f83-4fba91e5c454 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:31.640289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-88e6c78f-6c99-41d9-9f83-4fba91e5c454 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 01:23:31.640289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:31.640289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:23:31.640289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:23:31.640289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:23:31.640289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:23:31.640289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:23:31.640289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:31.640289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 01:23:31.640289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:31.640289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:23:31.640289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:31.640289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:31.640289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:31.640289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:31.640289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:31.640289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:31.642009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:31.642009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:31.642009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:31.642009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:31.642009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:31.642009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:31.642009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:23:31.642009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:23:31.642009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:23:31.642009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:23:31.642009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:31.642009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:31.642009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:31.642009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:31.642009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:31.642009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:31.642864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:31.642864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:31.642864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:31.642864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:31.642864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:31.642864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:31.642864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:31.642864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:31.642864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:31.642864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:31.642864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:23:31.642864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:31.642864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 01:23:31.642864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:31.642864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 361/714] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Sep 26 01:23:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:31.649021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a7c67-08a1-473f-a190-03081421e1fc None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:31.772761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6c78f-6c99-41d9-9f83-4fba91e5c454 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:31.802488 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a7c67-08a1-473f-a190-03081421e1fc None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:31.852705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df726d9-1950-46d1-808d-f895135b49ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:31.853181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df726d9-1950-46d1-808d-f895135b49ff None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:31.853555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df726d9-1950-46d1-808d-f895135b49ff None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:31.853902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df726d9-1950-46d1-808d-f895135b49ff None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:31.854607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df726d9-1950-46d1-808d-f895135b49ff None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:31.855016 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df726d9-1950-46d1-808d-f895135b49ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:31.856444 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df726d9-1950-46d1-808d-f895135b49ff None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:31.861989 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 354/715] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Sep 26 01:23:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:31.870125 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df726d9-1950-46d1-808d-f895135b49ff None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:31.895163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:31.906242 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6c78f-6c99-41d9-9f83-4fba91e5c454 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:31.954664 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee18c9c-1ca8-4c48-9574-98057455f9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:31.955389 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee18c9c-1ca8-4c48-9574-98057455f9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:31.955673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee18c9c-1ca8-4c48-9574-98057455f9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:31.955946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee18c9c-1ca8-4c48-9574-98057455f9f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:31.971671 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee18c9c-1ca8-4c48-9574-98057455f9f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:31.975524 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee18c9c-1ca8-4c48-9574-98057455f9f5 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:32.003799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-0ee18c9c-1ca8-4c48-9574-98057455f9f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:32.003799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:32.003799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:32.003799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:32.003799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:32.003799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:32.003799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:32.003799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:32.003799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:32.003799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:32.003799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:32.003799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:32.003799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:32.003799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:32.003799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:32.003799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:32.004849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:32.004849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:32.004849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:32.004849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:32.004849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:32.004849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:32.004849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:32.004849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:32.004849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:32.004849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:32.004849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:32.004849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:32.004849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:32.004849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:32.004849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:32.004849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:32.004849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:32.005747 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:32.005747 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:32.005747 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:32.006337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 362/716] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:32.016622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee18c9c-1ca8-4c48-9574-98057455f9f5 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:32.046022 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df726d9-1950-46d1-808d-f895135b49ff None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:32.110493 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:32.121043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ae479-f8f5-41dd-81aa-a698a892590e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:32.121661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ae479-f8f5-41dd-81aa-a698a892590e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:32.121937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ae479-f8f5-41dd-81aa-a698a892590e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:32.122202 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ae479-f8f5-41dd-81aa-a698a892590e None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:32.122848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ae479-f8f5-41dd-81aa-a698a892590e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:32.123170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ae479-f8f5-41dd-81aa-a698a892590e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:32.131300 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ae479-f8f5-41dd-81aa-a698a892590e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:32.140612 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 355/717] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Sep 26 01:23:31 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:32.163975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee18c9c-1ca8-4c48-9574-98057455f9f5 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:32.202587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1068b41-adc7-4b2a-9104-f1b8d1a62589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:32.203230 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1068b41-adc7-4b2a-9104-f1b8d1a62589 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:32.203646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1068b41-adc7-4b2a-9104-f1b8d1a62589 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:32.203920 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1068b41-adc7-4b2a-9104-f1b8d1a62589 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:32.204631 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1068b41-adc7-4b2a-9104-f1b8d1a62589 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:32.204931 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1068b41-adc7-4b2a-9104-f1b8d1a62589 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:32.206334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1068b41-adc7-4b2a-9104-f1b8d1a62589 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:32.219972 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 363/718] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:32.228444 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ae479-f8f5-41dd-81aa-a698a892590e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:32.366062 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:32.389459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ae479-f8f5-41dd-81aa-a698a892590e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:32.431891 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98a3ec-2249-4641-903b-ed6c03cb1da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:32.432497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98a3ec-2249-4641-903b-ed6c03cb1da6 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:32.432771 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98a3ec-2249-4641-903b-ed6c03cb1da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:32.433042 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98a3ec-2249-4641-903b-ed6c03cb1da6 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:32.433686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98a3ec-2249-4641-903b-ed6c03cb1da6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:32.435114 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98a3ec-2249-4641-903b-ed6c03cb1da6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:32.461563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 356/719] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 26 01:23:32 2022] POST /identity/v3/users => generated 254 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:23:33.798789 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c1444-4b66-4b47-8464-e04dc382e749 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:33.799324 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c1444-4b66-4b47-8464-e04dc382e749 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:33.799402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c1444-4b66-4b47-8464-e04dc382e749 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:33.801043 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 364/720] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:33.806952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7af50-99dc-4607-a7ab-087e04dd5967 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:33.807968 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7af50-99dc-4607-a7ab-087e04dd5967 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:33.808442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7af50-99dc-4607-a7ab-087e04dd5967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:33.829490 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-35d7af50-99dc-4607-a7ab-087e04dd5967 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:33.831206 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-35d7af50-99dc-4607-a7ab-087e04dd5967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:33.903611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 357/721] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:33.954259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123928a-f83b-4034-bd0f-c197a3b1d20e None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:33.954915 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123928a-f83b-4034-bd0f-c197a3b1d20e None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:33.955403 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123928a-f83b-4034-bd0f-c197a3b1d20e None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:33.956927 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 365/722] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:33.961983 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4395baf-3726-4b56-bd05-c6202fe24512 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:33.962506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4395baf-3726-4b56-bd05-c6202fe24512 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:33.963002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4395baf-3726-4b56-bd05-c6202fe24512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:33.987875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-b4395baf-3726-4b56-bd05-c6202fe24512 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:33.989371 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b4395baf-3726-4b56-bd05-c6202fe24512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:34.063992 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:34.078250 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 358/723] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:34.258101 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123928a-f83b-4034-bd0f-c197a3b1d20e None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:34.306614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29244df4-9e18-4f1c-971d-c66406b10047 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:34.306978 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29244df4-9e18-4f1c-971d-c66406b10047 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:34.307204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29244df4-9e18-4f1c-971d-c66406b10047 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:34.308788 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 359/724] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:34.314291 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3e025-8d72-45d8-8fcc-34096edcc3fd None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:34.314530 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3e025-8d72-45d8-8fcc-34096edcc3fd None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:34.314777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3e025-8d72-45d8-8fcc-34096edcc3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:34.333051 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-e2b3e025-8d72-45d8-8fcc-34096edcc3fd None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:34.334233 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e2b3e025-8d72-45d8-8fcc-34096edcc3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:34.404737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123928a-f83b-4034-bd0f-c197a3b1d20e None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:34.416092 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:34.453854 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 360/725] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 01:23:34.454809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3e025-8d72-45d8-8fcc-34096edcc3fd None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:34.471542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a41e9-af5c-4e25-91d0-29a7cf1bb20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:34.472166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a41e9-af5c-4e25-91d0-29a7cf1bb20d None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:34.472439 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a41e9-af5c-4e25-91d0-29a7cf1bb20d None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:34.472704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a41e9-af5c-4e25-91d0-29a7cf1bb20d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:34.491967 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a41e9-af5c-4e25-91d0-29a7cf1bb20d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:34.497736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-fa6a41e9-af5c-4e25-91d0-29a7cf1bb20d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:23:34.497736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:34.497736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:34.497736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:34.497736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:34.497736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:34.497736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:34.497736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:34.497736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:34.497736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:34.497736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:34.497736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:34.497736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:34.497736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:34.497736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:34.497736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:34.498658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:34.498658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:34.498658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:34.498658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:34.498658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:34.498658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:34.498658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:34.498658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:34.498658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:34.498658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:34.498658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:34.498658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:34.498658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:34.498658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:34.498658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:34.498658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:34.499551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:34.499551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:34.499551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:34.499551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:34.499551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:34.499551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:34.499551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:34.499551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:34.499551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:34.499551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:34.499551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:23:34.499551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:34.499551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 366/726] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:23:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:34.505783 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a41e9-af5c-4e25-91d0-29a7cf1bb20d None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:34.644462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3e025-8d72-45d8-8fcc-34096edcc3fd None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:34.695061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a41e9-af5c-4e25-91d0-29a7cf1bb20d None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:34.695809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:34.711865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40366036-a2e1-48e6-b2fe-c2c219633d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:34.712499 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40366036-a2e1-48e6-b2fe-c2c219633d0f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:34.714968 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40366036-a2e1-48e6-b2fe-c2c219633d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:34.715246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40366036-a2e1-48e6-b2fe-c2c219633d0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:34.737910 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40366036-a2e1-48e6-b2fe-c2c219633d0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:34.745952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-40366036-a2e1-48e6-b2fe-c2c219633d0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:23:34.745952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:34.745952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:34.745952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:34.745952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:34.745952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:34.745952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:34.745952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:34.745952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:34.745952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:34.745952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:34.745952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:34.745952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:34.745952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:34.745952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:34.745952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:34.746973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:34.746973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:34.746973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:34.746973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:34.746973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:34.746973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:34.746973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:34.746973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:34.746973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:34.746973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:34.746973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:34.746973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:34.746973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:34.746973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:34.746973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:34.746973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:34.747814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:34.747814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:34.747814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:34.747814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:34.747814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:34.747814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:34.747814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:34.747814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:34.747814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:34.747814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:34.747814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:23:34.747814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:34.747814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 361/727] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:23:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:34.757857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40366036-a2e1-48e6-b2fe-c2c219633d0f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:34.768219 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0484c0-d4c6-4a94-8010-ec8a74369788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:34.768832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0484c0-d4c6-4a94-8010-ec8a74369788 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:34.769111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0484c0-d4c6-4a94-8010-ec8a74369788 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:34.769386 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0484c0-d4c6-4a94-8010-ec8a74369788 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:34.770055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0484c0-d4c6-4a94-8010-ec8a74369788 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:34.770354 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0484c0-d4c6-4a94-8010-ec8a74369788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:34.771735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0484c0-d4c6-4a94-8010-ec8a74369788 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:34.782015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 367/728] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:23:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:34.783281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0484c0-d4c6-4a94-8010-ec8a74369788 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:34.809775 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:34.888644 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40366036-a2e1-48e6-b2fe-c2c219633d0f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:34.896349 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0484c0-d4c6-4a94-8010-ec8a74369788 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:34.933773 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45421fd-d7d3-4338-aa16-5b6be41978ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:34.934468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45421fd-d7d3-4338-aa16-5b6be41978ce None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:34.934860 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45421fd-d7d3-4338-aa16-5b6be41978ce None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:34.935231 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45421fd-d7d3-4338-aa16-5b6be41978ce None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:34.935985 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45421fd-d7d3-4338-aa16-5b6be41978ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:34.936241 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db51aed-1c5b-4eb7-9e7b-9acad3aac25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:34.936913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db51aed-1c5b-4eb7-9e7b-9acad3aac25a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:34.937256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db51aed-1c5b-4eb7-9e7b-9acad3aac25a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:34.937431 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45421fd-d7d3-4338-aa16-5b6be41978ce None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:34.937686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db51aed-1c5b-4eb7-9e7b-9acad3aac25a None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:34.938414 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db51aed-1c5b-4eb7-9e7b-9acad3aac25a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:34.938784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db51aed-1c5b-4eb7-9e7b-9acad3aac25a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:34.940219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db51aed-1c5b-4eb7-9e7b-9acad3aac25a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:34.950045 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 362/729] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:23:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:34.954903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db51aed-1c5b-4eb7-9e7b-9acad3aac25a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:34.955975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 368/730] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 26 01:23:34 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:23:34.957174 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd57088-ec55-47e5-8929-d0c5820cc561 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:34.957462 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd57088-ec55-47e5-8929-d0c5820cc561 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:34.957788 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd57088-ec55-47e5-8929-d0c5820cc561 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:34.959375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 369/731] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:34.960177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd57088-ec55-47e5-8929-d0c5820cc561 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:35.008460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:35.070646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:35.089431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db51aed-1c5b-4eb7-9e7b-9acad3aac25a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:35.104103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd57088-ec55-47e5-8929-d0c5820cc561 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:35.131280 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95aac8-8317-4542-917e-a1de3c3a0561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:35.131934 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95aac8-8317-4542-917e-a1de3c3a0561 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:35.132217 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95aac8-8317-4542-917e-a1de3c3a0561 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:35.132491 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95aac8-8317-4542-917e-a1de3c3a0561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:35.145739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95aac8-8317-4542-917e-a1de3c3a0561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:35.146427 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f800023-da3d-4c35-837e-378fac4f992c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:35.147241 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95aac8-8317-4542-917e-a1de3c3a0561 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:35.147360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f800023-da3d-4c35-837e-378fac4f992c None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:35.147931 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f800023-da3d-4c35-837e-378fac4f992c None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:35.148372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f800023-da3d-4c35-837e-378fac4f992c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:35.159520 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f800023-da3d-4c35-837e-378fac4f992c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:35.161295 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f800023-da3d-4c35-837e-378fac4f992c None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:35.166953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-9b95aac8-8317-4542-917e-a1de3c3a0561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:35.166953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:35.166953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:35.166953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:35.166953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:35.166953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:35.166953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:35.166953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:35.166953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:35.166953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:35.166953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:35.166953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:35.166953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:35.166953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:35.166953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:35.166953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:35.167896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:35.167896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:35.167896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:35.167896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:35.167896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:35.167896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:35.167896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:35.167896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:35.167896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:35.167896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:35.167896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:35.167896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:35.167896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:35.167896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:35.167896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:35.167896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:35.167896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:35.168834 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:35.168834 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:35.168834 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:35.170640 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 363/732] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:35.171855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2a796-2b40-4e9c-bb03-b05df6ae96ff None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:35.172672 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2a796-2b40-4e9c-bb03-b05df6ae96ff None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:35.172951 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2a796-2b40-4e9c-bb03-b05df6ae96ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:35.180949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-3f800023-da3d-4c35-837e-378fac4f992c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:35.180949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:35.180949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:35.180949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:35.180949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:35.180949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:35.180949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:35.180949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:35.180949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:35.180949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:35.180949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:35.180949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:35.180949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:35.180949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:35.180949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:35.180949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:35.181953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:35.181953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:35.181953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:35.181953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:35.181953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:35.181953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:35.181953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:35.181953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:35.181953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:35.181953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:35.181953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:35.181953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:35.181953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:35.181953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:35.181953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:35.181953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:35.181953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:35.182906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:35.182906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:35.182906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:35.184295 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 370/733] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:35.188971 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f800023-da3d-4c35-837e-378fac4f992c None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:35.193251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2dd2a796-2b40-4e9c-bb03-b05df6ae96ff None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:35.194444 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2dd2a796-2b40-4e9c-bb03-b05df6ae96ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:35.282971 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 364/734] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:35 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 01:23:35.284288 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2a796-2b40-4e9c-bb03-b05df6ae96ff None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:35.316185 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:35.336452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f800023-da3d-4c35-837e-378fac4f992c None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:35.399729 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2a796-2b40-4e9c-bb03-b05df6ae96ff None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:35.407632 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:35.425492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77be9a-8717-47d9-80bc-b08e67771ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:35.425958 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77be9a-8717-47d9-80bc-b08e67771ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:35.426244 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77be9a-8717-47d9-80bc-b08e67771ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:35.426516 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77be9a-8717-47d9-80bc-b08e67771ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:35.427267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77be9a-8717-47d9-80bc-b08e67771ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:35.427576 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77be9a-8717-47d9-80bc-b08e67771ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:35.428925 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77be9a-8717-47d9-80bc-b08e67771ec8 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:35.441940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34a5b5-b723-46fe-ac63-0a8365fd6386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:35.442962 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34a5b5-b723-46fe-ac63-0a8365fd6386 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:35.443436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34a5b5-b723-46fe-ac63-0a8365fd6386 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:35.443917 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34a5b5-b723-46fe-ac63-0a8365fd6386 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:35.444761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34a5b5-b723-46fe-ac63-0a8365fd6386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:35.445520 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34a5b5-b723-46fe-ac63-0a8365fd6386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:35.447119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34a5b5-b723-46fe-ac63-0a8365fd6386 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:35.457774 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 371/735] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:35.460080 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 365/736] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:35.464487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77be9a-8717-47d9-80bc-b08e67771ec8 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:35.466343 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34a5b5-b723-46fe-ac63-0a8365fd6386 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:35.580872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:35.590014 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34a5b5-b723-46fe-ac63-0a8365fd6386 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:35.628908 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242651d4-3422-4a29-b41a-31942d160ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:35.629898 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242651d4-3422-4a29-b41a-31942d160ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:35.630444 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242651d4-3422-4a29-b41a-31942d160ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:35.631063 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242651d4-3422-4a29-b41a-31942d160ba5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:35.642443 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242651d4-3422-4a29-b41a-31942d160ba5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:35.644535 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242651d4-3422-4a29-b41a-31942d160ba5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:35.665247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-242651d4-3422-4a29-b41a-31942d160ba5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 01:23:35.665247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:35.665247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:35.665247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:35.665247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:35.665247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:35.665247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:35.665247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:35.665247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:35.665247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:35.665247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:35.665247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:35.665247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:35.665247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:35.665247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:35.665247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:35.666219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:35.666219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:35.666219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:35.666219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:35.666219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:35.666219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:35.666219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:35.666219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:35.666219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:35.666219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:35.666219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:35.666219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:35.666219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:35.666219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:35.666219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:35.666219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:35.666219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:35.666219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:35.667275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:35.667275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:35.667275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:35.667275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:35.667275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:35.667275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:35.667275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:35.667275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:35.667275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 01:23:35.667275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:35.670218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 366/737] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 26 01:23:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:35.677475 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242651d4-3422-4a29-b41a-31942d160ba5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:35.696257 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77be9a-8717-47d9-80bc-b08e67771ec8 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:35.740963 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548e3da-f5f8-46d7-b7be-71f680534086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:35.741587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548e3da-f5f8-46d7-b7be-71f680534086 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:35.741917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548e3da-f5f8-46d7-b7be-71f680534086 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:35.742188 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548e3da-f5f8-46d7-b7be-71f680534086 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:35.750053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548e3da-f5f8-46d7-b7be-71f680534086 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:35.751698 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548e3da-f5f8-46d7-b7be-71f680534086 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:35.763922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-0548e3da-f5f8-46d7-b7be-71f680534086 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 01:23:35.763922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:35.763922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:35.763922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:35.763922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:35.763922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:35.763922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:35.763922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:35.763922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:35.763922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:35.763922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:35.763922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:35.763922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:35.763922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:35.763922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:35.763922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:35.764887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:35.764887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:35.764887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:35.764887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:35.764887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:35.764887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:35.764887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:35.764887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:35.764887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:35.764887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:35.764887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:35.764887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:35.764887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:35.764887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:35.764887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:35.764887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:35.764887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:35.764887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:35.771679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:35.771679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:35.771679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:35.771679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:35.771679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:35.771679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:35.771679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:35.771679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:35.771679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 01:23:35.771679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:35.771679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 372/738] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:23:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:35.771679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb5e7e-58cd-4b79-a387-574f1ba86f15 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:35.771679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb5e7e-58cd-4b79-a387-574f1ba86f15 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:35.772407 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb5e7e-58cd-4b79-a387-574f1ba86f15 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:35.772407 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 373/739] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:35.772407 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb5e7e-58cd-4b79-a387-574f1ba86f15 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:35.797836 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242651d4-3422-4a29-b41a-31942d160ba5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:35.827702 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:35.833431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de78e55-8bf7-4651-919e-7d577a27cfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:35.834040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de78e55-8bf7-4651-919e-7d577a27cfe5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:35.834322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de78e55-8bf7-4651-919e-7d577a27cfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:35.834591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de78e55-8bf7-4651-919e-7d577a27cfe5 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:35.835354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de78e55-8bf7-4651-919e-7d577a27cfe5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:35.835655 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de78e55-8bf7-4651-919e-7d577a27cfe5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:35.837066 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de78e55-8bf7-4651-919e-7d577a27cfe5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:35.859167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 367/740] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 26 01:23:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:35.860112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de78e55-8bf7-4651-919e-7d577a27cfe5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:35.868927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:35.889689 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb5e7e-58cd-4b79-a387-574f1ba86f15 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:35.926222 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88214be-8b9f-4437-af25-a16edde8fdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:35.927063 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88214be-8b9f-4437-af25-a16edde8fdbe None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:35.927350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88214be-8b9f-4437-af25-a16edde8fdbe None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:35.927626 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88214be-8b9f-4437-af25-a16edde8fdbe None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:35.928279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88214be-8b9f-4437-af25-a16edde8fdbe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:35.929652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88214be-8b9f-4437-af25-a16edde8fdbe None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:35.946601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 374/741] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 26 01:23:35 2022] POST /identity/v3/services => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:23:35.949661 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a0e4a-5cf3-4903-95ab-e13f99840537 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:35.950809 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a0e4a-5cf3-4903-95ab-e13f99840537 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:35.951109 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a0e4a-5cf3-4903-95ab-e13f99840537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:35.976390 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de78e55-8bf7-4651-919e-7d577a27cfe5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:35.981239 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-a46a0e4a-5cf3-4903-95ab-e13f99840537 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:35.982964 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a46a0e4a-5cf3-4903-95ab-e13f99840537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:36.024604 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2d659-81ef-49b2-b1aa-a15e28f81b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:36.025307 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2d659-81ef-49b2-b1aa-a15e28f81b5a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:36.025549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2d659-81ef-49b2-b1aa-a15e28f81b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:36.025827 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2d659-81ef-49b2-b1aa-a15e28f81b5a None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:36.026666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2d659-81ef-49b2-b1aa-a15e28f81b5a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:36.027324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2d659-81ef-49b2-b1aa-a15e28f81b5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:36.028642 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2d659-81ef-49b2-b1aa-a15e28f81b5a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:36.050389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 368/742] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Sep 26 01:23:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:36.051472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2d659-81ef-49b2-b1aa-a15e28f81b5a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:36.087418 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 375/743] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:23:36.088660 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a0e4a-5cf3-4903-95ab-e13f99840537 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:36.146304 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:36.148176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:36.205434 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2d659-81ef-49b2-b1aa-a15e28f81b5a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:36.213684 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a0e4a-5cf3-4903-95ab-e13f99840537 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:36.244385 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf417d-77d2-4bc6-b2c0-940c84065d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:36.245159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf417d-77d2-4bc6-b2c0-940c84065d8c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:36.245446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf417d-77d2-4bc6-b2c0-940c84065d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:36.245736 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf417d-77d2-4bc6-b2c0-940c84065d8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:36.257417 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdca41-9bfd-4b30-8df0-3d17fef7f63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:36.258504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdca41-9bfd-4b30-8df0-3d17fef7f63b None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:36.259179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdca41-9bfd-4b30-8df0-3d17fef7f63b None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:36.259651 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdca41-9bfd-4b30-8df0-3d17fef7f63b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:36.259756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf417d-77d2-4bc6-b2c0-940c84065d8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:36.261270 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf417d-77d2-4bc6-b2c0-940c84065d8c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:36.279856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-70bf417d-77d2-4bc6-b2c0-940c84065d8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:36.279856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:36.279856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:36.279856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:36.279856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:36.279856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:36.279856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:36.279856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:36.279856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:36.279856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:36.279856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:36.279856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:36.279856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:36.279856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:36.279856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:36.279856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:36.280848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:36.280848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:36.280848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:36.280848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:36.280848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:36.280848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:36.280848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:36.280848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:36.280848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:36.280848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:36.280848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:36.280848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:36.280848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:36.280848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:36.280848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:36.280848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:36.280848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:36.282354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:36.282354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:36.282354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:36.282354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 369/744] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:36.287452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf417d-77d2-4bc6-b2c0-940c84065d8c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:36.373373 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdca41-9bfd-4b30-8df0-3d17fef7f63b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:36.374842 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdca41-9bfd-4b30-8df0-3d17fef7f63b None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:36.453977 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:36.467775 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf417d-77d2-4bc6-b2c0-940c84065d8c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:36.481333 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:36.505099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f120bc-e2b7-41d2-ad8f-183e827fa8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:36.505805 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f120bc-e2b7-41d2-ad8f-183e827fa8d2 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:36.506088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f120bc-e2b7-41d2-ad8f-183e827fa8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:36.506453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f120bc-e2b7-41d2-ad8f-183e827fa8d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:36.507126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f120bc-e2b7-41d2-ad8f-183e827fa8d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:36.507427 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f120bc-e2b7-41d2-ad8f-183e827fa8d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:36.508880 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f120bc-e2b7-41d2-ad8f-183e827fa8d2 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:36.513193 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 376/745] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:23:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 01:23:36.514113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdca41-9bfd-4b30-8df0-3d17fef7f63b None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:36.527051 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 370/746] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:36.527992 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f120bc-e2b7-41d2-ad8f-183e827fa8d2 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:36.617344 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdca41-9bfd-4b30-8df0-3d17fef7f63b None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:36.642007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f120bc-e2b7-41d2-ad8f-183e827fa8d2 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:36.652525 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50183dde-c105-421a-8544-d522778e5311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:36.653158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50183dde-c105-421a-8544-d522778e5311 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:36.653537 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50183dde-c105-421a-8544-d522778e5311 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:36.653821 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50183dde-c105-421a-8544-d522778e5311 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:36.665034 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50183dde-c105-421a-8544-d522778e5311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:36.670267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-50183dde-c105-421a-8544-d522778e5311 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:36.670267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:36.670267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:36.670267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:36.670267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:36.670267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:36.670267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:36.670267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:36.670267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:36.670267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:36.670267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:36.670267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:36.670267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:36.670267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:36.670267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:36.670267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:36.671279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:36.671279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:36.671279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:36.671279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:36.671279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:36.671279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:36.671279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:36.671279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:36.671279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:36.671279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:36.671279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:36.671279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:36.671279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:36.671279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:36.671279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:36.671279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:36.672934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:36.672934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:36.672934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:36.672934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:36.672934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:36.672934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:36.672934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:36.672934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:36.672934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:36.672934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:36.672934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:36.672934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:36.672934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 377/747] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:36.674542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50183dde-c105-421a-8544-d522778e5311 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:36.678472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:36.685778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae880ed-8f34-4fbf-9985-214470abdee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:36.686518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae880ed-8f34-4fbf-9985-214470abdee6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:36.686796 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae880ed-8f34-4fbf-9985-214470abdee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:36.687097 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae880ed-8f34-4fbf-9985-214470abdee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:36.699139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae880ed-8f34-4fbf-9985-214470abdee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:36.700796 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae880ed-8f34-4fbf-9985-214470abdee6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:36.716786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-3ae880ed-8f34-4fbf-9985-214470abdee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:36.716786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:36.716786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:36.716786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:36.716786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:36.716786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:36.716786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:36.716786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:36.716786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:36.716786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:36.716786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:36.716786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:36.716786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:36.716786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:36.716786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:36.716786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:36.719111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:36.719111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:36.719111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:36.719111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:36.719111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:36.719111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:36.719111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:36.719111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:36.719111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:36.719111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:36.719111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:36.719111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:36.719111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:36.719111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:36.719111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:36.719111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:36.719111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:36.721468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:36.721468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:36.721468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:36.721468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 371/748] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:36.721468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae880ed-8f34-4fbf-9985-214470abdee6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:36.746996 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:36.782840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50183dde-c105-421a-8544-d522778e5311 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:36.820860 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e369d15-58d7-4d38-9a9b-7b39ebeaa82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:36.821485 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e369d15-58d7-4d38-9a9b-7b39ebeaa82e None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:36.821768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e369d15-58d7-4d38-9a9b-7b39ebeaa82e None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:36.822041 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e369d15-58d7-4d38-9a9b-7b39ebeaa82e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:36.829571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae880ed-8f34-4fbf-9985-214470abdee6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:36.832842 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e369d15-58d7-4d38-9a9b-7b39ebeaa82e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:36.834796 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e369d15-58d7-4d38-9a9b-7b39ebeaa82e None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:36.847988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-9e369d15-58d7-4d38-9a9b-7b39ebeaa82e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:36.847988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:36.847988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:36.847988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:36.847988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:36.847988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:36.847988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:36.847988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:36.847988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:36.847988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:36.847988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:36.847988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:36.847988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:36.847988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:36.847988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:36.848928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:36.848928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:36.848928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:36.848928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:36.848928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:36.848928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:36.848928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:36.848928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:36.848928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:36.848928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:36.848928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:36.848928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:36.848928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:36.848928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:36.848928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:36.848928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:36.848928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:36.849803 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:36.849803 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:36.849803 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:36.849803 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:36.849803 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:36.849803 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:36.849803 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:36.849803 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:36.852354 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 378/749] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:36.853320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e369d15-58d7-4d38-9a9b-7b39ebeaa82e None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:36.872785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933c8a9-bae4-42f5-b414-82e5ed146d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:36.873498 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933c8a9-bae4-42f5-b414-82e5ed146d17 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:36.873842 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933c8a9-bae4-42f5-b414-82e5ed146d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:36.874276 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933c8a9-bae4-42f5-b414-82e5ed146d17 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:36.875037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933c8a9-bae4-42f5-b414-82e5ed146d17 None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:36.875436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933c8a9-bae4-42f5-b414-82e5ed146d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:36.876964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933c8a9-bae4-42f5-b414-82e5ed146d17 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:36.886150 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 372/750] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:23:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:36.891621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933c8a9-bae4-42f5-b414-82e5ed146d17 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:36.921382 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:36.966072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e369d15-58d7-4d38-9a9b-7b39ebeaa82e None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:36.987606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:37.003582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933c8a9-bae4-42f5-b414-82e5ed146d17 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:37.005951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd8a94-1833-4f82-a830-19d1a789a058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:37.006790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd8a94-1833-4f82-a830-19d1a789a058 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:37.007462 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd8a94-1833-4f82-a830-19d1a789a058 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:37.007958 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd8a94-1833-4f82-a830-19d1a789a058 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:37.008786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd8a94-1833-4f82-a830-19d1a789a058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:37.009297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd8a94-1833-4f82-a830-19d1a789a058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:37.010964 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd8a94-1833-4f82-a830-19d1a789a058 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:37.024168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 379/751] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:37.025339 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd8a94-1833-4f82-a830-19d1a789a058 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:37.040059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c47fd-8ee2-45f7-8046-b8f2f9f1a4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:37.040593 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c47fd-8ee2-45f7-8046-b8f2f9f1a4af None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:37.040855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c47fd-8ee2-45f7-8046-b8f2f9f1a4af None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:37.041129 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c47fd-8ee2-45f7-8046-b8f2f9f1a4af None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:37.041823 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c47fd-8ee2-45f7-8046-b8f2f9f1a4af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:37.042127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c47fd-8ee2-45f7-8046-b8f2f9f1a4af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:37.043736 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c47fd-8ee2-45f7-8046-b8f2f9f1a4af None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:37.063458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 373/752] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:37.064626 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c47fd-8ee2-45f7-8046-b8f2f9f1a4af None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:37.137992 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd8a94-1833-4f82-a830-19d1a789a058 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:37.163136 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:37.173579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c47fd-8ee2-45f7-8046-b8f2f9f1a4af None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:37.177622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774174a-7f4a-4ace-8ef7-1bad052ee9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:37.178489 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774174a-7f4a-4ace-8ef7-1bad052ee9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:37.179030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774174a-7f4a-4ace-8ef7-1bad052ee9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:37.179498 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774174a-7f4a-4ace-8ef7-1bad052ee9c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:37.190536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774174a-7f4a-4ace-8ef7-1bad052ee9c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:37.192582 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774174a-7f4a-4ace-8ef7-1bad052ee9c3 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:37.209452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-e774174a-7f4a-4ace-8ef7-1bad052ee9c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:37.209452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:37.209452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:37.209452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:37.209452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:37.209452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:37.209452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:37.209452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:37.209452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:37.209452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:37.209452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:37.209452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:37.209452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:37.209452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:37.209452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:37.209452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:37.210401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:37.210401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:37.210401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:37.210401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:37.210401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:37.210401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:37.210401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:37.210401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:37.210401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:37.210401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:37.210401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:37.210401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:37.210401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:37.210401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:37.210401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:37.210401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:37.210401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:37.211372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:37.211372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:37.211372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:37.211595 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a9553-812c-4147-844a-ddbda60a20b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:37.211595 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a9553-812c-4147-844a-ddbda60a20b6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:37.211595 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a9553-812c-4147-844a-ddbda60a20b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:37.211595 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a9553-812c-4147-844a-ddbda60a20b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:37.213601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 380/753] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:37.214488 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774174a-7f4a-4ace-8ef7-1bad052ee9c3 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:37.223870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a9553-812c-4147-844a-ddbda60a20b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:37.225335 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a9553-812c-4147-844a-ddbda60a20b6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:37.239038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-4c4a9553-812c-4147-844a-ddbda60a20b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:37.239038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:37.239038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:37.239038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:37.239038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:37.239038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:37.239038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:37.239038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:37.239038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:37.239038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:37.239038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:37.239038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:37.239038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:37.239038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:37.239038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:37.240171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:37.240171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:37.240171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:37.240171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:37.240171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:37.240171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:37.240171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:37.240171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:37.240171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:37.240171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:37.240171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:37.240171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:37.240171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:37.240171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:37.240171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:37.240171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:37.240171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:37.241091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:37.241091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:37.241091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:37.241091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:37.241091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:37.241091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:37.241091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:37.241091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:37.241091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 374/754] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:37.241589 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a9553-812c-4147-844a-ddbda60a20b6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:37.252274 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:37.331271 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774174a-7f4a-4ace-8ef7-1bad052ee9c3 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:37.354347 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a9553-812c-4147-844a-ddbda60a20b6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:37.368305 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dc9ff-ff9e-4ef3-9e09-718f6e293d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:37.369337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dc9ff-ff9e-4ef3-9e09-718f6e293d09 None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:37.369853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dc9ff-ff9e-4ef3-9e09-718f6e293d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:37.370270 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dc9ff-ff9e-4ef3-9e09-718f6e293d09 None admin] PATH_INFO: `/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/3d6eaeb6bced49afabc7bdaa5e7cecfb/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:37.372445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dc9ff-ff9e-4ef3-9e09-718f6e293d09 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fda1727cc3d47b9a1fae73c74f32c27, user_id=3d6eaeb6bced49afabc7bdaa5e7cecfb, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:37.374134 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dc9ff-ff9e-4ef3-9e09-718f6e293d09 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:37.389121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 381/755] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:23:37 2022] PUT /identity/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/3d6eaeb6bced49afabc7bdaa5e7cecfb/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:23:37.389828 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dc9ff-ff9e-4ef3-9e09-718f6e293d09 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:37.395597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29803ff-fe85-46fd-8d7f-8234c5c4e38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:37.396225 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29803ff-fe85-46fd-8d7f-8234c5c4e38d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:37.396512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29803ff-fe85-46fd-8d7f-8234c5c4e38d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:37.396770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29803ff-fe85-46fd-8d7f-8234c5c4e38d None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:37.397431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29803ff-fe85-46fd-8d7f-8234c5c4e38d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:37.397732 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29803ff-fe85-46fd-8d7f-8234c5c4e38d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:37.403433 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29803ff-fe85-46fd-8d7f-8234c5c4e38d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:37.425002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 375/756] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:37.427333 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e06f3-13f4-4c58-b1b9-7a628f0f7708 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:37.427793 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e06f3-13f4-4c58-b1b9-7a628f0f7708 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:37.428237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e06f3-13f4-4c58-b1b9-7a628f0f7708 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:37.430476 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 376/757] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:37.431430 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e06f3-13f4-4c58-b1b9-7a628f0f7708 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:37.442329 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:37.526189 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:37.541925 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dc9ff-ff9e-4ef3-9e09-718f6e293d09 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:37.568401 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e06f3-13f4-4c58-b1b9-7a628f0f7708 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:37.592363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeedde2-3885-485c-95b2-248d65d16c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:37.592974 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeedde2-3885-485c-95b2-248d65d16c2d None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:37.593301 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeedde2-3885-485c-95b2-248d65d16c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:37.593578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeedde2-3885-485c-95b2-248d65d16c2d None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:37.595658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeedde2-3885-485c-95b2-248d65d16c2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:37.596034 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeedde2-3885-485c-95b2-248d65d16c2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:37.597829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeedde2-3885-485c-95b2-248d65d16c2d None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:37.611359 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795af24-c108-4b0d-8f17-8828ceaf8206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:37.612145 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795af24-c108-4b0d-8f17-8828ceaf8206 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:37.612334 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795af24-c108-4b0d-8f17-8828ceaf8206 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:37.612645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795af24-c108-4b0d-8f17-8828ceaf8206 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:37.616485 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 382/758] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:37.617728 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cb16b-08f5-4541-a39b-485d1331eefe None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:37.618016 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cb16b-08f5-4541-a39b-485d1331eefe None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:37.618292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cb16b-08f5-4541-a39b-485d1331eefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:37.624457 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795af24-c108-4b0d-8f17-8828ceaf8206 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:37.626408 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795af24-c108-4b0d-8f17-8828ceaf8206 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:37.641289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-4795af24-c108-4b0d-8f17-8828ceaf8206 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 01:23:37.641289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:37.641289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:37.641289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:37.641289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:37.641289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:37.641289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:37.641289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:37.641289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:37.641289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:37.641289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:37.641289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:37.641289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:37.641289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:37.641289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:37.641289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:37.642272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:37.642272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:37.642272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:37.642272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:37.642272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:37.642272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:37.642272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:37.642272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:37.642272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:37.642272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:37.642272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:37.642272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:37.642272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:37.642272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:37.642272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:37.642272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:37.642272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:37.642272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:37.643253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:37.643253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:37.643253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:37.643253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:37.643253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:37.643253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:37.643253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:37.643253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:37.643253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 01:23:37.643253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:37.643253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 377/759] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 26 01:23:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:37.643853 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795af24-c108-4b0d-8f17-8828ceaf8206 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:37.653758 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-850cb16b-08f5-4541-a39b-485d1331eefe None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:37.655805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-850cb16b-08f5-4541-a39b-485d1331eefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:37.742849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 383/760] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:23:37.742849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cb16b-08f5-4541-a39b-485d1331eefe None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:37.767608 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:37.789678 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795af24-c108-4b0d-8f17-8828ceaf8206 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:37.839420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:37.857982 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9898f-bc01-48e9-88a4-9da5a19d0489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:37.858588 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9898f-bc01-48e9-88a4-9da5a19d0489 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:37.858903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9898f-bc01-48e9-88a4-9da5a19d0489 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:37.859181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9898f-bc01-48e9-88a4-9da5a19d0489 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:37.860710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9898f-bc01-48e9-88a4-9da5a19d0489 None admin] RBAC: Adding query filter params (role.id=50adf18edc1a47b2bae0876828a88dbf, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=c924da83d1a94c49814d2e7b5969c8e9) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:37.861098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9898f-bc01-48e9-88a4-9da5a19d0489 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:37.862534 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9898f-bc01-48e9-88a4-9da5a19d0489 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:37.875586 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 378/761] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:23:37 2022] GET /identity/v3/role_assignments?user.id=c924da83d1a94c49814d2e7b5969c8e9&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:37.891549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cb16b-08f5-4541-a39b-485d1331eefe None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:37.948450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eff8e3-1435-4da5-be7a-c0dec4ec1988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:37.949075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eff8e3-1435-4da5-be7a-c0dec4ec1988 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:37.949353 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eff8e3-1435-4da5-be7a-c0dec4ec1988 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:37.949623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eff8e3-1435-4da5-be7a-c0dec4ec1988 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:37.950434 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eff8e3-1435-4da5-be7a-c0dec4ec1988 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:37.950730 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eff8e3-1435-4da5-be7a-c0dec4ec1988 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:37.952267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eff8e3-1435-4da5-be7a-c0dec4ec1988 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:37.982297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 384/762] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Sep 26 01:23:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:37.987982 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9898f-bc01-48e9-88a4-9da5a19d0489 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:38.142426 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9898f-bc01-48e9-88a4-9da5a19d0489 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:38.142868 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eff8e3-1435-4da5-be7a-c0dec4ec1988 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:38.210260 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cea8b-bf47-498f-9280-bd65f50dcebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:38.211268 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cea8b-bf47-498f-9280-bd65f50dcebc None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:38.211767 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cea8b-bf47-498f-9280-bd65f50dcebc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:38.212233 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cea8b-bf47-498f-9280-bd65f50dcebc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:38.287274 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:38.300287 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cea8b-bf47-498f-9280-bd65f50dcebc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:38.302312 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cea8b-bf47-498f-9280-bd65f50dcebc None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:38.321662 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:38.352810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eff8e3-1435-4da5-be7a-c0dec4ec1988 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:38.411730 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513c5ac-a447-4ba8-9507-ec964bb24ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:38.412898 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513c5ac-a447-4ba8-9507-ec964bb24ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:38.413174 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513c5ac-a447-4ba8-9507-ec964bb24ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:38.413443 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513c5ac-a447-4ba8-9507-ec964bb24ba5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:38.414037 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513c5ac-a447-4ba8-9507-ec964bb24ba5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:38.415452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513c5ac-a447-4ba8-9507-ec964bb24ba5 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:38.417999 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 379/763] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:23:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 01:23:38.419651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7945b-bfe5-4f77-b4c6-20d22e28f656 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:38.420148 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7945b-bfe5-4f77-b4c6-20d22e28f656 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:38.420645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7945b-bfe5-4f77-b4c6-20d22e28f656 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:38.426352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-a513c5ac-a447-4ba8-9507-ec964bb24ba5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 01:23:38.426352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:38.426352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:23:38.426352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:23:38.426352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:23:38.426352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:23:38.426352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:23:38.426352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:38.426352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 01:23:38.426352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:38.426352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:23:38.426352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:38.426352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:38.426352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:38.426352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:38.426352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:38.426352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:38.428090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:38.428090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:38.428090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:38.428090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:38.428090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:38.428090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:38.428090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:23:38.428090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:23:38.428090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:23:38.428090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:23:38.428090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:38.428090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:38.428090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:38.428090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:38.428090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:38.428090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:38.428941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:38.428941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:38.428941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:38.428941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:38.428941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:38.428941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:38.428941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:38.428941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:38.428941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:38.428941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:38.428941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:23:38.428941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:38.428941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 01:23:38.428941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:38.428941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 385/765] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:38 2022] GET /identity/v3/services/network => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:38.429733 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 380/765] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:38.429805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513c5ac-a447-4ba8-9507-ec964bb24ba5 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:38.429873 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdadb2-dc4b-4fe4-b0ac-d7d1474950f4 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:38.429873 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdadb2-dc4b-4fe4-b0ac-d7d1474950f4 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:38.430449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdadb2-dc4b-4fe4-b0ac-d7d1474950f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:38.449806 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-97bdadb2-dc4b-4fe4-b0ac-d7d1474950f4 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:38.451021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-97bdadb2-dc4b-4fe4-b0ac-d7d1474950f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:38.542166 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 381/766] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:23:38.542166 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdadb2-dc4b-4fe4-b0ac-d7d1474950f4 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:38.574276 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513c5ac-a447-4ba8-9507-ec964bb24ba5 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:38.588009 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:38.631233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ba135-2095-4ff4-b8bf-aee5b7afa27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:38.632106 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ba135-2095-4ff4-b8bf-aee5b7afa27e None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:38.632558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ba135-2095-4ff4-b8bf-aee5b7afa27e None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:38.633038 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ba135-2095-4ff4-b8bf-aee5b7afa27e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:38.645039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ba135-2095-4ff4-b8bf-aee5b7afa27e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:38.646763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ba135-2095-4ff4-b8bf-aee5b7afa27e None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:38.662277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-216ba135-2095-4ff4-b8bf-aee5b7afa27e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:38.662277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:38.662277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:38.662277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:38.662277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:38.662277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:38.662277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:38.662277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:38.662277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:38.662277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:38.662277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:38.662277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:38.662277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:38.662277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:38.662277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:38.662277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:38.663422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:38.663422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:38.663422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:38.663422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:38.663422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:38.663422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:38.663422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:38.663422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:38.663422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:38.663422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:38.663422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:38.663422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:38.663422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:38.663422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:38.663422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:38.663422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:38.663422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:38.664342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:38.664342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:38.664342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:38.669633 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:38.670976 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 386/767] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:38.672336 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ba135-2095-4ff4-b8bf-aee5b7afa27e None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:38.786056 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdadb2-dc4b-4fe4-b0ac-d7d1474950f4 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:38.799218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ba135-2095-4ff4-b8bf-aee5b7afa27e None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:38.822045 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df36eb-b2f7-4507-802f-ad0d4f78032c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:38.822753 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df36eb-b2f7-4507-802f-ad0d4f78032c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:38.823061 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df36eb-b2f7-4507-802f-ad0d4f78032c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:38.823419 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df36eb-b2f7-4507-802f-ad0d4f78032c None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:38.824043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df36eb-b2f7-4507-802f-ad0d4f78032c None admin] RBAC: Adding query filter params (name=network) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:38.824338 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df36eb-b2f7-4507-802f-ad0d4f78032c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:38.825683 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df36eb-b2f7-4507-802f-ad0d4f78032c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:38.831657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 382/768] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 26 01:23:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:38.836927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df36eb-b2f7-4507-802f-ad0d4f78032c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:38.842648 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fe289-300b-4b18-b0e1-b3bade5c6e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:38.843295 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fe289-300b-4b18-b0e1-b3bade5c6e35 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:38.843573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fe289-300b-4b18-b0e1-b3bade5c6e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:38.843917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fe289-300b-4b18-b0e1-b3bade5c6e35 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:38.845464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fe289-300b-4b18-b0e1-b3bade5c6e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:38.846026 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fe289-300b-4b18-b0e1-b3bade5c6e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:38.847766 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fe289-300b-4b18-b0e1-b3bade5c6e35 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:38.865670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 387/769] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:38.866614 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fe289-300b-4b18-b0e1-b3bade5c6e35 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:38.931554 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:38.933239 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:38.953922 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df36eb-b2f7-4507-802f-ad0d4f78032c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:38.983140 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fe289-300b-4b18-b0e1-b3bade5c6e35 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:38.992319 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a73fde-19aa-4201-aa03-011df5e0625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:38.993430 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a73fde-19aa-4201-aa03-011df5e0625a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:38.993848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a73fde-19aa-4201-aa03-011df5e0625a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:38.994305 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a73fde-19aa-4201-aa03-011df5e0625a None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:38.995186 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a73fde-19aa-4201-aa03-011df5e0625a None admin] RBAC: Adding query filter params (type=network) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:38.995761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a73fde-19aa-4201-aa03-011df5e0625a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:38.997245 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a73fde-19aa-4201-aa03-011df5e0625a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:39.007220 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 383/770] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 26 01:23:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:23:39.008235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a73fde-19aa-4201-aa03-011df5e0625a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:39.021463 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596ad01-3ec3-4280-8f4a-1e8af2e39a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:39.022090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596ad01-3ec3-4280-8f4a-1e8af2e39a87 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:39.022370 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596ad01-3ec3-4280-8f4a-1e8af2e39a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:39.022644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596ad01-3ec3-4280-8f4a-1e8af2e39a87 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:39.023372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596ad01-3ec3-4280-8f4a-1e8af2e39a87 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:39.024720 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596ad01-3ec3-4280-8f4a-1e8af2e39a87 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:39.035204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-7596ad01-3ec3-4280-8f4a-1e8af2e39a87 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 01:23:39.035204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:39.035204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:23:39.035204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:23:39.035204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:23:39.035204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:23:39.035204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:23:39.035204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:39.035204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 01:23:39.035204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:39.035204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:23:39.035204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:39.035204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:39.035204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:39.035204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:39.035204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:39.035204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:39.036385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:39.036385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:39.036385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:39.036385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:39.036385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:39.036385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:39.036385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:23:39.036385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:23:39.036385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:23:39.036385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:23:39.036385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:39.036385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:39.036385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:39.036385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:39.036385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:39.036385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:39.037243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:39.037243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:39.037243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:39.037243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:39.037243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:39.037243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:39.037243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:39.037243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:39.037243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:39.037243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:39.037243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:23:39.037243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:39.037243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 01:23:39.037243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:39.037243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 388/771] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Sep 26 01:23:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:39.038057 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596ad01-3ec3-4280-8f4a-1e8af2e39a87 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:39.125773 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a73fde-19aa-4201-aa03-011df5e0625a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:39.159617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596ad01-3ec3-4280-8f4a-1e8af2e39a87 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:39.163137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a33451-767b-4540-8cc7-59a709d3832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:39.163894 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a33451-767b-4540-8cc7-59a709d3832b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:39.164254 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a33451-767b-4540-8cc7-59a709d3832b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:39.164600 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a33451-767b-4540-8cc7-59a709d3832b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:39.172216 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a33451-767b-4540-8cc7-59a709d3832b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:39.173867 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a33451-767b-4540-8cc7-59a709d3832b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:39.183349 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:39.187478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-e1a33451-767b-4540-8cc7-59a709d3832b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:39.187478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:39.187478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:39.187478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:39.187478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:39.187478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:39.187478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:39.187478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:39.187478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:39.187478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:39.187478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:39.187478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:39.187478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:39.187478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:39.187478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:39.189222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:39.189222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:39.189222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:39.189222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:39.189222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:39.189222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:39.189222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:39.189222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:39.189222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:39.189222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:39.189222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:39.189222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:39.189222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:39.189222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:39.189222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:39.189222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:39.189222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:39.190122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:39.190122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:39.190122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:39.190122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:39.190122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:39.190122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:39.190122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:39.190122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:39.194443 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 384/772] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:39.196167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a33451-767b-4540-8cc7-59a709d3832b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:39.197837 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9df534-bc03-449d-8f3f-5dcdaf2dbf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:39.198518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9df534-bc03-449d-8f3f-5dcdaf2dbf42 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:39.198982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9df534-bc03-449d-8f3f-5dcdaf2dbf42 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:39.199329 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9df534-bc03-449d-8f3f-5dcdaf2dbf42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:39.200203 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9df534-bc03-449d-8f3f-5dcdaf2dbf42 None admin] RBAC: Adding query filter params (interface=public, service_id=e9310f2973b844e4a7481714996886ee, region_id=RegionOne) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:39.200576 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9df534-bc03-449d-8f3f-5dcdaf2dbf42 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:39.202004 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9df534-bc03-449d-8f3f-5dcdaf2dbf42 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:39.208944 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:39.212466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 389/773] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 26 01:23:39 2022] GET /identity/v3/endpoints?service_id=e9310f2973b844e4a7481714996886ee&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:39.213601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9df534-bc03-449d-8f3f-5dcdaf2dbf42 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:39.307641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a33451-767b-4540-8cc7-59a709d3832b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:39.324350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9df534-bc03-449d-8f3f-5dcdaf2dbf42 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:39.345517 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438a4b3-ce04-4caf-aaaf-64fadf3caef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:39.346129 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438a4b3-ce04-4caf-aaaf-64fadf3caef8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:39.346410 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438a4b3-ce04-4caf-aaaf-64fadf3caef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:39.346686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438a4b3-ce04-4caf-aaaf-64fadf3caef8 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:39.347791 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438a4b3-ce04-4caf-aaaf-64fadf3caef8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:39.347791 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438a4b3-ce04-4caf-aaaf-64fadf3caef8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:39.349121 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438a4b3-ce04-4caf-aaaf-64fadf3caef8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:39.359935 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 385/774] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Sep 26 01:23:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:39.360815 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438a4b3-ce04-4caf-aaaf-64fadf3caef8 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:39.363964 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ce475-44b6-47a6-9c90-7f1e956f7a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:39.364897 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ce475-44b6-47a6-9c90-7f1e956f7a94 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:39.365380 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ce475-44b6-47a6-9c90-7f1e956f7a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:39.365832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ce475-44b6-47a6-9c90-7f1e956f7a94 None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:39.366702 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ce475-44b6-47a6-9c90-7f1e956f7a94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:39.367210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ce475-44b6-47a6-9c90-7f1e956f7a94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:39.368803 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ce475-44b6-47a6-9c90-7f1e956f7a94 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:39.383253 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 390/775] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:39.384468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ce475-44b6-47a6-9c90-7f1e956f7a94 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:39.434873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:39.458993 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:39.494449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438a4b3-ce04-4caf-aaaf-64fadf3caef8 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:39.504677 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ce475-44b6-47a6-9c90-7f1e956f7a94 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:39.532042 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce30de-ef2e-4ab1-ac70-644437a344a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:39.532708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce30de-ef2e-4ab1-ac70-644437a344a6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:39.532987 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce30de-ef2e-4ab1-ac70-644437a344a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:39.533368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce30de-ef2e-4ab1-ac70-644437a344a6 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:39.533976 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce30de-ef2e-4ab1-ac70-644437a344a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:39.535499 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce30de-ef2e-4ab1-ac70-644437a344a6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:39.541333 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 386/776] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 26 01:23:39 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:39.542123 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce30de-ef2e-4ab1-ac70-644437a344a6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:39.547565 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3606c5-2f89-454d-9428-9b5ed9abad56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:39.548523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3606c5-2f89-454d-9428-9b5ed9abad56 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:39.548995 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3606c5-2f89-454d-9428-9b5ed9abad56 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:39.549448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3606c5-2f89-454d-9428-9b5ed9abad56 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:39.550278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3606c5-2f89-454d-9428-9b5ed9abad56 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:39.550777 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3606c5-2f89-454d-9428-9b5ed9abad56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:39.553234 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3606c5-2f89-454d-9428-9b5ed9abad56 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:39.561804 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 391/777] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Sep 26 01:23:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:39.568288 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3606c5-2f89-454d-9428-9b5ed9abad56 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:39.707224 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce30de-ef2e-4ab1-ac70-644437a344a6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:39.750633 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c2c5f-06f7-4aa9-82c3-56ddb6d481bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:39.751901 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c2c5f-06f7-4aa9-82c3-56ddb6d481bd None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:39.752188 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c2c5f-06f7-4aa9-82c3-56ddb6d481bd None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:39.752460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c2c5f-06f7-4aa9-82c3-56ddb6d481bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:39.753193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c2c5f-06f7-4aa9-82c3-56ddb6d481bd None admin] RBAC: Adding query filter params (role.id=8801886a5f4e4695a29b60c6eb347932, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=6f4696c410f343709be200dee463bd1c) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:39.753504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c2c5f-06f7-4aa9-82c3-56ddb6d481bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:39.754966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c2c5f-06f7-4aa9-82c3-56ddb6d481bd None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:39.759469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:39.764970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 387/778] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:23:39 2022] GET /identity/v3/role_assignments?user.id=6f4696c410f343709be200dee463bd1c&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=8801886a5f4e4695a29b60c6eb347932 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:39.781180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3606c5-2f89-454d-9428-9b5ed9abad56 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:39.794091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:39.825051 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbc49a-4c55-4bcf-9cb0-c36167fe958c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:39.825693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbc49a-4c55-4bcf-9cb0-c36167fe958c None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:39.825970 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbc49a-4c55-4bcf-9cb0-c36167fe958c None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:39.826243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbc49a-4c55-4bcf-9cb0-c36167fe958c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:39.827005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbc49a-4c55-4bcf-9cb0-c36167fe958c None admin] RBAC: Adding query filter params (interface=public, service_id=c4eb78e1149a4473aa535e3602d5ac1b, region_id=RegionOne) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:39.827389 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbc49a-4c55-4bcf-9cb0-c36167fe958c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:39.828873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbc49a-4c55-4bcf-9cb0-c36167fe958c None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:39.835360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 392/779] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 26 01:23:39 2022] GET /identity/v3/endpoints?service_id=c4eb78e1149a4473aa535e3602d5ac1b&interface=public®ion_id=RegionOne => generated 194 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:39.840966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c2c5f-06f7-4aa9-82c3-56ddb6d481bd None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:39.945837 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743a13e-165b-49e5-a8c1-1f9e831b041b None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:39.946356 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743a13e-165b-49e5-a8c1-1f9e831b041b None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:39.946356 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743a13e-165b-49e5-a8c1-1f9e831b041b None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:39.947725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 393/780] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:23:39.956217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151db47-9bc6-4445-bc38-9f26afd1ecf2 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:39.956217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151db47-9bc6-4445-bc38-9f26afd1ecf2 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:39.956217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151db47-9bc6-4445-bc38-9f26afd1ecf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:39.979020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-c151db47-9bc6-4445-bc38-9f26afd1ecf2 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:39.980774 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c151db47-9bc6-4445-bc38-9f26afd1ecf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:39.991417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c2c5f-06f7-4aa9-82c3-56ddb6d481bd None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:40.038565 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49904d54-f0ab-49b1-be4f-a4bf7070372b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:40.039361 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49904d54-f0ab-49b1-be4f-a4bf7070372b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:40.039558 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49904d54-f0ab-49b1-be4f-a4bf7070372b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:40.039834 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49904d54-f0ab-49b1-be4f-a4bf7070372b None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:40.040683 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49904d54-f0ab-49b1-be4f-a4bf7070372b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:40.041793 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49904d54-f0ab-49b1-be4f-a4bf7070372b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:40.047756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 388/781] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 26 01:23:39 2022] GET /identity/v3/services => generated 772 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:40.089102 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 394/782] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 01:23:40.272302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aa9b4-32a1-45eb-91dd-6e2744614e6c None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:40.272651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aa9b4-32a1-45eb-91dd-6e2744614e6c None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:40.272755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aa9b4-32a1-45eb-91dd-6e2744614e6c None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:40.274221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 389/783] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:40.279759 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc28f0-a2da-4524-b29c-805576ce2d39 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:40.280273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc28f0-a2da-4524-b29c-805576ce2d39 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:40.280743 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc28f0-a2da-4524-b29c-805576ce2d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:40.301483 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-76bc28f0-a2da-4524-b29c-805576ce2d39 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:40.303021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-76bc28f0-a2da-4524-b29c-805576ce2d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:40.438072 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1aa9b4-32a1-45eb-91dd-6e2744614e6c None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:40.496125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 395/784] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:23:40.554583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:40.611520 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1aa9b4-32a1-45eb-91dd-6e2744614e6c None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:40.656416 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa21fbc-9359-46ba-a788-ab6c31428f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:40.657242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa21fbc-9359-46ba-a788-ab6c31428f0a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:40.657519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa21fbc-9359-46ba-a788-ab6c31428f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:40.657788 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa21fbc-9359-46ba-a788-ab6c31428f0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:40.670754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa21fbc-9359-46ba-a788-ab6c31428f0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:40.676180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-7aa21fbc-9359-46ba-a788-ab6c31428f0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:23:40.676180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:40.676180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:40.676180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:40.676180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:40.676180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:40.676180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:40.676180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:40.676180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:40.676180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:40.676180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:40.676180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:40.676180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:40.676180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:40.676180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:40.676180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:40.677131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:40.677131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:40.677131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:40.677131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:40.677131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:40.677131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:40.677131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:40.677131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:40.677131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:40.677131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:40.677131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:40.677131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:40.677131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:40.677131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:40.677131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:40.677131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:40.678002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:40.678002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:40.678002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:40.678002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:40.678002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:40.678002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:40.678002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:40.678002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:40.678002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:40.678002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:40.678002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:23:40.678002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:40.678002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 390/785] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:23:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:40.683171 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc28f0-a2da-4524-b29c-805576ce2d39 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:40.718146 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:40.810818 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc28f0-a2da-4524-b29c-805576ce2d39 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:40.850857 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041dd3b-a8f0-482d-a62e-2bd45635b323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:40.851481 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041dd3b-a8f0-482d-a62e-2bd45635b323 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:40.851755 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041dd3b-a8f0-482d-a62e-2bd45635b323 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:40.852025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041dd3b-a8f0-482d-a62e-2bd45635b323 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:40.852693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041dd3b-a8f0-482d-a62e-2bd45635b323 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:40.852990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041dd3b-a8f0-482d-a62e-2bd45635b323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:40.854382 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041dd3b-a8f0-482d-a62e-2bd45635b323 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:40.864549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 396/786] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:23:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:40.870293 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa21fbc-9359-46ba-a788-ab6c31428f0a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:40.877970 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041dd3b-a8f0-482d-a62e-2bd45635b323 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:41.026709 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa21fbc-9359-46ba-a788-ab6c31428f0a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:41.053715 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:41.067326 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35907e9d-00a2-4fab-843a-87817b921c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:41.067883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35907e9d-00a2-4fab-843a-87817b921c8c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:41.068160 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35907e9d-00a2-4fab-843a-87817b921c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:41.068433 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35907e9d-00a2-4fab-843a-87817b921c8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:41.076564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:41.090270 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041dd3b-a8f0-482d-a62e-2bd45635b323 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:41.094069 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35907e9d-00a2-4fab-843a-87817b921c8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:41.095660 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35907e9d-00a2-4fab-843a-87817b921c8c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:41.124460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-35907e9d-00a2-4fab-843a-87817b921c8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:41.124460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:41.124460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:41.124460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:41.124460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:41.124460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:41.124460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:41.124460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:41.124460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:41.124460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:41.124460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:41.124460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:41.124460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:41.124460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:41.124460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:41.124460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:41.126086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:41.126086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:41.126086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:41.126086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:41.126086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:41.126086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:41.126086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:41.126086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:41.126086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:41.126086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:41.126086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:41.126086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:41.126086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:41.126086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:41.126086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:41.126086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:41.126086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:41.127126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:41.127126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:41.127126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:41.134811 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 391/787] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:41.135690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35907e9d-00a2-4fab-843a-87817b921c8c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:41.156453 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559a684-cb67-42e1-8072-8e486d67f426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:41.157087 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559a684-cb67-42e1-8072-8e486d67f426 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:41.157356 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559a684-cb67-42e1-8072-8e486d67f426 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:41.158665 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559a684-cb67-42e1-8072-8e486d67f426 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:41.179799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559a684-cb67-42e1-8072-8e486d67f426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:41.185975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-1559a684-cb67-42e1-8072-8e486d67f426 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:23:41.185975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:41.185975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:41.185975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:41.185975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:41.185975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:41.185975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:41.185975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:41.185975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:41.185975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:41.185975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:41.185975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:41.185975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:41.185975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:41.185975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:41.185975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:41.188753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:41.188753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:41.188753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:41.188753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:41.188753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:41.188753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:41.188753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:41.188753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:41.188753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:41.188753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:41.188753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:41.188753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:41.188753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:41.188753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:41.188753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:41.188753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:41.190750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:41.190750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:41.190750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:41.190750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:41.190750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:41.190750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:41.190750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:41.190750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:41.190750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:41.190750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:41.190750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:23:41.190750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:41.190750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 397/788] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:23:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:41.198196 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559a684-cb67-42e1-8072-8e486d67f426 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:41.336491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559a684-cb67-42e1-8072-8e486d67f426 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:41.361018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35907e9d-00a2-4fab-843a-87817b921c8c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:41.371265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cea27-4efb-4c13-9768-4f548a2fc9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:41.372506 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cea27-4efb-4c13-9768-4f548a2fc9bb None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:41.372506 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cea27-4efb-4c13-9768-4f548a2fc9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:41.372506 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cea27-4efb-4c13-9768-4f548a2fc9bb None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:41.373042 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cea27-4efb-4c13-9768-4f548a2fc9bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:41.373340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cea27-4efb-4c13-9768-4f548a2fc9bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:41.374688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cea27-4efb-4c13-9768-4f548a2fc9bb None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:41.384273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 398/789] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:23:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:23:41.390470 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cea27-4efb-4c13-9768-4f548a2fc9bb None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:41.422600 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:41.439410 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5353b6-fb85-4232-a648-6cb1af740193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:41.440016 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5353b6-fb85-4232-a648-6cb1af740193 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:41.440291 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5353b6-fb85-4232-a648-6cb1af740193 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:41.440558 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5353b6-fb85-4232-a648-6cb1af740193 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:41.441195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5353b6-fb85-4232-a648-6cb1af740193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:41.441494 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5353b6-fb85-4232-a648-6cb1af740193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:41.442864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5353b6-fb85-4232-a648-6cb1af740193 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:41.472247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 392/790] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:41.477463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5353b6-fb85-4232-a648-6cb1af740193 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:41.542427 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cea27-4efb-4c13-9768-4f548a2fc9bb None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:41.575916 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:41.594487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27cd2e-efe2-485c-918b-8fbb62eb9561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:41.596564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27cd2e-efe2-485c-918b-8fbb62eb9561 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:41.596850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27cd2e-efe2-485c-918b-8fbb62eb9561 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:41.597120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27cd2e-efe2-485c-918b-8fbb62eb9561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:41.616986 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27cd2e-efe2-485c-918b-8fbb62eb9561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:41.618414 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27cd2e-efe2-485c-918b-8fbb62eb9561 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:41.651636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-4e27cd2e-efe2-485c-918b-8fbb62eb9561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:41.651636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:41.651636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:41.651636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:41.651636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:41.651636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:41.651636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:41.651636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:41.651636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:41.651636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:41.651636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:41.651636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:41.651636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:41.651636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:41.651636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:41.651636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:41.652657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:41.652657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:41.652657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:41.652657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:41.652657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:41.652657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:41.652657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:41.652657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:41.652657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:41.652657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:41.652657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:41.652657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:41.652657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:41.652657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:41.652657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:41.652657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:41.652657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:41.653539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:41.653539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:41.653539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:41.655069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 399/791] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:41.660452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27cd2e-efe2-485c-918b-8fbb62eb9561 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:41.705213 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5353b6-fb85-4232-a648-6cb1af740193 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:41.775536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c98b0-fb7f-4ef6-aa0a-ab131d9d0764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:41.776181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c98b0-fb7f-4ef6-aa0a-ab131d9d0764 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:41.776507 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c98b0-fb7f-4ef6-aa0a-ab131d9d0764 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:41.776787 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c98b0-fb7f-4ef6-aa0a-ab131d9d0764 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:41.783180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:41.795865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27cd2e-efe2-485c-918b-8fbb62eb9561 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:41.796042 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c98b0-fb7f-4ef6-aa0a-ab131d9d0764 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:41.797996 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c98b0-fb7f-4ef6-aa0a-ab131d9d0764 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:41.822218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-ea8c98b0-fb7f-4ef6-aa0a-ab131d9d0764 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 01:23:41.822218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:41.822218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:41.822218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:41.822218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:41.822218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:41.822218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:41.822218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:41.822218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:41.822218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:41.822218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:41.822218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:41.822218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:41.822218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:41.822218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:41.822218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:41.823425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:41.823425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:41.823425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:41.823425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:41.823425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:41.823425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:41.823425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:41.823425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:41.823425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:41.823425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:41.823425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:41.823425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:41.823425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:41.823425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:41.823425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:41.823425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:41.823425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:41.823425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:41.824591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:41.824591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:41.824591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:41.824591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:41.824591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:41.824591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:41.824591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:41.824591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:41.824591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 01:23:41.824591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:41.824591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 393/792] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 26 01:23:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:41.835755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c98b0-fb7f-4ef6-aa0a-ab131d9d0764 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:41.836744 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b63ce-fa31-47de-b10a-965b49c6a939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:41.837505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b63ce-fa31-47de-b10a-965b49c6a939 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:41.837925 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b63ce-fa31-47de-b10a-965b49c6a939 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:41.838339 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b63ce-fa31-47de-b10a-965b49c6a939 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:41.839177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b63ce-fa31-47de-b10a-965b49c6a939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:41.839636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b63ce-fa31-47de-b10a-965b49c6a939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:41.841127 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b63ce-fa31-47de-b10a-965b49c6a939 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:41.854800 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 400/793] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:23:41.860914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b63ce-fa31-47de-b10a-965b49c6a939 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:42.041007 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b63ce-fa31-47de-b10a-965b49c6a939 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:42.057499 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c98b0-fb7f-4ef6-aa0a-ab131d9d0764 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:42.060265 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:42.106876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ae8b8-8ed7-4cae-b7fd-6387a0efbc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:42.108082 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ae8b8-8ed7-4cae-b7fd-6387a0efbc0f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:42.108796 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ae8b8-8ed7-4cae-b7fd-6387a0efbc0f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:42.109270 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ae8b8-8ed7-4cae-b7fd-6387a0efbc0f None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:42.110203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ae8b8-8ed7-4cae-b7fd-6387a0efbc0f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:42.110371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:42.111341 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ae8b8-8ed7-4cae-b7fd-6387a0efbc0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:42.113449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ae8b8-8ed7-4cae-b7fd-6387a0efbc0f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:42.131522 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85dd29-d349-42d6-b0f5-86dd039b13ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:42.132164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85dd29-d349-42d6-b0f5-86dd039b13ad None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:42.132446 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85dd29-d349-42d6-b0f5-86dd039b13ad None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:42.132716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85dd29-d349-42d6-b0f5-86dd039b13ad None admin] PATH_INFO: `/v3/users/swift` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:42.134629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 394/794] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 26 01:23:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:23:42.145611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85dd29-d349-42d6-b0f5-86dd039b13ad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:42.146048 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ae8b8-8ed7-4cae-b7fd-6387a0efbc0f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:42.147093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85dd29-d349-42d6-b0f5-86dd039b13ad None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:42.171319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-4b85dd29-d349-42d6-b0f5-86dd039b13ad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 01:23:42.171319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:42.171319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:42.171319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:42.171319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:42.171319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:42.171319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:42.171319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:42.171319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:42.171319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:42.171319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:42.171319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:42.171319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:42.171319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:42.171319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:42.171319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:42.172580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:42.172580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:42.172580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:42.172580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:42.172580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:42.172580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:42.172580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:42.172580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:42.172580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:42.172580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:42.172580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:42.172580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:42.172580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:42.172580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:42.172580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:42.172580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:42.172580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:42.172580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:42.173750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:42.173750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:42.173750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:42.173750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:42.173750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:42.173750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:42.173750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:42.173750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:42.173750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 01:23:42.173750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:42.180532 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 401/795] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:23:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:42.182947 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85dd29-d349-42d6-b0f5-86dd039b13ad None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:42.327894 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85dd29-d349-42d6-b0f5-86dd039b13ad None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:42.361031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ae8b8-8ed7-4cae-b7fd-6387a0efbc0f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:42.367823 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499cf8f-f8e2-4e16-b174-e5c636c08a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:42.368652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499cf8f-f8e2-4e16-b174-e5c636c08a54 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:42.369098 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499cf8f-f8e2-4e16-b174-e5c636c08a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:42.370053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499cf8f-f8e2-4e16-b174-e5c636c08a54 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:42.370955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499cf8f-f8e2-4e16-b174-e5c636c08a54 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:42.371405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499cf8f-f8e2-4e16-b174-e5c636c08a54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:42.373826 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499cf8f-f8e2-4e16-b174-e5c636c08a54 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:42.395997 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 402/796] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Sep 26 01:23:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:42.397466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de12a0-1ee8-4286-8826-624815e7ce56 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:42.398182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de12a0-1ee8-4286-8826-624815e7ce56 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:42.398599 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de12a0-1ee8-4286-8826-624815e7ce56 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:42.400401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 403/797] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:42.401583 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c4b2-cc25-4581-b057-802082e09bfb None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:42.401859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c4b2-cc25-4581-b057-802082e09bfb None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:42.402128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c4b2-cc25-4581-b057-802082e09bfb None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:42.403667 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 404/798] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:42.404659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37c4b2-cc25-4581-b057-802082e09bfb None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:42.413780 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246f83a-3da8-45c0-ad6e-dc5ed7e9461b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:42.414480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246f83a-3da8-45c0-ad6e-dc5ed7e9461b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:42.414764 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246f83a-3da8-45c0-ad6e-dc5ed7e9461b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:42.415141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246f83a-3da8-45c0-ad6e-dc5ed7e9461b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:42.443507 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:42.459116 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:42.491800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246f83a-3da8-45c0-ad6e-dc5ed7e9461b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:42.493231 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246f83a-3da8-45c0-ad6e-dc5ed7e9461b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:42.515414 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37c4b2-cc25-4581-b057-802082e09bfb None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:42.553711 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c6333-c9a7-4aa3-a181-9d05411d0187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:42.554338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c6333-c9a7-4aa3-a181-9d05411d0187 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:42.554611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c6333-c9a7-4aa3-a181-9d05411d0187 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:42.554912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c6333-c9a7-4aa3-a181-9d05411d0187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:42.566007 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c6333-c9a7-4aa3-a181-9d05411d0187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:42.567458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c6333-c9a7-4aa3-a181-9d05411d0187 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:42.585115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-c15c6333-c9a7-4aa3-a181-9d05411d0187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:42.585115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:42.585115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:42.585115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:42.585115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:42.585115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:42.585115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:42.585115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:42.585115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:42.585115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:42.585115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:42.585115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:42.585115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:42.585115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:42.585115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:42.585115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:42.586110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:42.586110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:42.586110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:42.586110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:42.586110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:42.586110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:42.586110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:42.586110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:42.586110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:42.586110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:42.586110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:42.586110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:42.586110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:42.586110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:42.586110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:42.586110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:42.586110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:42.587129 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:42.587129 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:42.587129 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:42.587129 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 405/799] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:42.587782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e635c-57f9-4ac7-948b-1ea25310f5ef None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:42.587782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e635c-57f9-4ac7-948b-1ea25310f5ef None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:42.588057 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e635c-57f9-4ac7-948b-1ea25310f5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:42.606139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 395/800] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:23:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 01:23:42.606139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19548f5-84b6-4928-93f9-649f890dcfc4 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:42.606139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19548f5-84b6-4928-93f9-649f890dcfc4 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:42.606139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19548f5-84b6-4928-93f9-649f890dcfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:42.612155 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-f23e635c-57f9-4ac7-948b-1ea25310f5ef None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:42.613298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f23e635c-57f9-4ac7-948b-1ea25310f5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:42.621397 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-c19548f5-84b6-4928-93f9-649f890dcfc4 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:42.622616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c19548f5-84b6-4928-93f9-649f890dcfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:42.676465 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:42.688139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 406/801] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:23:42.688804 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e635c-57f9-4ac7-948b-1ea25310f5ef None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:42.701682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 396/802] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:23:42.702780 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19548f5-84b6-4928-93f9-649f890dcfc4 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:42.746235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:42.823288 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e635c-57f9-4ac7-948b-1ea25310f5ef None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:42.836602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19548f5-84b6-4928-93f9-649f890dcfc4 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:42.869318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051e386-b6a8-40a7-a76a-aec7ffa53f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:42.870779 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051e386-b6a8-40a7-a76a-aec7ffa53f6c None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:42.871270 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051e386-b6a8-40a7-a76a-aec7ffa53f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:42.871743 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051e386-b6a8-40a7-a76a-aec7ffa53f6c None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:42.873141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051e386-b6a8-40a7-a76a-aec7ffa53f6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:42.873765 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051e386-b6a8-40a7-a76a-aec7ffa53f6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:42.875673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051e386-b6a8-40a7-a76a-aec7ffa53f6c None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:42.878696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cd8f6-c475-4e15-b7c8-010f0fe0787d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:42.879450 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cd8f6-c475-4e15-b7c8-010f0fe0787d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:42.879823 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cd8f6-c475-4e15-b7c8-010f0fe0787d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:42.880202 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cd8f6-c475-4e15-b7c8-010f0fe0787d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:42.890605 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 407/803] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:42.892337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211cd8f6-c475-4e15-b7c8-010f0fe0787d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:42.892664 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8d3b2-cb06-47c8-88f6-ffa602678de9 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:42.893096 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8d3b2-cb06-47c8-88f6-ffa602678de9 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:42.893515 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8d3b2-cb06-47c8-88f6-ffa602678de9 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:42.894207 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211cd8f6-c475-4e15-b7c8-010f0fe0787d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:42.895583 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 408/804] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:42.896707 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8d3b2-cb06-47c8-88f6-ffa602678de9 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:42.912943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-211cd8f6-c475-4e15-b7c8-010f0fe0787d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:42.912943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:42.912943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:42.912943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:42.912943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:42.912943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:42.912943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:42.912943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:42.912943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:42.912943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:42.912943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:42.912943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:42.912943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:42.912943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:42.912943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:42.912943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:42.914127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:42.914127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:42.914127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:42.914127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:42.914127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:42.914127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:42.914127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:42.914127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:42.914127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:42.914127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:42.914127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:42.914127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:42.914127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:42.914127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:42.914127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:42.914127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:42.914127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:42.915264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:42.915264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:42.915264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:42.920825 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 397/805] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:42.920825 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe18e8f-b524-4f0f-859a-4691cba2bf00 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:42.920825 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe18e8f-b524-4f0f-859a-4691cba2bf00 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:42.920825 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe18e8f-b524-4f0f-859a-4691cba2bf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:42.941502 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-efe18e8f-b524-4f0f-859a-4691cba2bf00 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:42.943381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-efe18e8f-b524-4f0f-859a-4691cba2bf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:42.977764 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:43.011601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:43.017386 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 398/806] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:23:43.018224 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe18e8f-b524-4f0f-859a-4691cba2bf00 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:43.023654 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8d3b2-cb06-47c8-88f6-ffa602678de9 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:43.061757 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4484fe-a24c-46a0-b21f-68fa29adaddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:43.062378 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4484fe-a24c-46a0-b21f-68fa29adaddc None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:43.062861 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4484fe-a24c-46a0-b21f-68fa29adaddc None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:43.063271 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4484fe-a24c-46a0-b21f-68fa29adaddc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:43.070016 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4484fe-a24c-46a0-b21f-68fa29adaddc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:43.071727 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4484fe-a24c-46a0-b21f-68fa29adaddc None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:43.089401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-fb4484fe-a24c-46a0-b21f-68fa29adaddc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:43.089401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:43.089401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:43.089401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:43.089401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:43.089401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:43.089401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:43.089401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:43.089401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:43.089401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:43.089401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:43.089401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:43.089401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:43.089401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:43.089401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:43.090340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:43.090340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:43.090340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:43.090340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:43.090340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:43.090340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:43.090340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:43.090340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:43.090340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:43.090340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:43.090340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:43.090340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:43.090340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:43.090340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:43.090340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:43.090340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:43.090340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:43.091341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:43.091341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:43.091341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:43.091341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:43.091341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:43.091341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:43.091341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:43.091341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:43.091341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 409/807] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:43.091854 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4484fe-a24c-46a0-b21f-68fa29adaddc None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:43.133743 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe18e8f-b524-4f0f-859a-4691cba2bf00 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:43.168315 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f493e-c5a0-4ad4-8453-f99f9531ac60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:43.168917 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f493e-c5a0-4ad4-8453-f99f9531ac60 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:43.169196 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f493e-c5a0-4ad4-8453-f99f9531ac60 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:43.169466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f493e-c5a0-4ad4-8453-f99f9531ac60 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:43.170107 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f493e-c5a0-4ad4-8453-f99f9531ac60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:43.170406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f493e-c5a0-4ad4-8453-f99f9531ac60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:43.171782 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f493e-c5a0-4ad4-8453-f99f9531ac60 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:43.188339 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 399/808] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:43.188339 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f493e-c5a0-4ad4-8453-f99f9531ac60 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:43.196952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4484fe-a24c-46a0-b21f-68fa29adaddc None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:43.218089 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:43.233443 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46352d9a-0cc9-4d7b-9d29-4fe6ff4aad48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:43.234067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46352d9a-0cc9-4d7b-9d29-4fe6ff4aad48 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:43.235070 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46352d9a-0cc9-4d7b-9d29-4fe6ff4aad48 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:43.235366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46352d9a-0cc9-4d7b-9d29-4fe6ff4aad48 None admin] PATH_INFO: `/v3/services/network` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:43.235949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46352d9a-0cc9-4d7b-9d29-4fe6ff4aad48 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:43.237283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46352d9a-0cc9-4d7b-9d29-4fe6ff4aad48 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:43.246272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-46352d9a-0cc9-4d7b-9d29-4fe6ff4aad48 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 01:23:43.246272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:43.246272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:23:43.246272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:23:43.246272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:23:43.246272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:23:43.246272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:23:43.246272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:43.246272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 01:23:43.246272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:43.246272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:23:43.246272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:43.246272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:43.246272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:43.246272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:43.246272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:43.246272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:43.247306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:43.247306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:43.247306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:43.247306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:43.247306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:43.247306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:43.247306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:23:43.247306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:23:43.247306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:23:43.247306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:23:43.247306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:43.247306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:43.247306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:43.247306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:43.247306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:43.247306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:43.248139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:43.248139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:43.248139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:43.248139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:43.248139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:43.248139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:43.248139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:43.248139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:43.248139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:43.248139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:43.248139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:23:43.248139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:43.248139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 01:23:43.248139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:43.248139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 410/809] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:43 2022] GET /identity/v3/services/network => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:43.248915 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46352d9a-0cc9-4d7b-9d29-4fe6ff4aad48 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:43.264366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:43.300301 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f493e-c5a0-4ad4-8453-f99f9531ac60 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:43.333029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f992af-6dfe-41cc-afec-fae8e710fc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:43.333641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f992af-6dfe-41cc-afec-fae8e710fc8a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:43.333920 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f992af-6dfe-41cc-afec-fae8e710fc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:43.334191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f992af-6dfe-41cc-afec-fae8e710fc8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:43.343898 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f992af-6dfe-41cc-afec-fae8e710fc8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:43.349049 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46352d9a-0cc9-4d7b-9d29-4fe6ff4aad48 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:43.349800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-62f992af-6dfe-41cc-afec-fae8e710fc8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:43.349800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:43.349800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:43.349800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:43.349800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:43.349800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:43.349800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:43.349800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:43.349800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:43.349800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:43.349800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:43.349800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:43.349800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:43.349800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:43.349800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:43.349800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:43.350722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:43.350722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:43.350722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:43.350722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:43.350722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:43.350722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:43.350722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:43.350722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:43.350722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:43.350722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:43.350722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:43.350722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:43.350722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:43.350722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:43.350722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:43.350722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:43.351670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:43.351670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:43.351670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:43.351670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:43.351670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:43.351670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:43.351670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:43.351670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:43.351670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:43.351670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:43.351670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:43.351670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:43.351670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 400/810] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:43.351670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f992af-6dfe-41cc-afec-fae8e710fc8a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:43.386775 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf51dda-8d6f-40a2-8610-cb6b55657b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:43.387324 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf51dda-8d6f-40a2-8610-cb6b55657b74 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:43.387597 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf51dda-8d6f-40a2-8610-cb6b55657b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:43.387865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf51dda-8d6f-40a2-8610-cb6b55657b74 None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:43.388538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf51dda-8d6f-40a2-8610-cb6b55657b74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:43.388834 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf51dda-8d6f-40a2-8610-cb6b55657b74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:43.390233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf51dda-8d6f-40a2-8610-cb6b55657b74 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:43.401902 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 411/811] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:43.402710 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf51dda-8d6f-40a2-8610-cb6b55657b74 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:43.438336 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:43.454403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f992af-6dfe-41cc-afec-fae8e710fc8a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:43.481561 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:43.488533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52c9d7-9b95-4d54-a1ea-881b5a5635f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:43.489151 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52c9d7-9b95-4d54-a1ea-881b5a5635f3 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:43.489426 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52c9d7-9b95-4d54-a1ea-881b5a5635f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:43.489692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52c9d7-9b95-4d54-a1ea-881b5a5635f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:43.496131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52c9d7-9b95-4d54-a1ea-881b5a5635f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:43.497551 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52c9d7-9b95-4d54-a1ea-881b5a5635f3 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:43.505982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf51dda-8d6f-40a2-8610-cb6b55657b74 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:43.508789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-1b52c9d7-9b95-4d54-a1ea-881b5a5635f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:43.508789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:43.508789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:43.508789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:43.508789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:43.508789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:43.508789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:43.508789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:43.508789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:43.508789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:43.508789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:43.508789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:43.508789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:43.508789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:43.508789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:43.509707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:43.509707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:43.509707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:43.509707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:43.509707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:43.509707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:43.509707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:43.509707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:43.509707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:43.509707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:43.509707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:43.509707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:43.509707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:43.509707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:43.509707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:43.509707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:43.509707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:43.510599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:43.510599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:43.510599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:43.510599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:43.510599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:43.510599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:43.510599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:43.510599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:43.510599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 401/812] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:43.510599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52c9d7-9b95-4d54-a1ea-881b5a5635f3 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:43.542720 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25975934-98da-434b-bb1e-b582a955c347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:43.543345 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975934-98da-434b-bb1e-b582a955c347 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:43.543619 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975934-98da-434b-bb1e-b582a955c347 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:43.543886 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975934-98da-434b-bb1e-b582a955c347 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:43.544499 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25975934-98da-434b-bb1e-b582a955c347 None admin] RBAC: Adding query filter params (name=network) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:43.544795 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25975934-98da-434b-bb1e-b582a955c347 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:43.546119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25975934-98da-434b-bb1e-b582a955c347 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:43.550461 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 412/813] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 26 01:23:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:43.551243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25975934-98da-434b-bb1e-b582a955c347 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:43.611470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52c9d7-9b95-4d54-a1ea-881b5a5635f3 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:43.645706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857bbdf-4d64-4b48-913b-50f85985cc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:43.646263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857bbdf-4d64-4b48-913b-50f85985cc0f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:43.646577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857bbdf-4d64-4b48-913b-50f85985cc0f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:43.646871 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857bbdf-4d64-4b48-913b-50f85985cc0f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:43.647456 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857bbdf-4d64-4b48-913b-50f85985cc0f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:43.648809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857bbdf-4d64-4b48-913b-50f85985cc0f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:43.652558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25975934-98da-434b-bb1e-b582a955c347 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:43.657556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-2857bbdf-4d64-4b48-913b-50f85985cc0f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 01:23:43.657556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:43.657556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:23:43.657556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:23:43.657556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:23:43.657556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:23:43.657556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:23:43.657556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:43.657556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 01:23:43.657556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:43.657556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:23:43.657556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:43.657556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:43.657556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:43.657556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:43.657556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:43.657556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:43.658739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:43.658739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:43.658739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:43.658739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:43.658739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:43.658739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:43.658739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:23:43.658739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:23:43.658739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:23:43.658739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:23:43.658739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:43.658739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:43.658739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:43.658739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:43.658739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:43.658739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:43.659763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:43.659763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:43.659763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:43.659763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:43.659763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:43.659763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:43.659763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:43.659763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:43.659763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:43.659763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:43.659763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:23:43.659763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:43.659763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 01:23:43.659763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:43.659763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 402/814] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Sep 26 01:23:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:43.660575 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857bbdf-4d64-4b48-913b-50f85985cc0f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:43.672086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:43.686683 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fb85a-de9a-4095-b5f5-0df4ba9ef6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:43.687308 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fb85a-de9a-4095-b5f5-0df4ba9ef6aa None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:43.688242 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fb85a-de9a-4095-b5f5-0df4ba9ef6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:43.688520 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fb85a-de9a-4095-b5f5-0df4ba9ef6aa None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:43.689309 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fb85a-de9a-4095-b5f5-0df4ba9ef6aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:43.689612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fb85a-de9a-4095-b5f5-0df4ba9ef6aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:43.690966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fb85a-de9a-4095-b5f5-0df4ba9ef6aa None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:43.696094 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:43.700392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 413/815] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:23:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:43.701172 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fb85a-de9a-4095-b5f5-0df4ba9ef6aa None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:43.762078 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857bbdf-4d64-4b48-913b-50f85985cc0f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:43.795177 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfce208-e37c-4776-84ce-1c91f5988327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:43.795827 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfce208-e37c-4776-84ce-1c91f5988327 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:43.796104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfce208-e37c-4776-84ce-1c91f5988327 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:43.796382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfce208-e37c-4776-84ce-1c91f5988327 None admin] PATH_INFO: `/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/c924da83d1a94c49814d2e7b5969c8e9/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:43.798413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfce208-e37c-4776-84ce-1c91f5988327 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fda1727cc3d47b9a1fae73c74f32c27, user_id=c924da83d1a94c49814d2e7b5969c8e9, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:43.799870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfce208-e37c-4776-84ce-1c91f5988327 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:43.802091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fb85a-de9a-4095-b5f5-0df4ba9ef6aa None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:43.813367 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 403/816] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:23:43 2022] PUT /identity/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/c924da83d1a94c49814d2e7b5969c8e9/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:23:43.814162 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfce208-e37c-4776-84ce-1c91f5988327 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:43.840987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c0185-0ee8-4d12-b0d4-83625459f324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:43.841643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0185-0ee8-4d12-b0d4-83625459f324 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:43.842037 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0185-0ee8-4d12-b0d4-83625459f324 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:43.842326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0185-0ee8-4d12-b0d4-83625459f324 None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:43.843029 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c0185-0ee8-4d12-b0d4-83625459f324 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:43.843398 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c0185-0ee8-4d12-b0d4-83625459f324 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:43.845032 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c0185-0ee8-4d12-b0d4-83625459f324 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:43.864108 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 414/817] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:43.864108 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c0185-0ee8-4d12-b0d4-83625459f324 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:43.897457 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:43.926846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:43.935955 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfce208-e37c-4776-84ce-1c91f5988327 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:43.974910 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cc908-e1a2-40ff-89bf-9ae37c73e7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:43.975537 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cc908-e1a2-40ff-89bf-9ae37c73e7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:43.975818 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cc908-e1a2-40ff-89bf-9ae37c73e7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:43.975922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c0185-0ee8-4d12-b0d4-83625459f324 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:43.976097 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cc908-e1a2-40ff-89bf-9ae37c73e7f6 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:43.976745 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419cc908-e1a2-40ff-89bf-9ae37c73e7f6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:43.977052 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419cc908-e1a2-40ff-89bf-9ae37c73e7f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:43.978432 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419cc908-e1a2-40ff-89bf-9ae37c73e7f6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:43.983771 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 404/818] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 26 01:23:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:43.985142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cc908-e1a2-40ff-89bf-9ae37c73e7f6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:44.022866 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc7dcc-ca9b-4bf2-8df8-7cb706eca700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:44.023450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc7dcc-ca9b-4bf2-8df8-7cb706eca700 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:44.023725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc7dcc-ca9b-4bf2-8df8-7cb706eca700 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:44.023993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc7dcc-ca9b-4bf2-8df8-7cb706eca700 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:44.024618 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc7dcc-ca9b-4bf2-8df8-7cb706eca700 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:44.024919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc7dcc-ca9b-4bf2-8df8-7cb706eca700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:44.026256 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc7dcc-ca9b-4bf2-8df8-7cb706eca700 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:44.034867 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 415/819] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Sep 26 01:23:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:44.034867 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc7dcc-ca9b-4bf2-8df8-7cb706eca700 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:44.095682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cc908-e1a2-40ff-89bf-9ae37c73e7f6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:44.129624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4493e0-3346-4574-aa99-6c74cb1fa586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:44.130622 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4493e0-3346-4574-aa99-6c74cb1fa586 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:44.130929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4493e0-3346-4574-aa99-6c74cb1fa586 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:44.131223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4493e0-3346-4574-aa99-6c74cb1fa586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:44.133103 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:44.139851 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc7dcc-ca9b-4bf2-8df8-7cb706eca700 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:44.145082 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4493e0-3346-4574-aa99-6c74cb1fa586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:44.147324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4493e0-3346-4574-aa99-6c74cb1fa586 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:44.162458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-0a4493e0-3346-4574-aa99-6c74cb1fa586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:44.162458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:44.162458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:44.162458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:44.162458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:44.162458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:44.162458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:44.162458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:44.162458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:44.162458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:44.162458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:44.162458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:44.162458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:44.162458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:44.162458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:44.162458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:44.163533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:44.163533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:44.163533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:44.163533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:44.163533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:44.163533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:44.163533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:44.163533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:44.163533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:44.163533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:44.163533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:44.163533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:44.163533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:44.163533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:44.163533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:44.163533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:44.163533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:44.164452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:44.164452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:44.164452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:44.164452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 405/820] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:44.164452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4493e0-3346-4574-aa99-6c74cb1fa586 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:44.170392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:44.181939 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa1990-3c19-4766-9f54-62dda2470f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:44.182543 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa1990-3c19-4766-9f54-62dda2470f73 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:44.182842 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa1990-3c19-4766-9f54-62dda2470f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:44.183124 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa1990-3c19-4766-9f54-62dda2470f73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:44.183851 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa1990-3c19-4766-9f54-62dda2470f73 None admin] RBAC: Adding query filter params (role.id=50adf18edc1a47b2bae0876828a88dbf, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=3d6eaeb6bced49afabc7bdaa5e7cecfb) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:44.184153 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa1990-3c19-4766-9f54-62dda2470f73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:44.185565 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa1990-3c19-4766-9f54-62dda2470f73 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:44.192602 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 416/821] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:23:44 2022] GET /identity/v3/role_assignments?user.id=3d6eaeb6bced49afabc7bdaa5e7cecfb&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:44.193326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa1990-3c19-4766-9f54-62dda2470f73 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:44.293257 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4493e0-3346-4574-aa99-6c74cb1fa586 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:44.335465 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa1990-3c19-4766-9f54-62dda2470f73 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:44.336719 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad2ad7-71cc-4a9f-b85a-a9e7b68e2501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:44.337761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad2ad7-71cc-4a9f-b85a-a9e7b68e2501 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:44.339190 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad2ad7-71cc-4a9f-b85a-a9e7b68e2501 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:44.339706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad2ad7-71cc-4a9f-b85a-a9e7b68e2501 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:44.340584 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad2ad7-71cc-4a9f-b85a-a9e7b68e2501 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:44.342132 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad2ad7-71cc-4a9f-b85a-a9e7b68e2501 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:44.376333 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 406/822] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:23:44 2022] POST /identity/v3/endpoints => generated 337 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:23:44.377722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad2ad7-71cc-4a9f-b85a-a9e7b68e2501 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:44.386591 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2048c4-0723-4097-9ba4-7088b5c844bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:44.387252 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2048c4-0723-4097-9ba4-7088b5c844bc None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:44.387530 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2048c4-0723-4097-9ba4-7088b5c844bc None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:44.387847 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2048c4-0723-4097-9ba4-7088b5c844bc None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:44.388493 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2048c4-0723-4097-9ba4-7088b5c844bc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:44.388797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2048c4-0723-4097-9ba4-7088b5c844bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:44.391616 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2048c4-0723-4097-9ba4-7088b5c844bc None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:44.397779 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 417/823] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Sep 26 01:23:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:44.403311 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2048c4-0723-4097-9ba4-7088b5c844bc None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:44.446621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:44.479062 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:44.525621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad2ad7-71cc-4a9f-b85a-a9e7b68e2501 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:44.549139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2048c4-0723-4097-9ba4-7088b5c844bc None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:44.574174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f506fe6-8078-416a-a399-40920e14ee38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:44.574819 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f506fe6-8078-416a-a399-40920e14ee38 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:44.575119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f506fe6-8078-416a-a399-40920e14ee38 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:44.575389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f506fe6-8078-416a-a399-40920e14ee38 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:44.576054 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f506fe6-8078-416a-a399-40920e14ee38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:44.576356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f506fe6-8078-416a-a399-40920e14ee38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:44.577893 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f506fe6-8078-416a-a399-40920e14ee38 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:44.598871 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 407/824] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:44.600384 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16c258-c875-4b7c-9561-8ee0167e5118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:44.600962 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16c258-c875-4b7c-9561-8ee0167e5118 None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:44.601246 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16c258-c875-4b7c-9561-8ee0167e5118 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:44.601521 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16c258-c875-4b7c-9561-8ee0167e5118 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:44.602193 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16c258-c875-4b7c-9561-8ee0167e5118 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:44.603777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f506fe6-8078-416a-a399-40920e14ee38 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:44.604881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16c258-c875-4b7c-9561-8ee0167e5118 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:44.648672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 418/825] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:23:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:23:44.726596 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f506fe6-8078-416a-a399-40920e14ee38 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:44.728349 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:44.776399 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c2a8d-7d05-4520-8bb0-8dde4a149937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:44.777038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c2a8d-7d05-4520-8bb0-8dde4a149937 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:44.777314 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c2a8d-7d05-4520-8bb0-8dde4a149937 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:44.777581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c2a8d-7d05-4520-8bb0-8dde4a149937 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:44.786326 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c2a8d-7d05-4520-8bb0-8dde4a149937 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:44.787875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c2a8d-7d05-4520-8bb0-8dde4a149937 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:44.803737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-882c2a8d-7d05-4520-8bb0-8dde4a149937 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 01:23:44.803737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:44.803737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:44.803737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:44.803737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:44.803737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:44.803737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:44.803737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:44.803737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:44.803737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:44.803737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:44.803737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:44.803737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:44.803737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:44.803737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:44.803737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:44.804761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:44.804761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:44.804761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:44.804761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:44.804761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:44.804761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:44.804761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:44.804761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:44.804761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:44.804761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:44.804761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:44.804761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:44.804761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:44.804761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:44.804761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:44.804761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:44.804761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:44.804761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:44.805738 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:44.805738 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:44.805738 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:44.805738 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:44.805738 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:44.805738 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:44.805738 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:44.805738 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:44.805738 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 01:23:44.805738 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:44.805738 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 408/826] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 26 01:23:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:44.812975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16c258-c875-4b7c-9561-8ee0167e5118 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:44.943600 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16c258-c875-4b7c-9561-8ee0167e5118 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:44.946261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:44.981545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494d56c-772f-4cb2-9992-057583251ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:44.982067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494d56c-772f-4cb2-9992-057583251ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:44.982344 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494d56c-772f-4cb2-9992-057583251ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:44.982620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494d56c-772f-4cb2-9992-057583251ee1 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:44.983382 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494d56c-772f-4cb2-9992-057583251ee1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:44.983684 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494d56c-772f-4cb2-9992-057583251ee1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:44.986225 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494d56c-772f-4cb2-9992-057583251ee1 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:45.005177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 419/827] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Sep 26 01:23:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:45.010465 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c2a8d-7d05-4520-8bb0-8dde4a149937 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:45.116248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c2a8d-7d05-4520-8bb0-8dde4a149937 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:45.151803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e6b57-c273-48a2-9aa4-6e02152351bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:45.152446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e6b57-c273-48a2-9aa4-6e02152351bc None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:45.152698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e6b57-c273-48a2-9aa4-6e02152351bc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:45.152970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e6b57-c273-48a2-9aa4-6e02152351bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:45.164825 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e6b57-c273-48a2-9aa4-6e02152351bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:45.166281 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e6b57-c273-48a2-9aa4-6e02152351bc None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:45.181848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-177e6b57-c273-48a2-9aa4-6e02152351bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:45.181848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:45.181848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:45.181848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:45.181848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:45.181848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:45.181848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:45.181848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:45.181848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:45.181848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:45.181848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:45.181848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:45.181848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:45.181848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:45.181848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:45.181848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:45.182937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:45.182937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:45.182937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:45.182937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:45.182937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:45.182937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:45.182937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:45.182937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:45.182937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:45.182937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:45.182937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:45.182937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:45.182937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:45.182937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:45.182937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:45.182937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:45.182937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:45.183863 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:45.183863 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:45.183863 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:45.183863 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 409/828] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:45.189058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494d56c-772f-4cb2-9992-057583251ee1 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:45.300549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494d56c-772f-4cb2-9992-057583251ee1 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:45.336076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82198634-def5-4c8c-a90f-bb9d78995075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:45.337379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82198634-def5-4c8c-a90f-bb9d78995075 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:45.337817 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82198634-def5-4c8c-a90f-bb9d78995075 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:45.338242 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82198634-def5-4c8c-a90f-bb9d78995075 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:45.339045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82198634-def5-4c8c-a90f-bb9d78995075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:45.339514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82198634-def5-4c8c-a90f-bb9d78995075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:45.340999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82198634-def5-4c8c-a90f-bb9d78995075 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:45.353854 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 420/829] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:45.359301 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e6b57-c273-48a2-9aa4-6e02152351bc None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:45.381407 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:45.473339 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e6b57-c273-48a2-9aa4-6e02152351bc None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:45.509161 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff6313-8d06-45eb-a07e-2d3b445c24ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:45.509790 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff6313-8d06-45eb-a07e-2d3b445c24ef None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:45.510072 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff6313-8d06-45eb-a07e-2d3b445c24ef None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:45.510349 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff6313-8d06-45eb-a07e-2d3b445c24ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:45.517341 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff6313-8d06-45eb-a07e-2d3b445c24ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:45.518785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff6313-8d06-45eb-a07e-2d3b445c24ef None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:45.530163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-40ff6313-8d06-45eb-a07e-2d3b445c24ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:45.530163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:45.530163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:45.530163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:45.530163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:45.530163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:45.530163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:45.530163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:45.530163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:45.530163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:45.530163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:45.530163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:45.530163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:45.530163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:45.530163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:45.531369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:45.531369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:45.531369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:45.531369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:45.531369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:45.531369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:45.531369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:45.531369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:45.531369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:45.531369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:45.531369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:45.531369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:45.531369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:45.531369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:45.531369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:45.531369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:45.531369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:45.532302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:45.532302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:45.532302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:45.532302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:45.532302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:45.532302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:45.532302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:45.532302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:45.532302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 410/830] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:45.537303 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82198634-def5-4c8c-a90f-bb9d78995075 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:45.564704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:45.643490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82198634-def5-4c8c-a90f-bb9d78995075 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:45.678789 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40636949-0c4b-4481-bea2-22fa55d1c7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:45.679422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636949-0c4b-4481-bea2-22fa55d1c7de None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:45.679701 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636949-0c4b-4481-bea2-22fa55d1c7de None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:45.679969 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636949-0c4b-4481-bea2-22fa55d1c7de None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:45.680665 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40636949-0c4b-4481-bea2-22fa55d1c7de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:45.680969 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40636949-0c4b-4481-bea2-22fa55d1c7de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:45.682386 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40636949-0c4b-4481-bea2-22fa55d1c7de None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:45.698926 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 421/831] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:45.700906 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff6313-8d06-45eb-a07e-2d3b445c24ef None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:45.782679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:45.808855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff6313-8d06-45eb-a07e-2d3b445c24ef None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:45.843500 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e3cbc-cf4a-4ead-8036-191b4107323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:45.844599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e3cbc-cf4a-4ead-8036-191b4107323c None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:45.844963 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e3cbc-cf4a-4ead-8036-191b4107323c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:45.845237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e3cbc-cf4a-4ead-8036-191b4107323c None admin] PATH_INFO: `/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/6f4696c410f343709be200dee463bd1c/roles/8801886a5f4e4695a29b60c6eb347932` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:45.860139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e3cbc-cf4a-4ead-8036-191b4107323c None admin] RBAC: Authorizing `identity:create_grant(project_id=0fda1727cc3d47b9a1fae73c74f32c27, user_id=6f4696c410f343709be200dee463bd1c, role_id=8801886a5f4e4695a29b60c6eb347932)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:45.861577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e3cbc-cf4a-4ead-8036-191b4107323c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:45.878432 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 411/832] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:23:45 2022] PUT /identity/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/6f4696c410f343709be200dee463bd1c/roles/8801886a5f4e4695a29b60c6eb347932 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:23:46.091845 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a8e88-211a-4dab-9c70-e37751dd16f3 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:46.092247 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a8e88-211a-4dab-9c70-e37751dd16f3 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:46.092428 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a8e88-211a-4dab-9c70-e37751dd16f3 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:46.093968 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 422/833] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:46.099532 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54029a-9972-4121-a377-ca1414109d7b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:46.100083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54029a-9972-4121-a377-ca1414109d7b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:46.100560 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54029a-9972-4121-a377-ca1414109d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:46.118968 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-ea54029a-9972-4121-a377-ca1414109d7b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:46.120471 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ea54029a-9972-4121-a377-ca1414109d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:46.191355 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 412/834] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:23:46.480265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a8e88-211a-4dab-9c70-e37751dd16f3 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:46.572227 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:46.602311 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a8e88-211a-4dab-9c70-e37751dd16f3 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:46.638541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073633a8-a027-40cd-8679-d5e1c45d202b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:46.639202 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073633a8-a027-40cd-8679-d5e1c45d202b None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:46.639481 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073633a8-a027-40cd-8679-d5e1c45d202b None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:46.639754 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073633a8-a027-40cd-8679-d5e1c45d202b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:46.651665 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073633a8-a027-40cd-8679-d5e1c45d202b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:46.657343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-073633a8-a027-40cd-8679-d5e1c45d202b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:23:46.657343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:46.657343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:46.657343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:46.657343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:46.657343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:46.657343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:46.657343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:46.657343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:46.657343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:46.657343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:46.657343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:46.657343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:46.657343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:46.657343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:46.657343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:46.658381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:46.658381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:46.658381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:46.658381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:46.658381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:46.658381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:46.658381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:46.658381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:46.658381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:46.658381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:46.658381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:46.658381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:46.658381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:46.658381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:46.658381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:46.658381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:46.659248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:46.659248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:46.659248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:46.659248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:46.659248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:46.659248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:46.659248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:46.659248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:46.659248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:46.659248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:46.659248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:23:46.659248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:46.659248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 423/835] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:23:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:46.664612 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54029a-9972-4121-a377-ca1414109d7b None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:46.668736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bacd5f-30d0-494d-9012-10010bde9f82 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:46.673963 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bacd5f-30d0-494d-9012-10010bde9f82 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:46.674242 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bacd5f-30d0-494d-9012-10010bde9f82 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:46.675902 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 424/836] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:46.684039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec86bf-5046-4a27-941e-ec68b7a39f19 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:46.684325 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec86bf-5046-4a27-941e-ec68b7a39f19 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:46.684598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec86bf-5046-4a27-941e-ec68b7a39f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:46.703788 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-bdec86bf-5046-4a27-941e-ec68b7a39f19 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:46.705099 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-bdec86bf-5046-4a27-941e-ec68b7a39f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:46.722359 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:46.777461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54029a-9972-4121-a377-ca1414109d7b None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:46.786952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 425/837] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 01:23:46.813486 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a4960-acf5-40af-9bf5-e54dceacc3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:46.814096 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a4960-acf5-40af-9bf5-e54dceacc3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:46.814372 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a4960-acf5-40af-9bf5-e54dceacc3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:46.814693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a4960-acf5-40af-9bf5-e54dceacc3e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:46.815384 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a4960-acf5-40af-9bf5-e54dceacc3e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:46.815737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a4960-acf5-40af-9bf5-e54dceacc3e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:46.817105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a4960-acf5-40af-9bf5-e54dceacc3e2 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:46.827227 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 413/838] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:23:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:46.833710 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec86bf-5046-4a27-941e-ec68b7a39f19 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:46.904267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:46.936469 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec86bf-5046-4a27-941e-ec68b7a39f19 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:46.972015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a3859-8879-495f-98d9-d5afb87627a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:46.972644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a3859-8879-495f-98d9-d5afb87627a7 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:46.972921 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a3859-8879-495f-98d9-d5afb87627a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:46.973191 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a3859-8879-495f-98d9-d5afb87627a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:46.983403 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a3859-8879-495f-98d9-d5afb87627a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:46.985097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a3859-8879-495f-98d9-d5afb87627a7 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:46.999556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-6a6a3859-8879-495f-98d9-d5afb87627a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:46.999556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:46.999556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:46.999556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:46.999556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:46.999556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:46.999556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:46.999556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:46.999556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:46.999556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:46.999556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:46.999556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:46.999556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:46.999556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:46.999556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:46.999556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:47.000663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:47.000663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:47.000663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:47.000663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:47.000663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:47.000663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:47.000663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:47.000663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:47.000663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:47.000663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:47.000663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:47.000663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:47.000663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:47.000663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:47.000663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:47.000663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:47.000663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:47.001548 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:47.001548 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:47.001548 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:47.001548 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 426/839] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:47.006616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a4960-acf5-40af-9bf5-e54dceacc3e2 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:47.074066 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a3859-8879-495f-98d9-d5afb87627a7 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:47.123159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a4960-acf5-40af-9bf5-e54dceacc3e2 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:47.137517 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:47.168389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5ac4f-ad04-4121-b838-bdeb04709790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:47.169015 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5ac4f-ad04-4121-b838-bdeb04709790 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:47.169293 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5ac4f-ad04-4121-b838-bdeb04709790 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:47.169565 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5ac4f-ad04-4121-b838-bdeb04709790 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:47.170211 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5ac4f-ad04-4121-b838-bdeb04709790 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:47.170509 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5ac4f-ad04-4121-b838-bdeb04709790 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:47.172451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5ac4f-ad04-4121-b838-bdeb04709790 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:47.191065 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 414/840] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:47.192591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d48b-ebb5-47ee-96c7-0e28bdfc1167 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:47.193156 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d48b-ebb5-47ee-96c7-0e28bdfc1167 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:47.193156 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d48b-ebb5-47ee-96c7-0e28bdfc1167 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:47.194593 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 415/841] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:47.195872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95d48b-ebb5-47ee-96c7-0e28bdfc1167 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:47.209505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a3859-8879-495f-98d9-d5afb87627a7 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:47.237263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:47.248834 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec733ed-d83b-4774-8ca8-db885614b9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:47.249484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec733ed-d83b-4774-8ca8-db885614b9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:47.249758 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec733ed-d83b-4774-8ca8-db885614b9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:47.250080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec733ed-d83b-4774-8ca8-db885614b9a0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:47.250663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec733ed-d83b-4774-8ca8-db885614b9a0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:47.252080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec733ed-d83b-4774-8ca8-db885614b9a0 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:47.261999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-aec733ed-d83b-4774-8ca8-db885614b9a0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 01:23:47.261999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:47.261999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:23:47.261999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:23:47.261999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:23:47.261999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:23:47.261999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:23:47.261999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:47.261999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 01:23:47.261999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:47.261999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:23:47.261999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:47.261999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:47.261999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:47.261999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:47.261999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:47.263327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:47.263327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:47.263327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:47.263327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:47.263327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:47.263327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:47.263327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:47.263327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:23:47.263327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:23:47.263327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:23:47.263327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:23:47.263327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:47.263327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:47.263327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:47.263327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:47.263327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:47.263327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:47.264310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:47.264310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:47.264310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:47.264310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:47.264310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:47.264310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:47.264310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:47.264310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:47.264310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:47.264310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:47.264310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:23:47.264310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:47.264310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 01:23:47.264310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:47.267207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 427/842] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Sep 26 01:23:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:47.269197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa466772-2b30-41cf-bc8d-77b2e8897ddf None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:47.269481 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa466772-2b30-41cf-bc8d-77b2e8897ddf None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:47.269754 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa466772-2b30-41cf-bc8d-77b2e8897ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:47.290927 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-fa466772-2b30-41cf-bc8d-77b2e8897ddf None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:47.292315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-fa466772-2b30-41cf-bc8d-77b2e8897ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:47.367604 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 428/843] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:23:47.368448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa466772-2b30-41cf-bc8d-77b2e8897ddf None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:47.447844 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95d48b-ebb5-47ee-96c7-0e28bdfc1167 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:47.493764 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da396739-9bcb-4335-b827-3ffa51efebd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:47.495408 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da396739-9bcb-4335-b827-3ffa51efebd4 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:47.495894 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da396739-9bcb-4335-b827-3ffa51efebd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:47.496369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da396739-9bcb-4335-b827-3ffa51efebd4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:47.497170 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa466772-2b30-41cf-bc8d-77b2e8897ddf None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:47.506689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da396739-9bcb-4335-b827-3ffa51efebd4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:47.509264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da396739-9bcb-4335-b827-3ffa51efebd4 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:47.516442 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:47.528146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-da396739-9bcb-4335-b827-3ffa51efebd4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 01:23:47.528146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:47.528146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:47.528146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:47.528146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:47.528146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:47.528146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:47.528146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:47.528146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:47.528146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:47.528146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:47.528146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:47.528146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:47.528146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:47.528146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:47.528146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:47.529146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:47.529146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:47.529146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:47.529146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:47.529146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:47.529146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:47.529146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:47.529146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:47.529146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:47.529146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:47.529146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:47.529146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:47.529146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:47.529146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:47.529146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:47.529146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:47.529146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:47.529146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:47.530083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:47.530083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:47.530083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:47.530083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:47.530083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:47.530083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:47.530083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:47.530083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:47.530083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 01:23:47.530083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:47.537474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 416/844] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:23:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:47.538120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5eeae-8c81-4ff1-bb7c-8040c3e717f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:47.538378 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da396739-9bcb-4335-b827-3ffa51efebd4 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:47.539283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5eeae-8c81-4ff1-bb7c-8040c3e717f6 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:47.539779 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5eeae-8c81-4ff1-bb7c-8040c3e717f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:47.540261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5eeae-8c81-4ff1-bb7c-8040c3e717f6 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:47.541379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5eeae-8c81-4ff1-bb7c-8040c3e717f6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:47.541880 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5eeae-8c81-4ff1-bb7c-8040c3e717f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:47.544327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5eeae-8c81-4ff1-bb7c-8040c3e717f6 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:47.549669 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 429/845] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 26 01:23:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:47.555188 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5eeae-8c81-4ff1-bb7c-8040c3e717f6 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:47.578527 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:47.653545 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da396739-9bcb-4335-b827-3ffa51efebd4 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:47.658737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5eeae-8c81-4ff1-bb7c-8040c3e717f6 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:47.691196 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11737d-22de-4e8b-9c07-8a997ecc024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:47.692198 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11737d-22de-4e8b-9c07-8a997ecc024c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:47.692762 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11737d-22de-4e8b-9c07-8a997ecc024c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:47.693127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11737d-22de-4e8b-9c07-8a997ecc024c None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:47.693955 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11737d-22de-4e8b-9c07-8a997ecc024c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:47.694145 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9915ded-1fef-4d18-bc5e-9cb91e1edab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:47.694278 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11737d-22de-4e8b-9c07-8a997ecc024c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:47.694685 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9915ded-1fef-4d18-bc5e-9cb91e1edab2 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:47.694991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9915ded-1fef-4d18-bc5e-9cb91e1edab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:47.695572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9915ded-1fef-4d18-bc5e-9cb91e1edab2 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:47.695948 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11737d-22de-4e8b-9c07-8a997ecc024c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:47.696202 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9915ded-1fef-4d18-bc5e-9cb91e1edab2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:47.696501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9915ded-1fef-4d18-bc5e-9cb91e1edab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:47.698184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9915ded-1fef-4d18-bc5e-9cb91e1edab2 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:47.714992 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 430/846] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 26 01:23:47 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:23:47.714992 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9915ded-1fef-4d18-bc5e-9cb91e1edab2 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:47.715961 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 417/847] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Sep 26 01:23:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:47.723164 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11737d-22de-4e8b-9c07-8a997ecc024c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:47.777250 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:47.835039 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:47.847406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11737d-22de-4e8b-9c07-8a997ecc024c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:47.861654 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9915ded-1fef-4d18-bc5e-9cb91e1edab2 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:47.895159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1019f0-0d06-46da-a15f-134e5ffaf250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:47.896118 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1019f0-0d06-46da-a15f-134e5ffaf250 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:47.896671 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1019f0-0d06-46da-a15f-134e5ffaf250 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:47.897214 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1019f0-0d06-46da-a15f-134e5ffaf250 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:47.899571 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd052dff-ff63-43d6-8e5c-5ebc9db6cd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:47.900195 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd052dff-ff63-43d6-8e5c-5ebc9db6cd7f None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:47.901264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd052dff-ff63-43d6-8e5c-5ebc9db6cd7f None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:47.902287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd052dff-ff63-43d6-8e5c-5ebc9db6cd7f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:47.902287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd052dff-ff63-43d6-8e5c-5ebc9db6cd7f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:47.903524 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd052dff-ff63-43d6-8e5c-5ebc9db6cd7f None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:47.914058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-bd052dff-ff63-43d6-8e5c-5ebc9db6cd7f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 01:23:47.914058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:47.914058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:23:47.914058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:23:47.914058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:23:47.914058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:23:47.914058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:23:47.914058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:47.914058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 01:23:47.914058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:47.914058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:23:47.914058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:47.914058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:47.914058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:47.914058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:47.914058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:47.914058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:47.915264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:47.915264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:47.915264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:47.915264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:47.915264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:47.915264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:47.915264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:23:47.915264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:23:47.915264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:23:47.915264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:23:47.915264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:47.915264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:47.915264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:47.915264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:47.915264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:47.915264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:47.916248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:47.916248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:47.916248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:47.916248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:47.916248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:47.916248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:47.916248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:47.916248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:47.916248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:47.916248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:47.916248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:23:47.916248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:47.916248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 01:23:47.916248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:47.916248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 431/848] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:23:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:47.922584 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd052dff-ff63-43d6-8e5c-5ebc9db6cd7f None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:47.982577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1019f0-0d06-46da-a15f-134e5ffaf250 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:47.984933 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1019f0-0d06-46da-a15f-134e5ffaf250 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:48.043459 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd052dff-ff63-43d6-8e5c-5ebc9db6cd7f None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:48.057167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:48.085207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cc2ec-8b0c-4ecf-b7ad-4e72d48b5dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:48.085819 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cc2ec-8b0c-4ecf-b7ad-4e72d48b5dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:48.086102 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cc2ec-8b0c-4ecf-b7ad-4e72d48b5dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:48.086379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cc2ec-8b0c-4ecf-b7ad-4e72d48b5dc5 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:48.087401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cc2ec-8b0c-4ecf-b7ad-4e72d48b5dc5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:48.087401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cc2ec-8b0c-4ecf-b7ad-4e72d48b5dc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:48.088718 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cc2ec-8b0c-4ecf-b7ad-4e72d48b5dc5 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:48.094380 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 432/849] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:23:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:48.103840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cc2ec-8b0c-4ecf-b7ad-4e72d48b5dc5 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:48.107174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:48.118842 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 418/850] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:23:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 01:23:48.124469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1019f0-0d06-46da-a15f-134e5ffaf250 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:48.219369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cc2ec-8b0c-4ecf-b7ad-4e72d48b5dc5 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:48.237494 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1019f0-0d06-46da-a15f-134e5ffaf250 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:48.255657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a5dac-2628-475d-8d96-5e6256b2dc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:48.256223 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a5dac-2628-475d-8d96-5e6256b2dc57 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:48.256501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a5dac-2628-475d-8d96-5e6256b2dc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:48.256769 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a5dac-2628-475d-8d96-5e6256b2dc57 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:48.257388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a5dac-2628-475d-8d96-5e6256b2dc57 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:48.257687 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a5dac-2628-475d-8d96-5e6256b2dc57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:48.259064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a5dac-2628-475d-8d96-5e6256b2dc57 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:48.274871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 433/851] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:23:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:48.274871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d38137-cdae-4554-8fa1-9dea055c9177 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:48.274871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d38137-cdae-4554-8fa1-9dea055c9177 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:48.274871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d38137-cdae-4554-8fa1-9dea055c9177 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:48.274871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 434/852] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:48.281694 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542ca76-8c4d-4f58-84c1-7d6fa7361536 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:48.282072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542ca76-8c4d-4f58-84c1-7d6fa7361536 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:48.282419 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542ca76-8c4d-4f58-84c1-7d6fa7361536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:48.286610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3b1d9-f7ac-45ff-8391-f414ed437571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:48.287571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3b1d9-f7ac-45ff-8391-f414ed437571 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:48.287994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3b1d9-f7ac-45ff-8391-f414ed437571 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:48.288422 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3b1d9-f7ac-45ff-8391-f414ed437571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:48.300076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3b1d9-f7ac-45ff-8391-f414ed437571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:48.301877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3b1d9-f7ac-45ff-8391-f414ed437571 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:48.303703 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-c542ca76-8c4d-4f58-84c1-7d6fa7361536 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:48.305283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c542ca76-8c4d-4f58-84c1-7d6fa7361536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:48.319765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-12d3b1d9-f7ac-45ff-8391-f414ed437571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:48.319765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:48.319765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:48.319765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:48.319765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:48.319765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:48.319765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:48.319765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:48.319765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:48.319765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:48.319765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:48.319765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:48.319765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:48.319765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:48.319765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:48.319765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:48.321083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:48.321083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:48.321083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:48.321083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:48.321083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:48.321083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:48.321083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:48.321083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:48.321083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:48.321083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:48.321083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:48.321083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:48.321083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:48.321083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:48.321083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:48.321083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:48.321083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:48.322023 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:48.322023 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:48.322023 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:48.324250 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 419/853] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:48.332103 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3b1d9-f7ac-45ff-8391-f414ed437571 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:48.344481 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:48.386158 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:48.396237 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 435/854] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 01:23:48.457040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3b1d9-f7ac-45ff-8391-f414ed437571 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:48.494934 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef518f7a-77e6-49b8-b779-8c6432b4ea72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:48.495478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef518f7a-77e6-49b8-b779-8c6432b4ea72 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:48.495750 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef518f7a-77e6-49b8-b779-8c6432b4ea72 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:48.496016 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef518f7a-77e6-49b8-b779-8c6432b4ea72 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:48.496645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef518f7a-77e6-49b8-b779-8c6432b4ea72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:48.496942 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef518f7a-77e6-49b8-b779-8c6432b4ea72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:48.498283 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef518f7a-77e6-49b8-b779-8c6432b4ea72 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:48.510774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 420/855] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:23:48.516697 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542ca76-8c4d-4f58-84c1-7d6fa7361536 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:48.631972 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542ca76-8c4d-4f58-84c1-7d6fa7361536 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:48.672447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830889e4-24a7-443f-84e3-9ab457a35df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:48.673095 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830889e4-24a7-443f-84e3-9ab457a35df7 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:48.673356 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830889e4-24a7-443f-84e3-9ab457a35df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:48.673626 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830889e4-24a7-443f-84e3-9ab457a35df7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:48.680741 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef518f7a-77e6-49b8-b779-8c6432b4ea72 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:48.680894 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830889e4-24a7-443f-84e3-9ab457a35df7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:48.682230 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830889e4-24a7-443f-84e3-9ab457a35df7 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:48.697688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-830889e4-24a7-443f-84e3-9ab457a35df7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:48.697688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:48.697688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:48.697688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:48.697688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:48.697688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:48.697688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:48.697688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:48.697688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:48.697688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:48.697688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:48.697688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:48.697688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:48.697688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:48.697688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:48.698620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:48.698620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:48.698620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:48.698620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:48.698620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:48.698620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:48.698620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:48.698620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:48.698620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:48.698620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:48.698620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:48.698620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:48.698620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:48.698620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:48.698620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:48.698620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:48.698620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:48.699546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:48.699546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:48.699546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:48.699546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:48.699546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:48.699546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:48.699546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:48.699546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:48.699546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 436/856] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:48.705384 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830889e4-24a7-443f-84e3-9ab457a35df7 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:48.738815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:48.788668 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef518f7a-77e6-49b8-b779-8c6432b4ea72 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:48.790447 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:48.821050 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830889e4-24a7-443f-84e3-9ab457a35df7 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:48.826552 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705aa1d-fae0-4a15-88c1-1aff2bfdaacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:48.827445 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705aa1d-fae0-4a15-88c1-1aff2bfdaacb None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:48.827928 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705aa1d-fae0-4a15-88c1-1aff2bfdaacb None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:48.828436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705aa1d-fae0-4a15-88c1-1aff2bfdaacb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:48.839361 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705aa1d-fae0-4a15-88c1-1aff2bfdaacb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:48.845242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-c705aa1d-fae0-4a15-88c1-1aff2bfdaacb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:48.845242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:48.845242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:48.845242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:48.845242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:48.845242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:48.845242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:48.845242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:48.845242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:48.845242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:48.845242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:48.845242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:48.845242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:48.845242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:48.845242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:48.845242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:48.846163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:48.846163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:48.846163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:48.846163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:48.846163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:48.846163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:48.846163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:48.846163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:48.846163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:48.846163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:48.846163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:48.846163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:48.846163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:48.846163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:48.846163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:48.846163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:48.847053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:48.847053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:48.847053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:48.847053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:48.847053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:48.847053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:48.847053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:48.847053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:48.847053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:48.847053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:48.847053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:23:48.847053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:48.854258 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 421/857] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:23:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:48.855445 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705aa1d-fae0-4a15-88c1-1aff2bfdaacb None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:48.857716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35732e57-0579-470b-90ca-edd12e74ce15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:48.858312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35732e57-0579-470b-90ca-edd12e74ce15 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:48.858588 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35732e57-0579-470b-90ca-edd12e74ce15 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:48.858878 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35732e57-0579-470b-90ca-edd12e74ce15 None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:48.859707 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35732e57-0579-470b-90ca-edd12e74ce15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:48.860080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35732e57-0579-470b-90ca-edd12e74ce15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:48.861541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35732e57-0579-470b-90ca-edd12e74ce15 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:48.878976 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 437/858] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:23:48.881544 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35732e57-0579-470b-90ca-edd12e74ce15 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:48.970486 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705aa1d-fae0-4a15-88c1-1aff2bfdaacb None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:48.983791 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:48.998501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35732e57-0579-470b-90ca-edd12e74ce15 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:49.010902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f08e8-7cee-4ad0-b15a-f769bcab67e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:49.011592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f08e8-7cee-4ad0-b15a-f769bcab67e0 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:49.011878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f08e8-7cee-4ad0-b15a-f769bcab67e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:49.012453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f08e8-7cee-4ad0-b15a-f769bcab67e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:49.013396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f08e8-7cee-4ad0-b15a-f769bcab67e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:49.013705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f08e8-7cee-4ad0-b15a-f769bcab67e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:49.015250 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f08e8-7cee-4ad0-b15a-f769bcab67e0 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:49.026873 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 422/859] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:23:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:49.031152 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f08e8-7cee-4ad0-b15a-f769bcab67e0 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:49.043832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10523def-1644-4249-95c5-5640ff0397c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:49.044454 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10523def-1644-4249-95c5-5640ff0397c0 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:49.044794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10523def-1644-4249-95c5-5640ff0397c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:49.045155 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10523def-1644-4249-95c5-5640ff0397c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:49.045994 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10523def-1644-4249-95c5-5640ff0397c0 None admin] RBAC: Adding query filter params (role.id=50adf18edc1a47b2bae0876828a88dbf, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=c924da83d1a94c49814d2e7b5969c8e9) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:49.046558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10523def-1644-4249-95c5-5640ff0397c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:49.047911 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10523def-1644-4249-95c5-5640ff0397c0 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:49.059235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 438/860] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:23:48 2022] GET /identity/v3/role_assignments?user.id=c924da83d1a94c49814d2e7b5969c8e9&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:23:49.071224 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:49.148022 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f08e8-7cee-4ad0-b15a-f769bcab67e0 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:49.195612 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b563063-1e9d-482c-9358-6bad75721d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:49.196567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b563063-1e9d-482c-9358-6bad75721d12 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:49.197029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b563063-1e9d-482c-9358-6bad75721d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:49.197471 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b563063-1e9d-482c-9358-6bad75721d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:49.210595 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b563063-1e9d-482c-9358-6bad75721d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:49.212471 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b563063-1e9d-482c-9358-6bad75721d12 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:49.229358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-0b563063-1e9d-482c-9358-6bad75721d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:49.229358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:49.229358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:49.229358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:49.229358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:49.229358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:49.229358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:49.229358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:49.229358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:49.229358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:49.229358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:49.229358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:49.229358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:49.229358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:49.229358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:49.229358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:49.230403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:49.230403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:49.230403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:49.230403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:49.230403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:49.230403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:49.230403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:49.230403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:49.230403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:49.230403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:49.230403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:49.230403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:49.230403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:49.230403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:49.230403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:49.230403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:49.230403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:49.231342 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:49.231342 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:49.231342 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:49.233262 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 423/861] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:49.239114 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10523def-1644-4249-95c5-5640ff0397c0 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:49.352014 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10523def-1644-4249-95c5-5640ff0397c0 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:49.387409 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbddc4-9f55-4e32-9d7c-d49c1a8e390a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:49.388358 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbddc4-9f55-4e32-9d7c-d49c1a8e390a None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:49.388867 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbddc4-9f55-4e32-9d7c-d49c1a8e390a None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:49.389340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbddc4-9f55-4e32-9d7c-d49c1a8e390a None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:49.390207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbddc4-9f55-4e32-9d7c-d49c1a8e390a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:49.391607 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbddc4-9f55-4e32-9d7c-d49c1a8e390a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:49.393166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbddc4-9f55-4e32-9d7c-d49c1a8e390a None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:49.406283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 439/862] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:49.415949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b563063-1e9d-482c-9358-6bad75721d12 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:49.501725 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:49.526161 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b563063-1e9d-482c-9358-6bad75721d12 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:49.563336 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45844e84-dac5-4cfa-9c26-21db649e12d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:49.564049 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45844e84-dac5-4cfa-9c26-21db649e12d3 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:49.564330 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45844e84-dac5-4cfa-9c26-21db649e12d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:49.564661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45844e84-dac5-4cfa-9c26-21db649e12d3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:49.572880 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45844e84-dac5-4cfa-9c26-21db649e12d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:49.574317 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45844e84-dac5-4cfa-9c26-21db649e12d3 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:49.586210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-45844e84-dac5-4cfa-9c26-21db649e12d3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 01:23:49.586210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:49.586210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:49.586210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:49.586210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:49.586210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:49.586210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:49.586210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:49.586210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:49.586210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:49.586210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:49.586210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:49.586210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:49.586210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:49.586210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:49.586210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:49.587191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:49.587191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:49.587191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:49.587191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:49.587191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:49.587191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:49.587191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:49.587191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:49.587191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:49.587191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:49.587191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:49.587191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:49.587191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:49.587191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:49.587191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:49.587191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:49.587191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:49.587191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:49.588173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:49.588173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:49.588173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:49.588173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:49.588173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:49.588173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:49.588173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:49.588173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:49.588173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 01:23:49.588173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:49.588173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 424/863] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 26 01:23:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:49.599934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbddc4-9f55-4e32-9d7c-d49c1a8e390a None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:49.621023 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:49.713664 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbddc4-9f55-4e32-9d7c-d49c1a8e390a None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:49.750364 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4302ba-d9da-4323-bf0b-4af0136589b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:49.751000 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4302ba-d9da-4323-bf0b-4af0136589b2 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:49.751281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4302ba-d9da-4323-bf0b-4af0136589b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:49.751549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4302ba-d9da-4323-bf0b-4af0136589b2 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:49.752281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4302ba-d9da-4323-bf0b-4af0136589b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:49.752584 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4302ba-d9da-4323-bf0b-4af0136589b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:49.754000 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4302ba-d9da-4323-bf0b-4af0136589b2 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:49.772815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 440/864] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Sep 26 01:23:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:49.778156 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45844e84-dac5-4cfa-9c26-21db649e12d3 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:49.884185 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45844e84-dac5-4cfa-9c26-21db649e12d3 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:49.924055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9582b6-4b9e-4bd0-a9c0-319b35468f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:49.924661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9582b6-4b9e-4bd0-a9c0-319b35468f66 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:49.924933 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9582b6-4b9e-4bd0-a9c0-319b35468f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:49.925200 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9582b6-4b9e-4bd0-a9c0-319b35468f66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:49.928814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:49.999072 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9582b6-4b9e-4bd0-a9c0-319b35468f66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:50.000635 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9582b6-4b9e-4bd0-a9c0-319b35468f66 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:50.011418 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee0b50-309a-4aa8-b7ee-9b6fa83320ec None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:50.011704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee0b50-309a-4aa8-b7ee-9b6fa83320ec None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:50.011972 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee0b50-309a-4aa8-b7ee-9b6fa83320ec None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:50.013541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 441/865] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:50.019402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7253292-4fa3-4089-a1d3-f956fc58edce None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:50.019688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7253292-4fa3-4089-a1d3-f956fc58edce None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:50.019965 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7253292-4fa3-4089-a1d3-f956fc58edce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:50.041801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-c7253292-4fa3-4089-a1d3-f956fc58edce None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:50.043200 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c7253292-4fa3-4089-a1d3-f956fc58edce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:50.123275 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:50.130852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 425/866] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:23:49 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 01:23:50.132790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 442/867] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:23:50.138376 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9582b6-4b9e-4bd0-a9c0-319b35468f66 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:50.175216 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:50.241252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9582b6-4b9e-4bd0-a9c0-319b35468f66 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:50.276152 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909477ba-3cbc-4f56-a0f3-02f38557acb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:50.276825 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909477ba-3cbc-4f56-a0f3-02f38557acb7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:50.277098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909477ba-3cbc-4f56-a0f3-02f38557acb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:50.277409 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909477ba-3cbc-4f56-a0f3-02f38557acb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:50.287570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909477ba-3cbc-4f56-a0f3-02f38557acb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:50.288985 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909477ba-3cbc-4f56-a0f3-02f38557acb7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:50.304382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-909477ba-3cbc-4f56-a0f3-02f38557acb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:50.304382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:50.304382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:50.304382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:50.304382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:50.304382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:50.304382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:50.304382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:50.304382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:50.304382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:50.304382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:50.304382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:50.304382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:50.304382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:50.304382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:50.304382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:50.305360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:50.305360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:50.305360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:50.305360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:50.305360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:50.305360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:50.305360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:50.305360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:50.305360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:50.305360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:50.305360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:50.305360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:50.305360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:50.305360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:50.305360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:50.305360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:50.305360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:50.306243 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:50.306243 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:50.306243 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:50.306243 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 426/868] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:50.311322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7253292-4fa3-4089-a1d3-f956fc58edce None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:50.419087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909477ba-3cbc-4f56-a0f3-02f38557acb7 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:50.431770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7253292-4fa3-4089-a1d3-f956fc58edce None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:50.474222 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684c4b9-26fa-45b6-8826-6bf21589f310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:50.474864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684c4b9-26fa-45b6-8826-6bf21589f310 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:50.475220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684c4b9-26fa-45b6-8826-6bf21589f310 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:50.475496 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684c4b9-26fa-45b6-8826-6bf21589f310 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:50.476740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684c4b9-26fa-45b6-8826-6bf21589f310 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:50.476740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684c4b9-26fa-45b6-8826-6bf21589f310 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:50.477833 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684c4b9-26fa-45b6-8826-6bf21589f310 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:50.492736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 443/869] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:50.498625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684c4b9-26fa-45b6-8826-6bf21589f310 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:50.542274 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:50.558744 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909477ba-3cbc-4f56-a0f3-02f38557acb7 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:50.579045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:50.598456 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267fb02-9c5f-4111-ba31-a124f0622bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:50.599084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267fb02-9c5f-4111-ba31-a124f0622bcb None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:50.599774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267fb02-9c5f-4111-ba31-a124f0622bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:50.600053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267fb02-9c5f-4111-ba31-a124f0622bcb None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:50.600774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267fb02-9c5f-4111-ba31-a124f0622bcb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:50.602854 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267fb02-9c5f-4111-ba31-a124f0622bcb None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:50.621214 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 427/870] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 26 01:23:50 2022] POST /identity/v3/services => generated 269 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:23:50.622529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfc087-b5f1-435e-b91b-c0bab1d5c63a None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:50.622929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfc087-b5f1-435e-b91b-c0bab1d5c63a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:50.623206 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfc087-b5f1-435e-b91b-c0bab1d5c63a None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:50.624564 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 428/871] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:50.630275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238963aa-c16c-4262-9247-cf489b0db98a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:50.630567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238963aa-c16c-4262-9247-cf489b0db98a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:50.630782 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238963aa-c16c-4262-9247-cf489b0db98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:50.642005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684c4b9-26fa-45b6-8826-6bf21589f310 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:50.650675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-238963aa-c16c-4262-9247-cf489b0db98a None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:50.652010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-238963aa-c16c-4262-9247-cf489b0db98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:50.702216 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da33bfa-7e3b-4f3e-b8a6-ff802cfc54ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:50.705750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da33bfa-7e3b-4f3e-b8a6-ff802cfc54ee None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:50.706028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da33bfa-7e3b-4f3e-b8a6-ff802cfc54ee None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:50.706299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da33bfa-7e3b-4f3e-b8a6-ff802cfc54ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:50.717853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da33bfa-7e3b-4f3e-b8a6-ff802cfc54ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:50.721215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da33bfa-7e3b-4f3e-b8a6-ff802cfc54ee None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:50.738369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-3da33bfa-7e3b-4f3e-b8a6-ff802cfc54ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:50.738369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:50.738369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:50.738369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:50.738369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:50.738369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:50.738369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:50.738369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:50.738369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:50.738369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:50.738369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:50.738369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:50.738369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:50.738369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:50.738369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:50.739420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:50.739420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:50.739420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:50.739420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:50.739420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:50.739420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:50.739420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:50.739420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:50.739420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:50.739420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:50.739420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:50.739420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:50.739420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:50.739420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:50.739420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:50.739420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:50.739420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:50.740302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:50.740302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:50.740302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:50.740302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:50.740302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:50.740302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:50.740302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:50.740302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:50.746712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 429/872] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:50 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:23:50.747280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 444/873] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:50.748195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238963aa-c16c-4262-9247-cf489b0db98a None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:50.839003 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:50.866333 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238963aa-c16c-4262-9247-cf489b0db98a None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:50.902319 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488648e6-6f2b-4c3f-befe-84932570d4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:50.902951 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488648e6-6f2b-4c3f-befe-84932570d4fe None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:50.903228 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488648e6-6f2b-4c3f-befe-84932570d4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:50.903494 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488648e6-6f2b-4c3f-befe-84932570d4fe None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:50.904173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488648e6-6f2b-4c3f-befe-84932570d4fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:50.904471 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488648e6-6f2b-4c3f-befe-84932570d4fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:50.905876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488648e6-6f2b-4c3f-befe-84932570d4fe None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:50.919349 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 430/874] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:50.925642 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da33bfa-7e3b-4f3e-b8a6-ff802cfc54ee None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:51.025330 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488648e6-6f2b-4c3f-befe-84932570d4fe None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:51.034133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da33bfa-7e3b-4f3e-b8a6-ff802cfc54ee None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:51.051392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:51.071043 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12e03a-bcfd-46f9-8811-28c6289eee1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:51.071643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12e03a-bcfd-46f9-8811-28c6289eee1d None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:51.071923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12e03a-bcfd-46f9-8811-28c6289eee1d None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:51.072194 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12e03a-bcfd-46f9-8811-28c6289eee1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:51.072916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12e03a-bcfd-46f9-8811-28c6289eee1d None admin] RBAC: Adding query filter params (role.id=8801886a5f4e4695a29b60c6eb347932, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=6f4696c410f343709be200dee463bd1c) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:51.073220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12e03a-bcfd-46f9-8811-28c6289eee1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:51.074699 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12e03a-bcfd-46f9-8811-28c6289eee1d None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:51.082608 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 445/875] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:23:50 2022] GET /identity/v3/role_assignments?user.id=6f4696c410f343709be200dee463bd1c&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=8801886a5f4e4695a29b60c6eb347932 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:51.154250 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488648e6-6f2b-4c3f-befe-84932570d4fe None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:51.192964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177fba9-f7c8-48fb-b75e-24337d700822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:51.193583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177fba9-f7c8-48fb-b75e-24337d700822 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:51.193863 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177fba9-f7c8-48fb-b75e-24337d700822 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:51.194136 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177fba9-f7c8-48fb-b75e-24337d700822 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:51.194802 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177fba9-f7c8-48fb-b75e-24337d700822 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:51.196474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177fba9-f7c8-48fb-b75e-24337d700822 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:51.209394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:51.217815 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 431/876] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 26 01:23:51 2022] POST /identity/v3/services => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:23:51.451764 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5295cc0-23ee-41fd-a2f8-ec3f029bb132 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:51.452156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5295cc0-23ee-41fd-a2f8-ec3f029bb132 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:51.452345 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5295cc0-23ee-41fd-a2f8-ec3f029bb132 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:51.454245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 446/877] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:51.459914 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d2113-dba4-4953-9e22-7e2739ea3fd3 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:51.460376 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d2113-dba4-4953-9e22-7e2739ea3fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:51.460461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d2113-dba4-4953-9e22-7e2739ea3fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:51.479452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-250d2113-dba4-4953-9e22-7e2739ea3fd3 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:51.480658 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-250d2113-dba4-4953-9e22-7e2739ea3fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:51.558872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 432/878] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:23:51.831198 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5295cc0-23ee-41fd-a2f8-ec3f029bb132 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:51.941174 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5295cc0-23ee-41fd-a2f8-ec3f029bb132 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:51.975931 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f1d85-0cbf-406f-8b4a-0563a5f3478b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:51.976559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f1d85-0cbf-406f-8b4a-0563a5f3478b None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:51.976835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f1d85-0cbf-406f-8b4a-0563a5f3478b None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:51.977105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f1d85-0cbf-406f-8b4a-0563a5f3478b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:51.977688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f1d85-0cbf-406f-8b4a-0563a5f3478b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:51.979060 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f1d85-0cbf-406f-8b4a-0563a5f3478b None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:51.988839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-1f4f1d85-0cbf-406f-8b4a-0563a5f3478b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 01:23:51.988839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:51.988839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:23:51.988839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:23:51.988839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:23:51.988839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:23:51.988839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:23:51.988839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:51.988839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 01:23:51.988839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:51.988839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:23:51.988839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:51.988839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:51.988839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:51.988839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:51.988839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:51.988839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:51.989966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:51.989966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:51.989966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:51.989966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:51.989966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:51.989966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:51.989966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:23:51.989966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:23:51.989966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:23:51.989966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:23:51.989966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:51.989966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:51.989966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:51.989966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:51.989966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:51.989966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:51.991399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:51.991399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:51.991399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:51.991399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:51.991399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:51.991399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:51.991399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:51.991399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:51.991399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:51.991399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:51.991399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:23:51.991399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:51.991399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 01:23:51.991399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:51.991399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 447/879] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 26 01:23:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:51.995949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d2113-dba4-4953-9e22-7e2739ea3fd3 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:52.104584 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d2113-dba4-4953-9e22-7e2739ea3fd3 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:52.129438 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:52.141270 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6007c-ea1a-4113-8a1d-7a9aaf840af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:52.142449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6007c-ea1a-4113-8a1d-7a9aaf840af1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:52.143000 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6007c-ea1a-4113-8a1d-7a9aaf840af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:52.143488 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6007c-ea1a-4113-8a1d-7a9aaf840af1 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:52.144326 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6007c-ea1a-4113-8a1d-7a9aaf840af1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:52.144839 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6007c-ea1a-4113-8a1d-7a9aaf840af1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:52.146431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6007c-ea1a-4113-8a1d-7a9aaf840af1 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:52.152470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 433/880] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 26 01:23:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:52.162866 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f1d85-0cbf-406f-8b4a-0563a5f3478b None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:52.208173 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:52.263137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f1d85-0cbf-406f-8b4a-0563a5f3478b None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:52.297687 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f337151-ed3e-4d7b-be11-3c04968d1810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:52.298329 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f337151-ed3e-4d7b-be11-3c04968d1810 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:52.298613 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f337151-ed3e-4d7b-be11-3c04968d1810 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:52.298916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f337151-ed3e-4d7b-be11-3c04968d1810 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:52.299544 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f337151-ed3e-4d7b-be11-3c04968d1810 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:52.299846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f337151-ed3e-4d7b-be11-3c04968d1810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:52.301197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f337151-ed3e-4d7b-be11-3c04968d1810 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:52.305908 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 448/881] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 26 01:23:52 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:53.012995 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df6ec0-d79b-4cab-b4fa-90f1c67a643a None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:53.013971 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df6ec0-d79b-4cab-b4fa-90f1c67a643a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:53.014472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df6ec0-d79b-4cab-b4fa-90f1c67a643a None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:53.016796 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 434/882] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:53.022723 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73f9e8-a700-47ff-9bff-e8d01e79d642 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:53.023621 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73f9e8-a700-47ff-9bff-e8d01e79d642 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:53.024109 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73f9e8-a700-47ff-9bff-e8d01e79d642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:53.043360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-df73f9e8-a700-47ff-9bff-e8d01e79d642 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:53.044919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-df73f9e8-a700-47ff-9bff-e8d01e79d642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:53.116502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 449/883] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:23:53.374662 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a2d46-8f49-4e1d-a6d6-10d589147155 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:53.375481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a2d46-8f49-4e1d-a6d6-10d589147155 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:53.375886 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a2d46-8f49-4e1d-a6d6-10d589147155 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:53.377448 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 435/884] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:53.384940 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987bf09-ecb1-4583-afb4-49f687d57647 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:53.385265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987bf09-ecb1-4583-afb4-49f687d57647 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:53.385497 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987bf09-ecb1-4583-afb4-49f687d57647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:53.389066 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a2d46-8f49-4e1d-a6d6-10d589147155 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:53.416803 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-4987bf09-ecb1-4583-afb4-49f687d57647 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:53.418323 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4987bf09-ecb1-4583-afb4-49f687d57647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:53.457477 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:53.507765 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 450/885] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:23:53.511650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e2e4-4713-4a36-b7c7-8a73c6c5383c None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:53.512177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e2e4-4713-4a36-b7c7-8a73c6c5383c None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:53.512654 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e2e4-4713-4a36-b7c7-8a73c6c5383c None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:53.514336 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 451/886] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:53.522609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d9cd7-5bcb-4279-b294-426481504395 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:53.522609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d9cd7-5bcb-4279-b294-426481504395 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:53.522609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d9cd7-5bcb-4279-b294-426481504395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:53.522988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a2d46-8f49-4e1d-a6d6-10d589147155 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:53.539679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-8f9d9cd7-5bcb-4279-b294-426481504395 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:53.541172 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-8f9d9cd7-5bcb-4279-b294-426481504395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:53.559219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78914f0-2fa6-4f36-82e6-5c80b022ed9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:53.559999 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78914f0-2fa6-4f36-82e6-5c80b022ed9b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:53.560376 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78914f0-2fa6-4f36-82e6-5c80b022ed9b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:53.560750 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78914f0-2fa6-4f36-82e6-5c80b022ed9b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:53.561434 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78914f0-2fa6-4f36-82e6-5c80b022ed9b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:53.563030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78914f0-2fa6-4f36-82e6-5c80b022ed9b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:53.572328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-b78914f0-2fa6-4f36-82e6-5c80b022ed9b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 01:23:53.572328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:53.572328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:23:53.572328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:23:53.572328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:23:53.572328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:23:53.572328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:23:53.572328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:53.572328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 01:23:53.572328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:53.572328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:23:53.572328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:53.572328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:53.572328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:53.572328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:53.572328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:53.573515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:53.573515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:53.573515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:53.573515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:53.573515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:53.573515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:53.573515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:53.573515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:23:53.573515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:23:53.573515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:23:53.573515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:23:53.573515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:53.573515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:53.573515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:53.573515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:53.573515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:53.573515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:53.574637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:53.574637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:53.574637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:53.574637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:53.574637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:53.574637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:53.574637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:53.574637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:53.574637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:53.574637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:53.574637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:23:53.574637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:53.574637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 01:23:53.574637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:53.581199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 436/887] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Sep 26 01:23:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:53.582231 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78914f0-2fa6-4f36-82e6-5c80b022ed9b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:53.637197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 452/888] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:23:53.651367 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:53.697633 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78914f0-2fa6-4f36-82e6-5c80b022ed9b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:53.732639 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b34de5-e4eb-49ba-a943-844b5a7f570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:53.733239 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b34de5-e4eb-49ba-a943-844b5a7f570e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:53.733577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b34de5-e4eb-49ba-a943-844b5a7f570e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:53.733852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b34de5-e4eb-49ba-a943-844b5a7f570e None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:53.734570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b34de5-e4eb-49ba-a943-844b5a7f570e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:53.734892 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b34de5-e4eb-49ba-a943-844b5a7f570e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:53.736244 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b34de5-e4eb-49ba-a943-844b5a7f570e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:53.741233 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 437/889] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 26 01:23:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:53.747952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d9cd7-5bcb-4279-b294-426481504395 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:53.792324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b34de5-e4eb-49ba-a943-844b5a7f570e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:53.855011 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:53.861486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d9cd7-5bcb-4279-b294-426481504395 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:53.904115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87914d01-d088-4eae-9f29-f80c72e5f626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:53.904664 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87914d01-d088-4eae-9f29-f80c72e5f626 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:53.904941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87914d01-d088-4eae-9f29-f80c72e5f626 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:53.905212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87914d01-d088-4eae-9f29-f80c72e5f626 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:53.906662 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87914d01-d088-4eae-9f29-f80c72e5f626 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:53.906992 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87914d01-d088-4eae-9f29-f80c72e5f626 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:53.909029 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87914d01-d088-4eae-9f29-f80c72e5f626 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:53.911154 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b34de5-e4eb-49ba-a943-844b5a7f570e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:53.914864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 453/890] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 26 01:23:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:53.924327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87914d01-d088-4eae-9f29-f80c72e5f626 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:53.934500 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:53.957024 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c13c7-4654-4fa0-8307-2b4c3afa876d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:53.957956 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c13c7-4654-4fa0-8307-2b4c3afa876d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:53.958269 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c13c7-4654-4fa0-8307-2b4c3afa876d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:53.958497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c13c7-4654-4fa0-8307-2b4c3afa876d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:53.969292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c13c7-4654-4fa0-8307-2b4c3afa876d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:53.974462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-744c13c7-4654-4fa0-8307-2b4c3afa876d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 01:23:53.974462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:53.974462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:53.974462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:53.974462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:53.974462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:53.974462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:53.974462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:53.974462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:53.974462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:53.974462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:53.974462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:53.974462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:53.974462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:53.974462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:53.974462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:53.975415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:53.975415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:53.975415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:53.975415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:53.975415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:53.975415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:53.975415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:53.975415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:53.975415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:53.975415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:53.975415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:53.975415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:53.975415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:53.975415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:53.975415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:53.975415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:53.979688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:53.979688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:53.979688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:53.979688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:53.979688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:53.979688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:53.979688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:53.979688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:53.979688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:53.979688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:53.979688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 01:23:53.979688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:53.979688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 438/891] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Sep 26 01:23:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:53.979688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c13c7-4654-4fa0-8307-2b4c3afa876d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:54.035958 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87914d01-d088-4eae-9f29-f80c72e5f626 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:54.072604 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946200ad-c54e-4756-a187-3c1fb122dd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:54.073490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946200ad-c54e-4756-a187-3c1fb122dd9e None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:54.073804 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946200ad-c54e-4756-a187-3c1fb122dd9e None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:54.074080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946200ad-c54e-4756-a187-3c1fb122dd9e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:54.074783 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946200ad-c54e-4756-a187-3c1fb122dd9e None admin] RBAC: Adding query filter params (interface=public, service_id=880c9eec101b41ed9a919227297d03b8, region_id=RegionOne) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:54.075156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946200ad-c54e-4756-a187-3c1fb122dd9e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:54.076649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946200ad-c54e-4756-a187-3c1fb122dd9e None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:54.083188 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 454/892] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 26 01:23:53 2022] GET /identity/v3/endpoints?service_id=880c9eec101b41ed9a919227297d03b8&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:54.084177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946200ad-c54e-4756-a187-3c1fb122dd9e None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:54.090684 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c13c7-4654-4fa0-8307-2b4c3afa876d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:54.117354 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:54.128588 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998855bf-7955-4b62-ac63-dad7995acf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:54.129419 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998855bf-7955-4b62-ac63-dad7995acf38 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:54.129870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998855bf-7955-4b62-ac63-dad7995acf38 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:54.130287 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998855bf-7955-4b62-ac63-dad7995acf38 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:54.131059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998855bf-7955-4b62-ac63-dad7995acf38 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:54.133008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998855bf-7955-4b62-ac63-dad7995acf38 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:54.144984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-998855bf-7955-4b62-ac63-dad7995acf38 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 01:23:54.144984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:54.144984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:23:54.144984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:23:54.144984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:23:54.144984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:23:54.144984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:23:54.144984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:54.144984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 01:23:54.144984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:54.144984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:23:54.144984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:54.144984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:54.144984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:54.144984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:54.144984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:54.144984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:54.146229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:54.146229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:54.146229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:54.146229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:54.146229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:54.146229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:54.146229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:23:54.146229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:23:54.146229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:23:54.146229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:23:54.146229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:54.146229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:54.146229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:54.146229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:54.146229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:54.146229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:54.147297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:54.147297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:54.147297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:54.147297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:54.147297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:54.147297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:54.147297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:54.147297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:54.147297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:54.147297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:54.147297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:23:54.147297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:54.147297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 01:23:54.147297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:54.148616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 439/893] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:23:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:54.149148 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998855bf-7955-4b62-ac63-dad7995acf38 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:54.192931 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:54.212735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946200ad-c54e-4756-a187-3c1fb122dd9e None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:54.252955 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998855bf-7955-4b62-ac63-dad7995acf38 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:54.254706 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a179d1-3e58-4fd6-9959-7cffab5ad4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:54.255956 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a179d1-3e58-4fd6-9959-7cffab5ad4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:54.255956 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a179d1-3e58-4fd6-9959-7cffab5ad4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:54.255956 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a179d1-3e58-4fd6-9959-7cffab5ad4d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:54.256501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a179d1-3e58-4fd6-9959-7cffab5ad4d0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:54.256799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a179d1-3e58-4fd6-9959-7cffab5ad4d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:54.258136 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a179d1-3e58-4fd6-9959-7cffab5ad4d0 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:54.271015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 455/894] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 26 01:23:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:54.271015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a179d1-3e58-4fd6-9959-7cffab5ad4d0 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:54.293926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa5c59-eb97-4013-8af0-ef30f034f6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:54.294534 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa5c59-eb97-4013-8af0-ef30f034f6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:54.294997 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa5c59-eb97-4013-8af0-ef30f034f6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:54.295279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa5c59-eb97-4013-8af0-ef30f034f6a9 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:54.296212 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa5c59-eb97-4013-8af0-ef30f034f6a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:54.298776 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa5c59-eb97-4013-8af0-ef30f034f6a9 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:54.305992 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 440/895] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 26 01:23:54 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:23:54.306788 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa5c59-eb97-4013-8af0-ef30f034f6a9 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:54.379355 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:54.397523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a179d1-3e58-4fd6-9959-7cffab5ad4d0 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:54.442444 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6926f5-d158-4fac-9a27-114ec4281329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:54.443174 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6926f5-d158-4fac-9a27-114ec4281329 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:54.443466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6926f5-d158-4fac-9a27-114ec4281329 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:54.443740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6926f5-d158-4fac-9a27-114ec4281329 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:54.444395 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6926f5-d158-4fac-9a27-114ec4281329 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:54.444677 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6926f5-d158-4fac-9a27-114ec4281329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:54.446583 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6926f5-d158-4fac-9a27-114ec4281329 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:54.452496 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 456/896] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:23:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:54.455036 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa5c59-eb97-4013-8af0-ef30f034f6a9 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:54.459183 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:54.471917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6926f5-d158-4fac-9a27-114ec4281329 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:54.514345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e003ca-0ddc-4634-83a6-089f15518025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:54.515929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e003ca-0ddc-4634-83a6-089f15518025 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:54.516394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e003ca-0ddc-4634-83a6-089f15518025 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:54.517435 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e003ca-0ddc-4634-83a6-089f15518025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:54.527988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e003ca-0ddc-4634-83a6-089f15518025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:54.529440 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e003ca-0ddc-4634-83a6-089f15518025 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:54.546099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-29e003ca-0ddc-4634-83a6-089f15518025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:54.546099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:54.546099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:54.546099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:54.546099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:54.546099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:54.546099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:54.546099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:54.546099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:54.546099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:54.546099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:54.546099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:54.546099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:54.546099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:54.546099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:54.546099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:54.547235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:54.547235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:54.547235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:54.547235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:54.547235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:54.547235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:54.547235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:54.547235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:54.547235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:54.547235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:54.547235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:54.547235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:54.547235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:54.547235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:54.547235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:54.547235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:54.547235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:54.548137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:54.548137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:54.548137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:54.548137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 441/897] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:54.548641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a308c-5839-4155-84c6-81cb482ea585 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:54.548940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a308c-5839-4155-84c6-81cb482ea585 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:54.550858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a308c-5839-4155-84c6-81cb482ea585 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:54.550858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 442/898] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:54.558575 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a79d3-2433-4067-b19a-f2ca19355fe1 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:54.558872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a79d3-2433-4067-b19a-f2ca19355fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:54.559148 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a79d3-2433-4067-b19a-f2ca19355fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:54.579621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-da6a79d3-2433-4067-b19a-f2ca19355fe1 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:54.581214 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-da6a79d3-2433-4067-b19a-f2ca19355fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:54.587480 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6926f5-d158-4fac-9a27-114ec4281329 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:54.623015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5f25b-d656-4259-9110-11a84ed3673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:54.623732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5f25b-d656-4259-9110-11a84ed3673c None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:54.624011 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5f25b-d656-4259-9110-11a84ed3673c None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:54.624282 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5f25b-d656-4259-9110-11a84ed3673c None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:54.624953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5f25b-d656-4259-9110-11a84ed3673c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:54.625434 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5f25b-d656-4259-9110-11a84ed3673c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:54.626870 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5f25b-d656-4259-9110-11a84ed3673c None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:54.632453 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 457/899] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:23:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:54.636115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5f25b-d656-4259-9110-11a84ed3673c None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:54.652599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 443/900] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 01:23:54.653857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a79d3-2433-4067-b19a-f2ca19355fe1 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:54.670446 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:54.754108 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:54.770894 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5f25b-d656-4259-9110-11a84ed3673c None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:54.772157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a79d3-2433-4067-b19a-f2ca19355fe1 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:54.814622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc811751-46f0-484e-b144-4a08300975e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:54.815049 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ce87a-c021-4a34-9aaa-baea6cf0b66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:54.815412 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc811751-46f0-484e-b144-4a08300975e5 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:54.815753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc811751-46f0-484e-b144-4a08300975e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:54.815872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ce87a-c021-4a34-9aaa-baea6cf0b66d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:54.816159 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc811751-46f0-484e-b144-4a08300975e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:54.816277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ce87a-c021-4a34-9aaa-baea6cf0b66d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:54.816558 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ce87a-c021-4a34-9aaa-baea6cf0b66d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:54.816975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc811751-46f0-484e-b144-4a08300975e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:54.817341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc811751-46f0-484e-b144-4a08300975e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:54.817455 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ce87a-c021-4a34-9aaa-baea6cf0b66d None admin] RBAC: Adding query filter params (interface=public, service_id=d1edfea500a843b5b831bcee3bdd49d8, region_id=RegionOne) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:54.817794 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ce87a-c021-4a34-9aaa-baea6cf0b66d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:54.818879 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc811751-46f0-484e-b144-4a08300975e5 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:54.819297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ce87a-c021-4a34-9aaa-baea6cf0b66d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:54.828924 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 444/901] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 26 01:23:54 2022] GET /identity/v3/endpoints?service_id=d1edfea500a843b5b831bcee3bdd49d8&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:54.835867 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ce87a-c021-4a34-9aaa-baea6cf0b66d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:54.839191 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 458/902] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:54.847791 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc811751-46f0-484e-b144-4a08300975e5 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:54.946030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:54.958208 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ce87a-c021-4a34-9aaa-baea6cf0b66d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:54.971623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc811751-46f0-484e-b144-4a08300975e5 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:54.997154 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b64acd-c257-46aa-82b8-81fc2b3fc289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:54.997782 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b64acd-c257-46aa-82b8-81fc2b3fc289 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:54.998092 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b64acd-c257-46aa-82b8-81fc2b3fc289 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:54.998368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b64acd-c257-46aa-82b8-81fc2b3fc289 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:54.999012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b64acd-c257-46aa-82b8-81fc2b3fc289 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:55.000461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b64acd-c257-46aa-82b8-81fc2b3fc289 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:55.006513 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 445/903] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 26 01:23:54 2022] GET /identity/v3/services => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:23:55.007083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b64acd-c257-46aa-82b8-81fc2b3fc289 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:55.015766 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2fc46-8d92-4789-9b62-33519db58acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:55.017631 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2fc46-8d92-4789-9b62-33519db58acb None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:55.018164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2fc46-8d92-4789-9b62-33519db58acb None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:55.018656 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2fc46-8d92-4789-9b62-33519db58acb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:55.025480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:55.030800 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2fc46-8d92-4789-9b62-33519db58acb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:55.033385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2fc46-8d92-4789-9b62-33519db58acb None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:55.051945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-30c2fc46-8d92-4789-9b62-33519db58acb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 01:23:55.051945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:55.051945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:55.051945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:55.051945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:55.051945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:55.051945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:55.051945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:55.051945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:55.051945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:55.051945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:55.051945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:55.051945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:23:55.051945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:23:55.051945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:23:55.051945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:23:55.053394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:55.053394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:55.053394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:23:55.053394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:55.053394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:23:55.053394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:23:55.053394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:55.053394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:55.053394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:55.053394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:55.053394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:55.053394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:55.053394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:55.053394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:55.053394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:55.053394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:55.053394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:55.053394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:55.054343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:55.054343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:55.054343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:23:55.054343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:23:55.054343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:23:55.054343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:23:55.054343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:23:55.054343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:23:55.054343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 01:23:55.054343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:55.057632 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 459/904] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 26 01:23:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:55.063368 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2fc46-8d92-4789-9b62-33519db58acb None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:55.138472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b64acd-c257-46aa-82b8-81fc2b3fc289 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:55.193256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d0093-3f52-4dae-95d9-c453a5c85253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:55.193913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d0093-3f52-4dae-95d9-c453a5c85253 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:55.194334 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d0093-3f52-4dae-95d9-c453a5c85253 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:55.194723 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d0093-3f52-4dae-95d9-c453a5c85253 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:55.195657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d0093-3f52-4dae-95d9-c453a5c85253 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:55.196627 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2fc46-8d92-4789-9b62-33519db58acb None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:55.197009 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d0093-3f52-4dae-95d9-c453a5c85253 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:55.215467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 446/905] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 26 01:23:55 2022] POST /identity/v3/services => generated 241 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:23:55.253075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:55.259503 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d8aae-816f-49f2-ac29-ce413f2af742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:55.260564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d8aae-816f-49f2-ac29-ce413f2af742 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:55.261083 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d8aae-816f-49f2-ac29-ce413f2af742 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:55.261587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d8aae-816f-49f2-ac29-ce413f2af742 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:55.262646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d8aae-816f-49f2-ac29-ce413f2af742 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:55.263224 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d8aae-816f-49f2-ac29-ce413f2af742 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:55.264971 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d8aae-816f-49f2-ac29-ce413f2af742 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:55.288183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 460/906] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Sep 26 01:23:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:55.293770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d0093-3f52-4dae-95d9-c453a5c85253 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:55.383311 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:55.415623 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d0093-3f52-4dae-95d9-c453a5c85253 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:55.457199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc9d18-86f5-4bbf-a98b-7bcc1979607a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:55.457809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc9d18-86f5-4bbf-a98b-7bcc1979607a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:55.458087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc9d18-86f5-4bbf-a98b-7bcc1979607a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:55.458359 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc9d18-86f5-4bbf-a98b-7bcc1979607a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:55.536507 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc9d18-86f5-4bbf-a98b-7bcc1979607a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:55.537878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc9d18-86f5-4bbf-a98b-7bcc1979607a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:55.617549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:55.649205 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 447/907] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:23:55 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 01:23:55.650632 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d8aae-816f-49f2-ac29-ce413f2af742 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:55.754124 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d8aae-816f-49f2-ac29-ce413f2af742 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:55.789676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570879b-11b4-47d5-b372-64749a38cddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:55.790219 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570879b-11b4-47d5-b372-64749a38cddb None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:55.790495 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570879b-11b4-47d5-b372-64749a38cddb None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:55.790763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570879b-11b4-47d5-b372-64749a38cddb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:55.801974 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570879b-11b4-47d5-b372-64749a38cddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:55.803436 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570879b-11b4-47d5-b372-64749a38cddb None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:55.818990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-8570879b-11b4-47d5-b372-64749a38cddb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:55.818990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:55.818990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:55.818990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:55.818990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:55.818990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:55.818990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:55.818990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:55.818990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:55.818990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:55.818990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:55.818990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:55.818990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:55.818990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:55.818990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:55.818990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:55.820025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:55.820025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:55.820025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:55.820025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:55.820025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:55.820025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:55.820025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:55.820025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:55.820025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:55.820025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:55.820025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:55.820025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:55.820025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:55.820025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:55.820025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:55.820025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:55.820025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:55.821183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:55.821183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:55.821183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:55.824956 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 461/908] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:55.826284 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc9d18-86f5-4bbf-a98b-7bcc1979607a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:55.927873 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc9d18-86f5-4bbf-a98b-7bcc1979607a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:55.963142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a769d-2340-4411-a9c0-98da20cc2669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:55.963743 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a769d-2340-4411-a9c0-98da20cc2669 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:55.964018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a769d-2340-4411-a9c0-98da20cc2669 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:55.964289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a769d-2340-4411-a9c0-98da20cc2669 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:55.964923 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a769d-2340-4411-a9c0-98da20cc2669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:55.965219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a769d-2340-4411-a9c0-98da20cc2669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:55.966574 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a769d-2340-4411-a9c0-98da20cc2669 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:55.982852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 448/909] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:55.984726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570879b-11b4-47d5-b372-64749a38cddb None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:56.032388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:56.091696 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570879b-11b4-47d5-b372-64749a38cddb None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:56.126420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104cdde-58ef-4baa-bf37-7ceadc8da347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:56.127080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104cdde-58ef-4baa-bf37-7ceadc8da347 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:56.127352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104cdde-58ef-4baa-bf37-7ceadc8da347 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:56.127621 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104cdde-58ef-4baa-bf37-7ceadc8da347 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:56.134474 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104cdde-58ef-4baa-bf37-7ceadc8da347 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:56.135925 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104cdde-58ef-4baa-bf37-7ceadc8da347 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:56.147761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-c104cdde-58ef-4baa-bf37-7ceadc8da347 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:56.147761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:56.147761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:56.147761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:56.147761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:56.147761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:56.147761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:56.147761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:56.147761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:56.147761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:56.147761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:56.147761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:56.147761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:23:56.147761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:23:56.147761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:23:56.149580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:23:56.149580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:56.149580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:56.149580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:56.149580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:56.149580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:56.149580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:56.149580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:56.149580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:56.149580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:56.149580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:56.149580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:56.149580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:56.149580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:56.149580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:56.149580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:56.149580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:56.151158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:23:56.151158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:23:56.151158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:23:56.151158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:23:56.151158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:23:56.151158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:23:56.151158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:23:56.151158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:23:56.151158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 462/910] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:23:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:56.154895 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a769d-2340-4411-a9c0-98da20cc2669 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:56.194785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:56.264384 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a769d-2340-4411-a9c0-98da20cc2669 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:56.304441 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f99727-d0c8-467b-9431-b874fd2e56bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:56.305048 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f99727-d0c8-467b-9431-b874fd2e56bb None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:56.305324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f99727-d0c8-467b-9431-b874fd2e56bb None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:56.307684 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f99727-d0c8-467b-9431-b874fd2e56bb None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:56.307684 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f99727-d0c8-467b-9431-b874fd2e56bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:56.307684 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f99727-d0c8-467b-9431-b874fd2e56bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:56.308165 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f99727-d0c8-467b-9431-b874fd2e56bb None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:56.321620 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 449/911] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:23:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:56.327438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104cdde-58ef-4baa-bf37-7ceadc8da347 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:56.429732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104cdde-58ef-4baa-bf37-7ceadc8da347 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:56.431293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:56.465633 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd092c3d-a55a-48d7-9561-33055f688c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:56.466252 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd092c3d-a55a-48d7-9561-33055f688c80 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:56.466526 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd092c3d-a55a-48d7-9561-33055f688c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:56.466793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd092c3d-a55a-48d7-9561-33055f688c80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:56.467609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd092c3d-a55a-48d7-9561-33055f688c80 None admin] RBAC: Adding query filter params (role.id=1ce2279b741048d1a5abc82efefcdf15, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=6f4696c410f343709be200dee463bd1c) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:56.467917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd092c3d-a55a-48d7-9561-33055f688c80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:56.469898 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd092c3d-a55a-48d7-9561-33055f688c80 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:56.476495 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 463/912] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:23:56 2022] GET /identity/v3/role_assignments?user.id=6f4696c410f343709be200dee463bd1c&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=1ce2279b741048d1a5abc82efefcdf15 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:56.590263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f4f4c-9aad-42e5-9eb7-0316629b21ad None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:56.590987 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f4f4c-9aad-42e5-9eb7-0316629b21ad None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:56.591490 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f4f4c-9aad-42e5-9eb7-0316629b21ad None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:56.593315 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 450/913] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:56.599196 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4939db-6720-4623-9e02-b28643dd4aa3 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:56.599837 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4939db-6720-4623-9e02-b28643dd4aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:56.600318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4939db-6720-4623-9e02-b28643dd4aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:56.619787 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-ef4939db-6720-4623-9e02-b28643dd4aa3 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:56.621376 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-ef4939db-6720-4623-9e02-b28643dd4aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:56.694869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 464/914] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:23:56.962597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f4f4c-9aad-42e5-9eb7-0316629b21ad None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:57.064146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:57.071903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f4f4c-9aad-42e5-9eb7-0316629b21ad None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:57.109674 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e0ae1-4646-4b2f-a4a7-041011a47a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:57.110300 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e0ae1-4646-4b2f-a4a7-041011a47a0a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:57.110572 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e0ae1-4646-4b2f-a4a7-041011a47a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:57.110859 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e0ae1-4646-4b2f-a4a7-041011a47a0a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:57.111482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e0ae1-4646-4b2f-a4a7-041011a47a0a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:57.112890 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e0ae1-4646-4b2f-a4a7-041011a47a0a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:57.121929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-183e0ae1-4646-4b2f-a4a7-041011a47a0a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 01:23:57.121929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:57.121929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:23:57.121929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:23:57.121929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:23:57.121929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:23:57.121929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:23:57.121929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:57.121929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 01:23:57.121929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:57.121929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:23:57.121929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:57.121929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:57.121929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:57.121929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:57.121929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:57.122899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:57.122899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:57.122899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:57.122899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:57.122899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:57.122899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:57.122899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:57.122899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:23:57.122899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:23:57.122899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:23:57.122899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:23:57.122899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:57.122899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:57.122899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:57.122899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:57.122899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:57.122899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:57.123800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:57.123800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:57.123800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:57.123800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:57.123800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:57.123800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:57.123800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:57.123800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:57.123800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:57.123800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:57.123800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:23:57.123800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:57.123800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 01:23:57.123800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:57.123800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 451/915] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Sep 26 01:23:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:57.131579 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4939db-6720-4623-9e02-b28643dd4aa3 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:57.235253 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:57.238592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4939db-6720-4623-9e02-b28643dd4aa3 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:57.278563 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b976f37-e65c-43e2-b79f-fbcddbd071c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:57.279218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b976f37-e65c-43e2-b79f-fbcddbd071c4 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:57.279499 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b976f37-e65c-43e2-b79f-fbcddbd071c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:57.279772 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b976f37-e65c-43e2-b79f-fbcddbd071c4 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:57.280416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b976f37-e65c-43e2-b79f-fbcddbd071c4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:57.280716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b976f37-e65c-43e2-b79f-fbcddbd071c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:57.282498 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b976f37-e65c-43e2-b79f-fbcddbd071c4 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:57.288279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 465/916] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 26 01:23:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:57.293899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e0ae1-4646-4b2f-a4a7-041011a47a0a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:57.382164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a726dc-bd11-4f31-9531-c65efc050da7 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:57.383017 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a726dc-bd11-4f31-9531-c65efc050da7 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:57.383519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a726dc-bd11-4f31-9531-c65efc050da7 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:57.385473 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 466/917] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:57.396849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389a878-4286-4e4e-ab29-0be8246f2b96 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:57.397599 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389a878-4286-4e4e-ab29-0be8246f2b96 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:57.398089 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389a878-4286-4e4e-ab29-0be8246f2b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:57.410312 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e0ae1-4646-4b2f-a4a7-041011a47a0a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:57.421449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-4389a878-4286-4e4e-ab29-0be8246f2b96 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:57.423023 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4389a878-4286-4e4e-ab29-0be8246f2b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:57.444970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068c150-e93d-492c-ac15-626bab2bf983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:57.445864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068c150-e93d-492c-ac15-626bab2bf983 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:57.446144 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068c150-e93d-492c-ac15-626bab2bf983 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:57.446412 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068c150-e93d-492c-ac15-626bab2bf983 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:57.447386 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068c150-e93d-492c-ac15-626bab2bf983 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:57.447386 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068c150-e93d-492c-ac15-626bab2bf983 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:57.448838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068c150-e93d-492c-ac15-626bab2bf983 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:57.455213 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 452/918] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 26 01:23:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:57.461641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068c150-e93d-492c-ac15-626bab2bf983 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:57.495367 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:57.512926 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 467/919] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 01:23:57.574966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068c150-e93d-492c-ac15-626bab2bf983 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:57.580279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db0ad6-ccf3-4164-9309-d5b03908c510 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:57.580569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db0ad6-ccf3-4164-9309-d5b03908c510 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:57.580847 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db0ad6-ccf3-4164-9309-d5b03908c510 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:57.582293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 468/920] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:23:57.587460 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44116547-fb06-482a-b92e-22c325f72251 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:57.587967 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44116547-fb06-482a-b92e-22c325f72251 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:57.588446 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44116547-fb06-482a-b92e-22c325f72251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:57.607373 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-44116547-fb06-482a-b92e-22c325f72251 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:57.609835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-44116547-fb06-482a-b92e-22c325f72251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:57.613780 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087458a-cf0c-4dd2-973c-975482f23472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:57.614651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087458a-cf0c-4dd2-973c-975482f23472 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:57.615182 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087458a-cf0c-4dd2-973c-975482f23472 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:57.615651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087458a-cf0c-4dd2-973c-975482f23472 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:57.616520 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087458a-cf0c-4dd2-973c-975482f23472 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:57.618079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087458a-cf0c-4dd2-973c-975482f23472 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:57.640867 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 453/921] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:23:57 2022] POST /identity/v3/endpoints => generated 347 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:23:57.704355 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 469/922] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 01:23:57.786778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087458a-cf0c-4dd2-973c-975482f23472 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:57.876630 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:57.902687 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087458a-cf0c-4dd2-973c-975482f23472 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:57.939026 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703347f-2d66-44e0-a52d-570678fac709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:57.939660 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703347f-2d66-44e0-a52d-570678fac709 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:57.939990 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703347f-2d66-44e0-a52d-570678fac709 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:57.940311 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703347f-2d66-44e0-a52d-570678fac709 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:57.940895 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703347f-2d66-44e0-a52d-570678fac709 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:57.942251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703347f-2d66-44e0-a52d-570678fac709 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:57.951442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-3703347f-2d66-44e0-a52d-570678fac709 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 01:23:57.951442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:57.951442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:23:57.951442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:23:57.951442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:23:57.951442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:23:57.951442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:23:57.951442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:57.951442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 01:23:57.951442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:57.951442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:23:57.951442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:57.951442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:57.951442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:57.951442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:57.951442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:57.951442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:57.952463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:57.952463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:57.952463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:57.952463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:57.952463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:57.952463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:57.952463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:23:57.952463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:23:57.952463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:23:57.952463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:23:57.952463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:57.952463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:57.952463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:57.952463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:57.952463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:57.952463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:57.953508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:57.953508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:57.953508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:57.953508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:57.953508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:57.953508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:57.953508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:57.953508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:57.953508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:57.953508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:57.953508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:23:57.953508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:57.953508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 01:23:57.953508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:57.953508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 454/923] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:23:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:57.960779 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44116547-fb06-482a-b92e-22c325f72251 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:57.979122 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:57.991222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703347f-2d66-44e0-a52d-570678fac709 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:58.078720 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44116547-fb06-482a-b92e-22c325f72251 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:58.118848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703347f-2d66-44e0-a52d-570678fac709 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:58.119638 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc91da9-e844-4fc5-90d6-5e9067274e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:58.120272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc91da9-e844-4fc5-90d6-5e9067274e83 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:58.120622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc91da9-e844-4fc5-90d6-5e9067274e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:58.120894 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc91da9-e844-4fc5-90d6-5e9067274e83 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:58.121632 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc91da9-e844-4fc5-90d6-5e9067274e83 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:58.121940 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc91da9-e844-4fc5-90d6-5e9067274e83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:58.123325 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc91da9-e844-4fc5-90d6-5e9067274e83 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:58.128764 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 470/924] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:23:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:58.135189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc91da9-e844-4fc5-90d6-5e9067274e83 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:58.157017 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d494e-69b0-4dae-8469-59bde4376c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:58.158030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d494e-69b0-4dae-8469-59bde4376c8c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:58.158509 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d494e-69b0-4dae-8469-59bde4376c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:58.159058 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d494e-69b0-4dae-8469-59bde4376c8c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:58.159849 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d494e-69b0-4dae-8469-59bde4376c8c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:58.161418 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d494e-69b0-4dae-8469-59bde4376c8c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:58.172289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-2c5d494e-69b0-4dae-8469-59bde4376c8c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 01:23:58.172289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:58.172289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:23:58.172289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:23:58.172289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:23:58.172289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:23:58.172289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:23:58.172289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:58.172289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 01:23:58.172289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:58.172289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:23:58.172289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:58.172289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:58.172289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:58.172289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:58.172289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:58.172289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:58.173324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:58.173324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:58.173324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:58.173324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:58.173324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:58.173324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:58.173324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:23:58.173324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:23:58.173324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:23:58.173324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:23:58.173324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:58.173324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:58.173324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:58.173324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:58.173324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:58.173324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:58.174193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:58.174193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:58.174193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:58.174193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:58.174193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:58.174193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:58.174193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:58.174193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:58.174193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:58.174193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:58.174193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:23:58.174193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:23:58.174193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 01:23:58.174193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:58.174193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 455/925] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 26 01:23:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:23:58.187843 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d494e-69b0-4dae-8469-59bde4376c8c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:58.198372 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:58.243301 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:58.268280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc91da9-e844-4fc5-90d6-5e9067274e83 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:58.299948 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d494e-69b0-4dae-8469-59bde4376c8c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:58.308882 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8d6e6-3107-4258-b153-75efcabadbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:58.309672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8d6e6-3107-4258-b153-75efcabadbc1 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:58.310136 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8d6e6-3107-4258-b153-75efcabadbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:58.311001 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8d6e6-3107-4258-b153-75efcabadbc1 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:58.311782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8d6e6-3107-4258-b153-75efcabadbc1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:58.313255 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8d6e6-3107-4258-b153-75efcabadbc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:58.315084 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8d6e6-3107-4258-b153-75efcabadbc1 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:58.321728 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 471/926] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 26 01:23:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:58.327217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8d6e6-3107-4258-b153-75efcabadbc1 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:58.342849 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98a8c8-b3e5-4050-96f5-b861dd8ddd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:58.343573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98a8c8-b3e5-4050-96f5-b861dd8ddd25 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:58.344056 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98a8c8-b3e5-4050-96f5-b861dd8ddd25 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:58.344397 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98a8c8-b3e5-4050-96f5-b861dd8ddd25 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:58.345128 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98a8c8-b3e5-4050-96f5-b861dd8ddd25 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:58.345462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98a8c8-b3e5-4050-96f5-b861dd8ddd25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:58.347099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98a8c8-b3e5-4050-96f5-b861dd8ddd25 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:58.353616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 456/927] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 26 01:23:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:58.360484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98a8c8-b3e5-4050-96f5-b861dd8ddd25 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:58.437019 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:58.459093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8d6e6-3107-4258-b153-75efcabadbc1 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:58.471904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98a8c8-b3e5-4050-96f5-b861dd8ddd25 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:58.497058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf1faf-e309-4008-9ecd-c5a880cfc73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:58.497664 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf1faf-e309-4008-9ecd-c5a880cfc73f None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:58.497940 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf1faf-e309-4008-9ecd-c5a880cfc73f None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:58.498211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf1faf-e309-4008-9ecd-c5a880cfc73f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:58.498913 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf1faf-e309-4008-9ecd-c5a880cfc73f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:58.500805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf1faf-e309-4008-9ecd-c5a880cfc73f None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:58.509032 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd459f0-3ea3-4fc6-b8be-6aab777d13bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:58.509903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd459f0-3ea3-4fc6-b8be-6aab777d13bf None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:58.510383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd459f0-3ea3-4fc6-b8be-6aab777d13bf None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:58.510889 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd459f0-3ea3-4fc6-b8be-6aab777d13bf None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:58.512022 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd459f0-3ea3-4fc6-b8be-6aab777d13bf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:58.512623 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd459f0-3ea3-4fc6-b8be-6aab777d13bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:58.514327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd459f0-3ea3-4fc6-b8be-6aab777d13bf None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:58.520809 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:58.521684 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 457/928] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 26 01:23:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:58.527108 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd459f0-3ea3-4fc6-b8be-6aab777d13bf None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:58.531552 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 472/929] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:23:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:23:58.659888 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd459f0-3ea3-4fc6-b8be-6aab777d13bf None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:58.699865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:58.706529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bbd77-663b-4041-96d8-8d3fdd9a902a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:58.707184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bbd77-663b-4041-96d8-8d3fdd9a902a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:58.707465 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bbd77-663b-4041-96d8-8d3fdd9a902a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:58.707801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bbd77-663b-4041-96d8-8d3fdd9a902a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:58.708498 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bbd77-663b-4041-96d8-8d3fdd9a902a None admin] RBAC: Adding query filter params (interface=public, service_id=22361f6334d342c39e87c74c0f53f0f1, region_id=RegionOne) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:58.708852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bbd77-663b-4041-96d8-8d3fdd9a902a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:58.710231 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bbd77-663b-4041-96d8-8d3fdd9a902a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:58.716366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 458/930] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 26 01:23:58 2022] GET /identity/v3/endpoints?service_id=22361f6334d342c39e87c74c0f53f0f1&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:23:58.723557 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf1faf-e309-4008-9ecd-c5a880cfc73f None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:58.733678 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19fb40-f7db-4593-84ad-25ad2148bf7e None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:58.733958 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19fb40-f7db-4593-84ad-25ad2148bf7e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:58.734269 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19fb40-f7db-4593-84ad-25ad2148bf7e None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:58.736906 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 459/931] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:23:58.741319 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf177bb-fcf0-4109-b006-15d7d0afd677 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:58.741615 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf177bb-fcf0-4109-b006-15d7d0afd677 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:58.741924 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf177bb-fcf0-4109-b006-15d7d0afd677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:58.767267 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-bcf177bb-fcf0-4109-b006-15d7d0afd677 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:23:58.768464 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-bcf177bb-fcf0-4109-b006-15d7d0afd677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:23:58.847859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf1faf-e309-4008-9ecd-c5a880cfc73f None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:58.863060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 460/932] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:23:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 01:23:58.898740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788648bc-fc11-4370-90ec-d2d1497b88d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:58.899392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788648bc-fc11-4370-90ec-d2d1497b88d2 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:58.899745 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788648bc-fc11-4370-90ec-d2d1497b88d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:58.900253 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788648bc-fc11-4370-90ec-d2d1497b88d2 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:58.900911 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788648bc-fc11-4370-90ec-d2d1497b88d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:58.902334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788648bc-fc11-4370-90ec-d2d1497b88d2 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:58.909661 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 473/933] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 26 01:23:58 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:23:59.182261 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf177bb-fcf0-4109-b006-15d7d0afd677 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:59.290096 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf177bb-fcf0-4109-b006-15d7d0afd677 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:59.316982 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:59.329344 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a701d0e-b716-4048-a132-0cd2bb012b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:59.330198 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a701d0e-b716-4048-a132-0cd2bb012b06 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:59.330596 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a701d0e-b716-4048-a132-0cd2bb012b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:59.330897 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a701d0e-b716-4048-a132-0cd2bb012b06 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:59.341957 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a701d0e-b716-4048-a132-0cd2bb012b06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:23:59.347556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-5a701d0e-b716-4048-a132-0cd2bb012b06 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 01:23:59.347556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:59.347556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:59.347556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:59.347556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:59.347556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:59.347556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:59.347556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:59.347556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:59.347556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:59.347556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:59.347556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:59.347556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:23:59.347556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:23:59.347556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:23:59.347556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:23:59.349469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:23:59.349469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:23:59.349469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:23:59.349469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:23:59.349469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:59.349469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:59.349469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:59.349469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:59.349469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:59.349469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:59.349469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:59.349469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:59.349469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:59.349469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:59.349469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:59.349469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:59.351548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:59.351548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:59.351548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:59.351548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:59.351548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:23:59.351548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:23:59.351548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:23:59.351548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:23:59.351548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:23:59.351548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:23:59.351548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 01:23:59.351548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:59.354857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 461/934] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Sep 26 01:23:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:59.358878 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788648bc-fc11-4370-90ec-d2d1497b88d2 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:59.435951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:59.490144 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788648bc-fc11-4370-90ec-d2d1497b88d2 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:59.528836 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176136c6-8574-4e7f-97e5-893a4186bf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:59.529456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176136c6-8574-4e7f-97e5-893a4186bf94 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:59.529739 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176136c6-8574-4e7f-97e5-893a4186bf94 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:59.530014 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176136c6-8574-4e7f-97e5-893a4186bf94 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:59.530688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176136c6-8574-4e7f-97e5-893a4186bf94 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:59.531537 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176136c6-8574-4e7f-97e5-893a4186bf94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:59.533311 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176136c6-8574-4e7f-97e5-893a4186bf94 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:59.542709 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 474/935] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 26 01:23:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:59.549558 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a701d0e-b716-4048-a132-0cd2bb012b06 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:59.665167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a701d0e-b716-4048-a132-0cd2bb012b06 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:59.704207 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8663d9-f217-487d-87c7-f781fe372638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:59.704734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8663d9-f217-487d-87c7-f781fe372638 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:59.705011 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8663d9-f217-487d-87c7-f781fe372638 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:59.705280 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8663d9-f217-487d-87c7-f781fe372638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:59.716514 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8663d9-f217-487d-87c7-f781fe372638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:59.717969 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8663d9-f217-487d-87c7-f781fe372638 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:59.735417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-6b8663d9-f217-487d-87c7-f781fe372638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:59.735417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:23:59.735417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:23:59.735417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:23:59.735417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:23:59.735417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:23:59.735417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:23:59.735417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:23:59.735417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:23:59.735417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:23:59.735417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:23:59.735417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:23:59.735417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:23:59.735417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:23:59.735417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:23:59.735417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:23:59.736701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:23:59.736701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:23:59.736701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:23:59.736701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:23:59.736701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:23:59.736701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:23:59.736701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:23:59.736701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:23:59.736701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:23:59.736701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:23:59.736701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:23:59.736701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:23:59.736701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:23:59.736701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:23:59.736701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:23:59.736701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:23:59.736701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:23:59.737938 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:23:59.737938 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:23:59.737938 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:23:59.737938 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 462/936] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:23:59.744235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176136c6-8574-4e7f-97e5-893a4186bf94 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:59.854736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176136c6-8574-4e7f-97e5-893a4186bf94 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:23:59.887141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:23:59.897279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96138164-756f-4fb7-b314-d9353e741cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:23:59.897886 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96138164-756f-4fb7-b314-d9353e741cbb None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:23:59.898164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96138164-756f-4fb7-b314-d9353e741cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:23:59.898440 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96138164-756f-4fb7-b314-d9353e741cbb None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:23:59.899109 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96138164-756f-4fb7-b314-d9353e741cbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:23:59.899407 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96138164-756f-4fb7-b314-d9353e741cbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:23:59.900744 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96138164-756f-4fb7-b314-d9353e741cbb None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:23:59.915197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 475/937] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:23:59.921377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8663d9-f217-487d-87c7-f781fe372638 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:23:59.963777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:00.030537 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8663d9-f217-487d-87c7-f781fe372638 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:00.048023 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99b1ed-3bc7-4f4f-962b-5b70c07a97b8 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:00.048368 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99b1ed-3bc7-4f4f-962b-5b70c07a97b8 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:00.048541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99b1ed-3bc7-4f4f-962b-5b70c07a97b8 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:00.050130 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 476/938] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:24:00.055111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf5de0-6329-414c-8344-351a4960d4ab None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:00.055391 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf5de0-6329-414c-8344-351a4960d4ab None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:00.055665 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf5de0-6329-414c-8344-351a4960d4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:00.069980 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd62810-0766-4aa7-a604-9f2ec1dc84c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:00.070878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd62810-0766-4aa7-a604-9f2ec1dc84c9 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:00.071159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd62810-0766-4aa7-a604-9f2ec1dc84c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:00.071424 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd62810-0766-4aa7-a604-9f2ec1dc84c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:00.074790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-bbdf5de0-6329-414c-8344-351a4960d4ab None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:00.076053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-bbdf5de0-6329-414c-8344-351a4960d4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:00.080292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd62810-0766-4aa7-a604-9f2ec1dc84c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:00.081739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd62810-0766-4aa7-a604-9f2ec1dc84c9 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:00.094778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-cfd62810-0766-4aa7-a604-9f2ec1dc84c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 01:24:00.094778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:00.094778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:00.094778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:00.094778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:00.094778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:00.094778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:00.094778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:00.094778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:00.094778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:00.094778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:00.094778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:00.094778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:24:00.094778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:24:00.094778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:24:00.094778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:24:00.095754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:00.095754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:00.095754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:24:00.095754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:24:00.095754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:24:00.095754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:24:00.095754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:00.095754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:00.095754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:00.095754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:00.095754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:00.095754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:00.095754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:00.095754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:00.095754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:00.095754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:00.095754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:00.095754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:00.096947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:00.096947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:00.096947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:24:00.096947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:24:00.096947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:24:00.096947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:24:00.096947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:24:00.096947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:24:00.096947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 01:24:00.096947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:00.096947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 463/939] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 26 01:23:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:00.103285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd62810-0766-4aa7-a604-9f2ec1dc84c9 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:00.158911 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 477/940] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 01:24:00.219599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:00.226932 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd62810-0766-4aa7-a604-9f2ec1dc84c9 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:00.262675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899c4df-61cb-4f47-a9ac-95cf4f25a4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:00.263583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899c4df-61cb-4f47-a9ac-95cf4f25a4ff None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:00.264037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899c4df-61cb-4f47-a9ac-95cf4f25a4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:00.264459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899c4df-61cb-4f47-a9ac-95cf4f25a4ff None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:00.265406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899c4df-61cb-4f47-a9ac-95cf4f25a4ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:00.265862 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899c4df-61cb-4f47-a9ac-95cf4f25a4ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:00.267458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899c4df-61cb-4f47-a9ac-95cf4f25a4ff None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:00.290584 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 464/941] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Sep 26 01:24:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:00.296350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf5de0-6329-414c-8344-351a4960d4ab None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:00.399335 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf5de0-6329-414c-8344-351a4960d4ab None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:00.417451 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:00.436198 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754ebc6-3686-43d9-ac4f-99c1dfc3fb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:00.436832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754ebc6-3686-43d9-ac4f-99c1dfc3fb45 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:00.437151 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754ebc6-3686-43d9-ac4f-99c1dfc3fb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:00.437430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754ebc6-3686-43d9-ac4f-99c1dfc3fb45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:00.448185 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754ebc6-3686-43d9-ac4f-99c1dfc3fb45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:00.449616 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754ebc6-3686-43d9-ac4f-99c1dfc3fb45 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:00.456953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899c4df-61cb-4f47-a9ac-95cf4f25a4ff None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:00.465659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-4754ebc6-3686-43d9-ac4f-99c1dfc3fb45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:00.465659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:00.465659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:00.465659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:00.465659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:00.465659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:00.465659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:00.465659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:00.465659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:00.465659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:00.465659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:00.465659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:00.465659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:24:00.465659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:24:00.465659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:24:00.465659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:24:00.466598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:00.466598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:00.466598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:00.466598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:00.466598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:00.466598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:00.466598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:00.466598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:00.466598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:00.466598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:00.466598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:00.466598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:00.466598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:00.466598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:00.466598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:00.466598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:00.466598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:24:00.467518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:24:00.467518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:00.467518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:00.471049 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 478/942] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:00.473355 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754ebc6-3686-43d9-ac4f-99c1dfc3fb45 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:00.566524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899c4df-61cb-4f47-a9ac-95cf4f25a4ff None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:00.580970 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754ebc6-3686-43d9-ac4f-99c1dfc3fb45 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:00.604297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71460fc0-ab4d-429b-b200-5df0b546bde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:00.605325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71460fc0-ab4d-429b-b200-5df0b546bde9 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:00.605845 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71460fc0-ab4d-429b-b200-5df0b546bde9 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:00.606316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71460fc0-ab4d-429b-b200-5df0b546bde9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:00.607137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71460fc0-ab4d-429b-b200-5df0b546bde9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:00.608691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71460fc0-ab4d-429b-b200-5df0b546bde9 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:00.617158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a546d-04c4-4679-ae87-8a46bfe0ddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:00.617762 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a546d-04c4-4679-ae87-8a46bfe0ddfe None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:00.618044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a546d-04c4-4679-ae87-8a46bfe0ddfe None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:00.618324 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a546d-04c4-4679-ae87-8a46bfe0ddfe None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:00.619002 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a546d-04c4-4679-ae87-8a46bfe0ddfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:00.619311 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a546d-04c4-4679-ae87-8a46bfe0ddfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:00.619774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-71460fc0-ab4d-429b-b200-5df0b546bde9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 01:24:00.619774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:00.619774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:24:00.619774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:24:00.619774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:24:00.619774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:24:00.619774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:24:00.619774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:24:00.619774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 01:24:00.619774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:00.619774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:24:00.619774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:00.619774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:00.619774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:00.619774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:00.619774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:00.619774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:00.620706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:00.620706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:00.620706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:00.620706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:00.620706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:00.620706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:00.620706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:24:00.620706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:24:00.620706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:24:00.620706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:24:00.620706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:00.620706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:00.620706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:00.620706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:00.620706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:00.620706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:00.621542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:00.621542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:00.621542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:00.621542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:00.621542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:00.621542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:00.621542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:00.621542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:00.621542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:00.621542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:00.621542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:24:00.621542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:24:00.621542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 01:24:00.621542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:00.622296 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a546d-04c4-4679-ae87-8a46bfe0ddfe None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:00.629074 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 465/943] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:24:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:24:00.630225 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71460fc0-ab4d-429b-b200-5df0b546bde9 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:00.638238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 479/944] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:24:00.639581 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a546d-04c4-4679-ae87-8a46bfe0ddfe None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:00.652249 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:00.673584 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:00.744103 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71460fc0-ab4d-429b-b200-5df0b546bde9 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:00.751553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a546d-04c4-4679-ae87-8a46bfe0ddfe None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:00.782220 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109e186-5df4-4344-be29-7d88eed38d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:00.783214 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109e186-5df4-4344-be29-7d88eed38d9d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:00.783821 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109e186-5df4-4344-be29-7d88eed38d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:00.784327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109e186-5df4-4344-be29-7d88eed38d9d None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:00.785204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109e186-5df4-4344-be29-7d88eed38d9d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:00.785706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109e186-5df4-4344-be29-7d88eed38d9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:00.787306 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109e186-5df4-4344-be29-7d88eed38d9d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:00.789628 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecae1a2-1d2a-4c1c-a211-c2ee05bb9051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:00.790271 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecae1a2-1d2a-4c1c-a211-c2ee05bb9051 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:00.790553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecae1a2-1d2a-4c1c-a211-c2ee05bb9051 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:00.790841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecae1a2-1d2a-4c1c-a211-c2ee05bb9051 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:00.798404 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 466/945] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 26 01:24:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:00.798562 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecae1a2-1d2a-4c1c-a211-c2ee05bb9051 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:00.799753 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109e186-5df4-4344-be29-7d88eed38d9d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:00.801353 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecae1a2-1d2a-4c1c-a211-c2ee05bb9051 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:00.815105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-aecae1a2-1d2a-4c1c-a211-c2ee05bb9051 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:24:00.815105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:00.815105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:00.815105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:00.815105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:00.815105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:00.815105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:00.815105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:00.815105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:00.815105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:00.815105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:00.815105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:00.815105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:24:00.815105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:24:00.815105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:24:00.816047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:24:00.816047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:00.816047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:00.816047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:00.816047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:00.816047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:00.816047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:00.816047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:00.816047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:00.816047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:00.816047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:00.816047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:00.816047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:00.816047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:00.816047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:00.816047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:00.816047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:00.816932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:24:00.816932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:24:00.816932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:24:00.816932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:24:00.816932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:24:00.816932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:24:00.816932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:24:00.816932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:00.821155 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 480/946] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:24:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:00.822591 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecae1a2-1d2a-4c1c-a211-c2ee05bb9051 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:00.893869 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:00.913386 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109e186-5df4-4344-be29-7d88eed38d9d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:00.925448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:00.939950 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecae1a2-1d2a-4c1c-a211-c2ee05bb9051 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:00.956353 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22a76f-0d79-481a-b367-cb91f80b41ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:00.957312 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22a76f-0d79-481a-b367-cb91f80b41ed None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:00.957750 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22a76f-0d79-481a-b367-cb91f80b41ed None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:00.958182 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22a76f-0d79-481a-b367-cb91f80b41ed None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:00.959002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22a76f-0d79-481a-b367-cb91f80b41ed None admin] RBAC: Adding query filter params (type=compute) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:00.959446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22a76f-0d79-481a-b367-cb91f80b41ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:00.961121 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22a76f-0d79-481a-b367-cb91f80b41ed None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:00.976646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 467/947] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 26 01:24:00 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:00.981585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396adb0-46bb-412b-8def-87ebbcff030b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:00.982416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396adb0-46bb-412b-8def-87ebbcff030b None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:00.982816 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396adb0-46bb-412b-8def-87ebbcff030b None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:00.983265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396adb0-46bb-412b-8def-87ebbcff030b None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:00.984645 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396adb0-46bb-412b-8def-87ebbcff030b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:00.985059 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396adb0-46bb-412b-8def-87ebbcff030b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:00.987032 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396adb0-46bb-412b-8def-87ebbcff030b None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:01.007100 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 481/948] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:24:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:01.008501 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22a76f-0d79-481a-b367-cb91f80b41ed None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:01.048936 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b94583-8ce1-4194-8733-4dbc319c2137 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:01.049570 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b94583-8ce1-4194-8733-4dbc319c2137 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:01.050029 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b94583-8ce1-4194-8733-4dbc319c2137 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:01.051992 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 482/949] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:01.057181 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae482214-a3a4-4b8f-9c77-34e609006a96 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:01.057742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae482214-a3a4-4b8f-9c77-34e609006a96 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:01.058224 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae482214-a3a4-4b8f-9c77-34e609006a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:01.079625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-ae482214-a3a4-4b8f-9c77-34e609006a96 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:01.081184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-ae482214-a3a4-4b8f-9c77-34e609006a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:01.129224 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22a76f-0d79-481a-b367-cb91f80b41ed None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:01.162239 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 483/950] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 01:24:01.174676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73da131-3d3c-49be-a09a-6cda41594cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:01.175885 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73da131-3d3c-49be-a09a-6cda41594cf3 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:01.176453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73da131-3d3c-49be-a09a-6cda41594cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:01.176987 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73da131-3d3c-49be-a09a-6cda41594cf3 None admin] PATH_INFO: `/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/6f4696c410f343709be200dee463bd1c/roles/1ce2279b741048d1a5abc82efefcdf15` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:01.179952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73da131-3d3c-49be-a09a-6cda41594cf3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fda1727cc3d47b9a1fae73c74f32c27, user_id=6f4696c410f343709be200dee463bd1c, role_id=1ce2279b741048d1a5abc82efefcdf15)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:01.181828 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73da131-3d3c-49be-a09a-6cda41594cf3 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:01.203307 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 468/951] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:24:01 2022] PUT /identity/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/6f4696c410f343709be200dee463bd1c/roles/1ce2279b741048d1a5abc82efefcdf15 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:24:01.291758 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed94340-5592-4f88-a973-2dd09919d6ff None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:01.292053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed94340-5592-4f88-a973-2dd09919d6ff None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:01.292238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed94340-5592-4f88-a973-2dd09919d6ff None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:01.293993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 484/952] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:01.301572 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744174c-ecee-40f7-ae36-222ff4d9b732 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:01.301916 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744174c-ecee-40f7-ae36-222ff4d9b732 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:01.302132 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744174c-ecee-40f7-ae36-222ff4d9b732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:01.316257 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:01.323710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2744174c-ecee-40f7-ae36-222ff4d9b732 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:01.325415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2744174c-ecee-40f7-ae36-222ff4d9b732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:01.406943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 469/953] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:01.444793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed94340-5592-4f88-a973-2dd09919d6ff None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:01.525998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:01.551708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed94340-5592-4f88-a973-2dd09919d6ff None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:01.592496 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6bc1a-1b6d-4f64-85f5-b1b4db805ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:01.593103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6bc1a-1b6d-4f64-85f5-b1b4db805ef3 None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:01.593987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6bc1a-1b6d-4f64-85f5-b1b4db805ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:01.594413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6bc1a-1b6d-4f64-85f5-b1b4db805ef3 None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:01.595216 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6bc1a-1b6d-4f64-85f5-b1b4db805ef3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:01.596802 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6bc1a-1b6d-4f64-85f5-b1b4db805ef3 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:01.599499 dv-cinder-859203-2-smb devstack@keystone.service[81422]: WARNING keystone.server.flask.common [None req-ade6bc1a-1b6d-4f64-85f5-b1b4db805ef3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 26 01:24:01.624715 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.sql.core [None req-ade6bc1a-1b6d-4f64-85f5-b1b4db805ef3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 26 01:24:01.624715 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 26 01:24:01.624715 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [parameters: {'id': 'a2d0c2cc9d3a4bea8f15ad655b3b9a33', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 26 01:24:01.624715 dv-cinder-859203-2-smb devstack@keystone.service[81422]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81422) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 26 01:24:01.632492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-ade6bc1a-1b6d-4f64-85f5-b1b4db805ef3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a2d0c2cc9d3a4bea8f15ad655b3b9a33.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a2d0c2cc9d3a4bea8f15ad655b3b9a33. Sep 26 01:24:01.632492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:01.632492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 01:24:01.632492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 01:24:01.632492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 01:24:01.632492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 01:24:01.632492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 01:24:01.632492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 01:24:01.632492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 01:24:01.632492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application conn.query(q) Sep 26 01:24:01.632492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 01:24:01.632492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 01:24:01.632492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 01:24:01.633268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application result.read() Sep 26 01:24:01.633268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 01:24:01.633268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 01:24:01.633268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 01:24:01.633268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 01:24:01.633268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 01:24:01.633268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 01:24:01.633268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 01:24:01.633268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 01:24:01.633268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 26 01:24:01.633268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:01.633268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 26 01:24:01.633268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:01.633268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:01.633268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 26 01:24:01.633268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 26 01:24:01.633268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 26 01:24:01.633268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 26 01:24:01.634217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 01:24:01.634217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application next(self.gen) Sep 26 01:24:01.634217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 26 01:24:01.634217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application yield resource Sep 26 01:24:01.634217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 01:24:01.634217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application next(self.gen) Sep 26 01:24:01.634217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 26 01:24:01.634217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self.session.rollback() Sep 26 01:24:01.634217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 26 01:24:01.634217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self.force_reraise() Sep 26 01:24:01.634217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 26 01:24:01.634217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise self.value Sep 26 01:24:01.634217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 26 01:24:01.634217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 26 01:24:01.634217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 26 01:24:01.634217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application session.commit() Sep 26 01:24:01.634217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 26 01:24:01.635126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 26 01:24:01.635126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 26 01:24:01.635126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._prepare_impl() Sep 26 01:24:01.635126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 26 01:24:01.635126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self.session.flush() Sep 26 01:24:01.635126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 26 01:24:01.635126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._flush(objects) Sep 26 01:24:01.635126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 26 01:24:01.635126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 26 01:24:01.635126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 26 01:24:01.635126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application compat.raise_( Sep 26 01:24:01.635126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 01:24:01.635126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception Sep 26 01:24:01.635126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 26 01:24:01.635126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application flush_context.execute() Sep 26 01:24:01.635126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 26 01:24:01.635126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rec.execute(self) Sep 26 01:24:01.636013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 26 01:24:01.636013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 26 01:24:01.636013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 26 01:24:01.636013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 26 01:24:01.636013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 26 01:24:01.636013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 26 01:24:01.636013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 26 01:24:01.636013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 26 01:24:01.636013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 26 01:24:01.636013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 26 01:24:01.636013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 26 01:24:01.636013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 26 01:24:01.636013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 26 01:24:01.636013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 26 01:24:01.636013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 26 01:24:01.636786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 26 01:24:01.636786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 01:24:01.636786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception Sep 26 01:24:01.636786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 01:24:01.636786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 01:24:01.636786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 01:24:01.636786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 01:24:01.636786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 01:24:01.636786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 01:24:01.636786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 01:24:01.636786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application conn.query(q) Sep 26 01:24:01.636786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 01:24:01.636786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 01:24:01.636786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 01:24:01.636786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application result.read() Sep 26 01:24:01.636786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 01:24:01.636786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 01:24:01.637641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 01:24:01.637641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 01:24:01.637641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 01:24:01.637641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 01:24:01.637641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 01:24:01.637641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 01:24:01.637641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 26 01:24:01.637641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 26 01:24:01.637641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [parameters: {'id': 'a2d0c2cc9d3a4bea8f15ad655b3b9a33', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 26 01:24:01.637641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 26 01:24:01.637641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:01.637641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:24:01.637641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:01.637641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:01.637641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 26 01:24:01.639919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 26 01:24:01.639919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 26 01:24:01.639919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 26 01:24:01.639919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 26 01:24:01.639919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:01.639919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:24:01.639919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:01.639919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:01.639919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:01.639919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:01.639919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:01.639919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:01.639919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:01.639919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:01.639919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:01.639919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:01.639919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:01.642113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:01.642113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 26 01:24:01.642113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 26 01:24:01.642113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:01.642113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:01.642113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 26 01:24:01.642113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 26 01:24:01.642113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a2d0c2cc9d3a4bea8f15ad655b3b9a33. Sep 26 01:24:01.642113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:01.642113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 485/954] 10.222.0.26 () {60 vars in 1140 bytes} [Mon Sep 26 01:24:01 2022] POST /identity/v3/projects => generated 262 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:01.642984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744174c-ecee-40f7-ae36-222ff4d9b732 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:01.721620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6bc1a-1b6d-4f64-85f5-b1b4db805ef3 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:01.749235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744174c-ecee-40f7-ae36-222ff4d9b732 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:01.796170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114fede-48e2-448b-b4a9-33ee088f461f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:01.797187 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114fede-48e2-448b-b4a9-33ee088f461f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:01.798536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114fede-48e2-448b-b4a9-33ee088f461f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:01.798940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114fede-48e2-448b-b4a9-33ee088f461f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:01.802055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:01.808750 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114fede-48e2-448b-b4a9-33ee088f461f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:01.810623 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114fede-48e2-448b-b4a9-33ee088f461f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:01.828425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-2114fede-48e2-448b-b4a9-33ee088f461f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:24:01.828425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:01.828425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:01.828425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:01.828425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:01.828425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:01.828425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:01.828425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:01.828425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:01.828425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:01.828425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:01.828425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:01.828425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:24:01.828425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:24:01.828425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:24:01.829717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:24:01.829717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:01.829717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:01.829717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:01.829717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:01.829717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:01.829717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:01.829717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:01.829717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:01.829717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:01.829717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:01.829717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:01.829717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:01.829717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:01.829717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:01.829717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:01.829717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:01.830665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:24:01.830665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:24:01.830665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:24:01.830665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:24:01.830665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:24:01.830665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:24:01.830665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:24:01.830665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:01.834850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6bc1a-1b6d-4f64-85f5-b1b4db805ef3 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:01.835091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 470/955] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:24:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:01.836592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114fede-48e2-448b-b4a9-33ee088f461f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:01.870785 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802f56c-6a93-4623-a61c-ab7058b48ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:01.871455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802f56c-6a93-4623-a61c-ab7058b48ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:01.872051 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802f56c-6a93-4623-a61c-ab7058b48ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:01.872163 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802f56c-6a93-4623-a61c-ab7058b48ab0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:01.872709 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802f56c-6a93-4623-a61c-ab7058b48ab0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:01.874279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802f56c-6a93-4623-a61c-ab7058b48ab0 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:01.877143 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:01.886179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-8802f56c-6a93-4623-a61c-ab7058b48ab0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 01:24:01.886179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:01.886179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:24:01.886179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:24:01.886179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:24:01.886179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:24:01.886179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:24:01.886179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:24:01.886179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 01:24:01.886179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:01.886179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:24:01.886179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:01.886179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:01.886179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:01.886179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:01.886179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:01.886179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:01.887326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:01.887326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:01.887326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:01.887326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:01.887326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:01.887326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:01.887326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:24:01.887326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:24:01.887326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:24:01.887326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:24:01.887326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:01.887326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:01.887326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:01.887326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:01.887326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:01.887326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:01.888187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:01.888187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:01.888187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:01.888187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:01.888187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:01.888187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:01.888187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:01.888187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:01.888187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:01.888187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:01.888187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:24:01.888187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:24:01.888187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 01:24:01.888187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:01.888187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 486/956] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 26 01:24:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:01.893790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802f56c-6a93-4623-a61c-ab7058b48ab0 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:01.986303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114fede-48e2-448b-b4a9-33ee088f461f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:02.010091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802f56c-6a93-4623-a61c-ab7058b48ab0 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:02.023944 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed9a3d-d765-4d68-b775-04581eb89980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:02.024385 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9a3d-d765-4d68-b775-04581eb89980 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:02.024765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9a3d-d765-4d68-b775-04581eb89980 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:02.025134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9a3d-d765-4d68-b775-04581eb89980 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:02.026044 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed9a3d-d765-4d68-b775-04581eb89980 None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:02.026296 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed9a3d-d765-4d68-b775-04581eb89980 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:02.027849 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed9a3d-d765-4d68-b775-04581eb89980 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:02.050857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 471/957] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 26 01:24:01 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:02.057544 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a3d60-64ba-4aad-b1f8-62485ba6486f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:02.058129 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a3d60-64ba-4aad-b1f8-62485ba6486f None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:02.058409 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a3d60-64ba-4aad-b1f8-62485ba6486f None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:02.058678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a3d60-64ba-4aad-b1f8-62485ba6486f None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:02.059388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a3d60-64ba-4aad-b1f8-62485ba6486f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:02.059689 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a3d60-64ba-4aad-b1f8-62485ba6486f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:02.061147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a3d60-64ba-4aad-b1f8-62485ba6486f None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:02.071122 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 487/958] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 26 01:24:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:24:02.076774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed9a3d-d765-4d68-b775-04581eb89980 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:02.142681 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:02.194734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed9a3d-d765-4d68-b775-04581eb89980 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:02.235650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8370c-54d0-4f42-9d0b-66a1d6f2ae6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:02.236695 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8370c-54d0-4f42-9d0b-66a1d6f2ae6c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:02.237175 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8370c-54d0-4f42-9d0b-66a1d6f2ae6c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:02.237651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8370c-54d0-4f42-9d0b-66a1d6f2ae6c None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:02.238519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae8370c-54d0-4f42-9d0b-66a1d6f2ae6c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:02.239045 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae8370c-54d0-4f42-9d0b-66a1d6f2ae6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:02.240661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae8370c-54d0-4f42-9d0b-66a1d6f2ae6c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:02.246880 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 472/959] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 26 01:24:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:02.253068 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a3d60-64ba-4aad-b1f8-62485ba6486f None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:02.323309 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:02.366097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a3d60-64ba-4aad-b1f8-62485ba6486f None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:02.409581 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37edc4f3-c396-442b-a31d-05c7354b18b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:02.409581 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edc4f3-c396-442b-a31d-05c7354b18b6 None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:02.409581 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edc4f3-c396-442b-a31d-05c7354b18b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:02.409581 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edc4f3-c396-442b-a31d-05c7354b18b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:02.409998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37edc4f3-c396-442b-a31d-05c7354b18b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:02.410261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37edc4f3-c396-442b-a31d-05c7354b18b6 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:02.433071 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 488/960] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:24:02 2022] POST /identity/v3/endpoints => generated 349 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:24:03.268236 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9111471-18a3-4e5b-ae4b-5bf3d3a8104a None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:03.269244 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9111471-18a3-4e5b-ae4b-5bf3d3a8104a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:03.269730 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9111471-18a3-4e5b-ae4b-5bf3d3a8104a None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:03.271548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 473/961] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:03.276682 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed6457-e314-4c04-a246-ad619b046608 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:03.277117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed6457-e314-4c04-a246-ad619b046608 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:03.277307 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed6457-e314-4c04-a246-ad619b046608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:03.298179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-f5ed6457-e314-4c04-a246-ad619b046608 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:03.299720 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f5ed6457-e314-4c04-a246-ad619b046608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:03.386366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 489/962] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:03.465225 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bd940-f659-45bb-8375-049721c4dddc None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:03.465515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bd940-f659-45bb-8375-049721c4dddc None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:03.465771 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bd940-f659-45bb-8375-049721c4dddc None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:03.467406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 474/963] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:03.472943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bce5a3-102b-4472-8dc1-761d59c69f72 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:03.473232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bce5a3-102b-4472-8dc1-761d59c69f72 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:03.473509 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bce5a3-102b-4472-8dc1-761d59c69f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:03.492928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-69bce5a3-102b-4472-8dc1-761d59c69f72 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:03.494099 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-69bce5a3-102b-4472-8dc1-761d59c69f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:03.536809 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:03.566814 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 490/964] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:03.655428 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bd940-f659-45bb-8375-049721c4dddc None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:03.766405 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bd940-f659-45bb-8375-049721c4dddc None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:03.787838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:03.802913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d9a32-84db-432c-b536-4e91be1f68ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:03.803781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d9a32-84db-432c-b536-4e91be1f68ee None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:03.804355 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d9a32-84db-432c-b536-4e91be1f68ee None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:03.804828 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d9a32-84db-432c-b536-4e91be1f68ee None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:03.805829 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d9a32-84db-432c-b536-4e91be1f68ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:03.807218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d9a32-84db-432c-b536-4e91be1f68ee None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:03.824437 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 475/965] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 26 01:24:03 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:24:03.842308 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bce5a3-102b-4472-8dc1-761d59c69f72 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:03.965553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bce5a3-102b-4472-8dc1-761d59c69f72 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:04.013286 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd13736-5f05-41e0-9d42-4af9d0d1f499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:04.013930 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd13736-5f05-41e0-9d42-4af9d0d1f499 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:04.014211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd13736-5f05-41e0-9d42-4af9d0d1f499 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:04.014487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd13736-5f05-41e0-9d42-4af9d0d1f499 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:04.027943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd13736-5f05-41e0-9d42-4af9d0d1f499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:24:04.033551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-dcd13736-5f05-41e0-9d42-4af9d0d1f499 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 01:24:04.033551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:04.033551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:04.033551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:04.033551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:04.033551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:04.033551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:04.033551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:04.033551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:04.033551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:04.033551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:04.033551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:04.033551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:24:04.033551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:24:04.033551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:24:04.033551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:24:04.034504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:24:04.034504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:24:04.034504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:24:04.034504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:24:04.034504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:04.034504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:04.034504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:04.034504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:04.034504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:04.034504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:04.034504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:04.034504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:04.034504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:04.034504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:04.034504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:04.034504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:04.036052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:04.036052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:04.036052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:04.036052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:04.036052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:24:04.036052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:24:04.036052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:24:04.036052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:24:04.036052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:24:04.036052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:24:04.036052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 01:24:04.036052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:04.036052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 491/966] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Sep 26 01:24:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:04.040695 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d9a32-84db-432c-b536-4e91be1f68ee None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:04.152005 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d9a32-84db-432c-b536-4e91be1f68ee None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:04.189153 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73026dd7-2c02-42bf-ad14-4aaca1fc06ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:04.190171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73026dd7-2c02-42bf-ad14-4aaca1fc06ee None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:04.190685 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73026dd7-2c02-42bf-ad14-4aaca1fc06ee None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:04.191182 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73026dd7-2c02-42bf-ad14-4aaca1fc06ee None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:04.192047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73026dd7-2c02-42bf-ad14-4aaca1fc06ee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:04.192548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73026dd7-2c02-42bf-ad14-4aaca1fc06ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:04.194167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73026dd7-2c02-42bf-ad14-4aaca1fc06ee None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:04.205331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 476/967] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 26 01:24:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:04.211770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd13736-5f05-41e0-9d42-4af9d0d1f499 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:04.247003 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:04.320848 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd13736-5f05-41e0-9d42-4af9d0d1f499 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:04.357232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3af68a-5f46-4798-b4fe-839b7c2f8699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:04.357883 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3af68a-5f46-4798-b4fe-839b7c2f8699 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:04.358162 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3af68a-5f46-4798-b4fe-839b7c2f8699 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:04.358442 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3af68a-5f46-4798-b4fe-839b7c2f8699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:04.370702 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3af68a-5f46-4798-b4fe-839b7c2f8699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:04.372287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3af68a-5f46-4798-b4fe-839b7c2f8699 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:04.389147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-1a3af68a-5f46-4798-b4fe-839b7c2f8699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:04.389147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:04.389147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:04.389147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:04.389147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:04.389147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:04.389147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:04.389147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:04.389147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:04.389147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:04.389147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:04.389147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:04.389147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:24:04.389147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:24:04.389147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:24:04.389147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:24:04.390742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:04.390742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:04.390742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:04.390742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:04.390742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:04.390742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:04.390742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:04.390742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:04.390742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:04.390742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:04.390742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:04.390742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:04.390742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:04.390742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:04.390742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:04.390742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:04.390742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:24:04.391851 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:24:04.391851 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:04.391851 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:04.391851 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 492/968] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:04.400683 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73026dd7-2c02-42bf-ad14-4aaca1fc06ee None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:04.448755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:04.498655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e222cb-94f6-4e8e-af88-be466e4a8966 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:04.499007 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e222cb-94f6-4e8e-af88-be466e4a8966 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:04.499242 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e222cb-94f6-4e8e-af88-be466e4a8966 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:04.500916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 493/969] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:24:04.506144 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef6982-7c9e-4945-8a57-16d73dc4d0fd None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:04.506297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef6982-7c9e-4945-8a57-16d73dc4d0fd None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:04.506574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef6982-7c9e-4945-8a57-16d73dc4d0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:04.512573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73026dd7-2c02-42bf-ad14-4aaca1fc06ee None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:04.526813 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-78ef6982-7c9e-4945-8a57-16d73dc4d0fd None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:04.528157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-78ef6982-7c9e-4945-8a57-16d73dc4d0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:04.549436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b677f-1405-46d9-a876-fd31919fb419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:04.550466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b677f-1405-46d9-a876-fd31919fb419 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:04.551000 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b677f-1405-46d9-a876-fd31919fb419 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:04.551508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b677f-1405-46d9-a876-fd31919fb419 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:04.552396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b677f-1405-46d9-a876-fd31919fb419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:04.552933 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b677f-1405-46d9-a876-fd31919fb419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:04.554693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b677f-1405-46d9-a876-fd31919fb419 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:04.569676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 477/970] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:04.576316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b677f-1405-46d9-a876-fd31919fb419 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:04.611099 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 494/971] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 01:24:04.675511 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796aed0-4aa1-4cc9-b9bd-2379826dcc76 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:04.675831 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796aed0-4aa1-4cc9-b9bd-2379826dcc76 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:04.676063 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796aed0-4aa1-4cc9-b9bd-2379826dcc76 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:04.678735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 495/972] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:24:04.684409 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04abfd-0936-4c7a-a63e-127a1f88558a None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:04.684683 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04abfd-0936-4c7a-a63e-127a1f88558a None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:04.684954 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04abfd-0936-4c7a-a63e-127a1f88558a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:04.685875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b677f-1405-46d9-a876-fd31919fb419 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:04.699612 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:04.705571 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-0e04abfd-0936-4c7a-a63e-127a1f88558a None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:04.706756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0e04abfd-0936-4c7a-a63e-127a1f88558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:04.715508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:04.727853 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a41761-b108-4ac1-8295-626bfb1fd620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:04.728717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a41761-b108-4ac1-8295-626bfb1fd620 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:04.729243 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a41761-b108-4ac1-8295-626bfb1fd620 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:04.729674 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a41761-b108-4ac1-8295-626bfb1fd620 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:04.738017 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a41761-b108-4ac1-8295-626bfb1fd620 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:04.739824 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a41761-b108-4ac1-8295-626bfb1fd620 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:04.753380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-81a41761-b108-4ac1-8295-626bfb1fd620 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 01:24:04.753380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:04.753380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:04.753380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:04.753380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:04.753380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:04.753380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:04.753380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:04.753380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:04.753380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:04.753380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:04.753380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:04.753380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:24:04.753380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:24:04.753380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:24:04.753380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:24:04.754570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:04.754570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:04.754570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:24:04.754570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:24:04.754570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:24:04.754570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:24:04.754570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:04.754570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:04.754570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:04.754570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:04.754570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:04.754570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:04.754570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:04.754570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:04.754570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:04.754570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:04.754570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:04.754570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:04.755785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:04.755785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:04.755785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:24:04.755785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:24:04.755785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:24:04.755785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:24:04.755785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:24:04.755785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:24:04.755785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 01:24:04.755785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:04.758073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 478/973] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 26 01:24:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:24:04.766888 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a41761-b108-4ac1-8295-626bfb1fd620 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:04.786910 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 496/974] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:04.870632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a41761-b108-4ac1-8295-626bfb1fd620 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:04.896107 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04abfd-0936-4c7a-a63e-127a1f88558a None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:04.912563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c29197-d9b7-465e-8ae2-8bef18943369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:04.913380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c29197-d9b7-465e-8ae2-8bef18943369 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:04.913830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c29197-d9b7-465e-8ae2-8bef18943369 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:04.914329 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c29197-d9b7-465e-8ae2-8bef18943369 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:04.915365 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c29197-d9b7-465e-8ae2-8bef18943369 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:04.915820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c29197-d9b7-465e-8ae2-8bef18943369 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:04.917421 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c29197-d9b7-465e-8ae2-8bef18943369 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:04.938230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 479/975] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Sep 26 01:24:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:04.944081 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c29197-d9b7-465e-8ae2-8bef18943369 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:04.967166 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:04.997227 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04abfd-0936-4c7a-a63e-127a1f88558a None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:05.031929 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c890e75-cf72-472a-8286-127188a79667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:05.032534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890e75-cf72-472a-8286-127188a79667 None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:05.032811 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890e75-cf72-472a-8286-127188a79667 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:05.033086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890e75-cf72-472a-8286-127188a79667 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:05.033727 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c890e75-cf72-472a-8286-127188a79667 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:05.042866 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c890e75-cf72-472a-8286-127188a79667 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:05.052973 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.sql.core [None req-0c890e75-cf72-472a-8286-127188a79667 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 26 01:24:05.052973 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 26 01:24:05.052973 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [parameters: {'user_id': 'e016c767be1e48f880948ab7fc5a5988', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 26 01:24:05.052973 dv-cinder-859203-2-smb devstack@keystone.service[81422]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81422) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 26 01:24:05.057264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c29197-d9b7-465e-8ae2-8bef18943369 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:05.061993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-0c890e75-cf72-472a-8286-127188a79667 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 26 01:24:05.061993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:05.061993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 01:24:05.061993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 01:24:05.061993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 01:24:05.061993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 01:24:05.061993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 01:24:05.061993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 01:24:05.061993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 01:24:05.061993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application conn.query(q) Sep 26 01:24:05.061993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 01:24:05.061993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 01:24:05.061993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 01:24:05.061993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application result.read() Sep 26 01:24:05.061993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 01:24:05.063490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 01:24:05.063490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 01:24:05.063490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 01:24:05.063490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 01:24:05.063490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 01:24:05.063490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 01:24:05.063490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 01:24:05.063490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 26 01:24:05.063490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:05.063490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 26 01:24:05.063490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:05.063490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:05.063490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 26 01:24:05.063490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 26 01:24:05.063490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 26 01:24:05.063490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 26 01:24:05.063490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 01:24:05.063490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application next(self.gen) Sep 26 01:24:05.064575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 26 01:24:05.064575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application yield resource Sep 26 01:24:05.064575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 01:24:05.064575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application next(self.gen) Sep 26 01:24:05.064575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 26 01:24:05.064575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self.session.rollback() Sep 26 01:24:05.064575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 26 01:24:05.064575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self.force_reraise() Sep 26 01:24:05.064575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 26 01:24:05.064575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise self.value Sep 26 01:24:05.064575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 26 01:24:05.064575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 26 01:24:05.064575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 26 01:24:05.064575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application session.commit() Sep 26 01:24:05.064575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 26 01:24:05.064575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 26 01:24:05.064575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 26 01:24:05.065914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._prepare_impl() Sep 26 01:24:05.065914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 26 01:24:05.065914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self.session.flush() Sep 26 01:24:05.065914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 26 01:24:05.065914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._flush(objects) Sep 26 01:24:05.065914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 26 01:24:05.065914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 26 01:24:05.065914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 26 01:24:05.065914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application compat.raise_( Sep 26 01:24:05.065914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 01:24:05.065914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception Sep 26 01:24:05.065914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 26 01:24:05.065914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application flush_context.execute() Sep 26 01:24:05.065914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 26 01:24:05.065914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rec.execute(self) Sep 26 01:24:05.065914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 26 01:24:05.065914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 26 01:24:05.066862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 26 01:24:05.066862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 26 01:24:05.066862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 26 01:24:05.066862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 26 01:24:05.066862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 26 01:24:05.066862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 26 01:24:05.066862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 26 01:24:05.066862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 26 01:24:05.066862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 26 01:24:05.066862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 26 01:24:05.066862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 26 01:24:05.066862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 26 01:24:05.066862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 26 01:24:05.066862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 26 01:24:05.066862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 01:24:05.066862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception Sep 26 01:24:05.068215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 01:24:05.068215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 01:24:05.068215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 01:24:05.068215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 01:24:05.068215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 01:24:05.068215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 01:24:05.068215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 01:24:05.068215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application conn.query(q) Sep 26 01:24:05.068215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 01:24:05.068215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 01:24:05.068215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 01:24:05.068215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application result.read() Sep 26 01:24:05.068215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 01:24:05.068215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 01:24:05.068215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 01:24:05.068215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 01:24:05.069410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 01:24:05.069410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 01:24:05.069410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 01:24:05.069410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 01:24:05.069410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 26 01:24:05.069410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 26 01:24:05.069410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e016c767be1e48f880948ab7fc5a5988', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 26 01:24:05.069410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 26 01:24:05.069410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:05.069410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:24:05.069410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:05.069410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:05.069410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:05.069410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:05.069410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:05.071064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:05.071064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:05.071064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:05.071064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:05.071064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:05.071064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:05.071064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:05.071064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 26 01:24:05.071064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 26 01:24:05.071064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:05.071064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:05.071064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:24:05.071064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:24:05.071064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:24:05.071064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:24:05.071064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 26 01:24:05.071064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 26 01:24:05.073610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 26 01:24:05.073610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 26 01:24:05.073610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 26 01:24:05.073610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 26 01:24:05.073610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 26 01:24:05.073610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:05.081082 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 497/976] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Sep 26 01:24:04 2022] POST /identity/v3/users => generated 160 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:24:05.081082 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c890e75-cf72-472a-8286-127188a79667 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:05.086115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:05.102788 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc29949-2b12-4ad2-a732-e0263beac36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:05.103732 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc29949-2b12-4ad2-a732-e0263beac36e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:05.104020 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc29949-2b12-4ad2-a732-e0263beac36e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:05.104300 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc29949-2b12-4ad2-a732-e0263beac36e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:05.177979 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc29949-2b12-4ad2-a732-e0263beac36e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:05.179373 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc29949-2b12-4ad2-a732-e0263beac36e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:05.190403 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c890e75-cf72-472a-8286-127188a79667 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:05.201542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:05.226734 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a46b0a-4de3-4019-b4e3-362c0c560ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:05.228013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a46b0a-4de3-4019-b4e3-362c0c560ade None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:05.228525 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a46b0a-4de3-4019-b4e3-362c0c560ade None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:05.229507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a46b0a-4de3-4019-b4e3-362c0c560ade None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:05.230615 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a46b0a-4de3-4019-b4e3-362c0c560ade None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:05.232728 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a46b0a-4de3-4019-b4e3-362c0c560ade None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:05.242445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-f0a46b0a-4de3-4019-b4e3-362c0c560ade None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 01:24:05.242445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:05.242445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:24:05.242445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:24:05.242445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:24:05.242445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:24:05.242445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:24:05.242445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:24:05.242445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 01:24:05.242445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:05.242445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:24:05.242445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:05.242445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:05.242445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:05.242445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:05.242445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:05.242445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:05.243519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:05.243519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:05.243519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:05.243519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:05.243519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:05.243519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:05.243519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:24:05.243519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:24:05.243519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:24:05.243519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:24:05.243519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:05.243519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:05.243519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:05.243519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:05.243519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:05.243519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:05.244346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:05.244346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:05.244346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:05.244346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:05.244346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:05.244346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:05.244346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:05.244346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:05.244346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:05.244346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:05.244346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:24:05.244346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:24:05.244346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 01:24:05.244346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:05.244346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 498/977] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 26 01:24:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:05.245148 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a46b0a-4de3-4019-b4e3-362c0c560ade None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:05.292224 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 480/978] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:24:04 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 01:24:05.292886 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc29949-2b12-4ad2-a732-e0263beac36e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:05.326953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:05.364516 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a46b0a-4de3-4019-b4e3-362c0c560ade None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:05.405623 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc29949-2b12-4ad2-a732-e0263beac36e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:05.408288 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf27915-1189-43e5-8caa-be6027f6939b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:05.408915 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf27915-1189-43e5-8caa-be6027f6939b None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:05.409187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf27915-1189-43e5-8caa-be6027f6939b None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:05.409451 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf27915-1189-43e5-8caa-be6027f6939b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:05.418702 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf27915-1189-43e5-8caa-be6027f6939b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:05.420153 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf27915-1189-43e5-8caa-be6027f6939b None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:05.431700 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:05.431941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-9bf27915-1189-43e5-8caa-be6027f6939b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 01:24:05.431941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:05.431941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:05.431941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:05.431941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:05.431941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:05.431941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:05.431941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:05.431941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:05.431941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:05.431941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:05.431941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:05.431941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:24:05.431941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:24:05.431941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:24:05.431941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:24:05.432955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:05.432955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:05.432955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:24:05.432955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:24:05.432955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:24:05.432955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:24:05.432955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:05.432955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:05.432955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:05.432955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:05.432955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:05.432955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:05.432955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:05.432955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:05.432955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:05.432955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:05.432955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:05.432955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:05.433912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:05.433912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:05.433912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:24:05.433912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:24:05.433912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:24:05.433912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:24:05.433912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:24:05.433912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:24:05.433912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 01:24:05.433912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:05.433912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 499/979] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:24:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:05.433912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf27915-1189-43e5-8caa-be6027f6939b None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:05.451408 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ceb71-74d4-4304-9c4b-5aba879ea9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:05.452017 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ceb71-74d4-4304-9c4b-5aba879ea9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:05.452306 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ceb71-74d4-4304-9c4b-5aba879ea9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:05.452565 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ceb71-74d4-4304-9c4b-5aba879ea9b1 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:05.453548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ceb71-74d4-4304-9c4b-5aba879ea9b1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:05.453859 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ceb71-74d4-4304-9c4b-5aba879ea9b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:05.455257 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ceb71-74d4-4304-9c4b-5aba879ea9b1 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:05.465081 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 481/980] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 26 01:24:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:05.465895 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ceb71-74d4-4304-9c4b-5aba879ea9b1 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:05.544671 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf27915-1189-43e5-8caa-be6027f6939b None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:05.579187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:05.582050 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ceb71-74d4-4304-9c4b-5aba879ea9b1 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:05.586047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c41b8b-3cbd-4220-82f1-9c6064de41e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:05.586669 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c41b8b-3cbd-4220-82f1-9c6064de41e7 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:05.586987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c41b8b-3cbd-4220-82f1-9c6064de41e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:05.587257 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c41b8b-3cbd-4220-82f1-9c6064de41e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:05.598039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c41b8b-3cbd-4220-82f1-9c6064de41e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:05.599492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c41b8b-3cbd-4220-82f1-9c6064de41e7 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:05.613542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-36c41b8b-3cbd-4220-82f1-9c6064de41e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:05.613542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:05.613542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:05.613542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:05.613542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:05.613542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:05.613542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:05.613542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:05.613542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:05.613542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:05.613542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:05.613542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:05.613542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:24:05.613542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:24:05.613542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:24:05.613542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:24:05.614466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:05.614466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:05.614466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:05.614466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:05.614466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:05.614466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:05.614466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:05.614466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:05.614466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:05.614466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:05.614466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:05.614466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:05.614466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:05.614466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:05.614466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:05.614466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:05.614466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:24:05.620279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:24:05.620279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:05.620279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:05.620279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 500/981] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:05.620279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c41b8b-3cbd-4220-82f1-9c6064de41e7 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:05.623164 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e892296-602e-4365-a95e-3749202ceb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:05.623763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e892296-602e-4365-a95e-3749202ceb47 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:05.624037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e892296-602e-4365-a95e-3749202ceb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:05.624307 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e892296-602e-4365-a95e-3749202ceb47 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:05.625707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e892296-602e-4365-a95e-3749202ceb47 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:05.625995 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e892296-602e-4365-a95e-3749202ceb47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:05.627440 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e892296-602e-4365-a95e-3749202ceb47 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:05.662234 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 482/982] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 26 01:24:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:05.662234 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e892296-602e-4365-a95e-3749202ceb47 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:05.734486 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:05.735464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c41b8b-3cbd-4220-82f1-9c6064de41e7 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:05.781211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cc8d8-3fe3-4e75-a571-648f03c1b2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:05.781916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cc8d8-3fe3-4e75-a571-648f03c1b2bb None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:05.782210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cc8d8-3fe3-4e75-a571-648f03c1b2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:05.782466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cc8d8-3fe3-4e75-a571-648f03c1b2bb None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:05.783130 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93cc8d8-3fe3-4e75-a571-648f03c1b2bb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:05.783426 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93cc8d8-3fe3-4e75-a571-648f03c1b2bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:05.784791 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93cc8d8-3fe3-4e75-a571-648f03c1b2bb None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:05.796274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 501/983] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 26 01:24:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:05.803295 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cc8d8-3fe3-4e75-a571-648f03c1b2bb None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:05.828773 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e892296-602e-4365-a95e-3749202ceb47 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:05.872308 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:05.876698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ab82b-3e07-4c2f-8e84-bfd2410352c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:05.877623 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ab82b-3e07-4c2f-8e84-bfd2410352c4 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:05.878112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ab82b-3e07-4c2f-8e84-bfd2410352c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:05.878660 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ab82b-3e07-4c2f-8e84-bfd2410352c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:05.879539 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ab82b-3e07-4c2f-8e84-bfd2410352c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:05.880071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ab82b-3e07-4c2f-8e84-bfd2410352c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:05.881682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ab82b-3e07-4c2f-8e84-bfd2410352c4 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:05.895647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 483/984] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:05.901128 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ab82b-3e07-4c2f-8e84-bfd2410352c4 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:05.936623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cc8d8-3fe3-4e75-a571-648f03c1b2bb None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:05.975480 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7463f7-48ec-4b89-8427-7d541f46033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:05.976248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7463f7-48ec-4b89-8427-7d541f46033a None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:05.976529 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7463f7-48ec-4b89-8427-7d541f46033a None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:05.976798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7463f7-48ec-4b89-8427-7d541f46033a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:05.977505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7463f7-48ec-4b89-8427-7d541f46033a None admin] RBAC: Adding query filter params (interface=admin, service_id=22361f6334d342c39e87c74c0f53f0f1, region_id=RegionOne) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:05.977808 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7463f7-48ec-4b89-8427-7d541f46033a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:05.979728 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7463f7-48ec-4b89-8427-7d541f46033a None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:05.985734 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 502/985] 10.222.0.26 () {56 vars in 1249 bytes} [Mon Sep 26 01:24:05 2022] GET /identity/v3/endpoints?service_id=22361f6334d342c39e87c74c0f53f0f1&interface=admin®ion_id=RegionOne => generated 193 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:05.991224 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7463f7-48ec-4b89-8427-7d541f46033a None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:06.016232 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ab82b-3e07-4c2f-8e84-bfd2410352c4 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:06.018147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:06.054394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb41207-8b7d-48a3-a273-2adca133d8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:06.055072 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb41207-8b7d-48a3-a273-2adca133d8f6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:06.055350 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb41207-8b7d-48a3-a273-2adca133d8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:06.055618 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb41207-8b7d-48a3-a273-2adca133d8f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:06.062639 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb41207-8b7d-48a3-a273-2adca133d8f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:06.064152 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb41207-8b7d-48a3-a273-2adca133d8f6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:06.076629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-8bb41207-8b7d-48a3-a273-2adca133d8f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:24:06.076629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:06.076629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:06.076629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:06.076629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:06.076629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:06.076629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:06.076629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:06.076629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:06.076629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:06.076629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:06.076629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:06.076629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:24:06.076629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:24:06.076629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:24:06.077686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:24:06.077686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:06.077686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:06.077686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:06.077686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:06.077686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:06.077686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:06.077686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:06.077686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:06.077686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:06.077686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:06.077686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:06.077686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:06.077686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:06.077686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:06.077686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:06.077686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:06.079105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:24:06.079105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:24:06.079105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:24:06.079105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:24:06.079105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:24:06.079105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:24:06.079105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:24:06.079105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:06.079105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 484/986] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:24:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:24:06.084698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb41207-8b7d-48a3-a273-2adca133d8f6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:06.100941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7463f7-48ec-4b89-8427-7d541f46033a None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:06.111303 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:06.140710 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89f448-4edc-4b08-ba69-b956d0393f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:06.141700 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89f448-4edc-4b08-ba69-b956d0393f9e None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:06.141980 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89f448-4edc-4b08-ba69-b956d0393f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:06.142248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89f448-4edc-4b08-ba69-b956d0393f9e None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:06.142871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89f448-4edc-4b08-ba69-b956d0393f9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:06.144220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89f448-4edc-4b08-ba69-b956d0393f9e None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:06.158892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 503/987] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 26 01:24:05 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:24:06.195960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb41207-8b7d-48a3-a273-2adca133d8f6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:06.198028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e19c83-172e-441a-9332-cf1824c37643 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:06.198613 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e19c83-172e-441a-9332-cf1824c37643 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:06.199025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e19c83-172e-441a-9332-cf1824c37643 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:06.201415 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 504/988] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:24:06.207878 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d3f09-d685-4d67-a4bc-02dddfcdb37e None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:06.208308 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d3f09-d685-4d67-a4bc-02dddfcdb37e None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:06.208994 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d3f09-d685-4d67-a4bc-02dddfcdb37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:06.229476 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-af3d3f09-d685-4d67-a4bc-02dddfcdb37e None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:06.231207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-af3d3f09-d685-4d67-a4bc-02dddfcdb37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:06.235071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef0d95-004d-432f-a710-c56f129a34ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:06.235694 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef0d95-004d-432f-a710-c56f129a34ac None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:06.236025 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef0d95-004d-432f-a710-c56f129a34ac None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:06.236236 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef0d95-004d-432f-a710-c56f129a34ac None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:06.236935 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef0d95-004d-432f-a710-c56f129a34ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:06.237236 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef0d95-004d-432f-a710-c56f129a34ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:06.238766 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef0d95-004d-432f-a710-c56f129a34ac None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:06.257066 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 485/989] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:24:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:06.263215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef0d95-004d-432f-a710-c56f129a34ac None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:06.293844 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:06.313309 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 505/990] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 01:24:06.380166 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef0d95-004d-432f-a710-c56f129a34ac None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:06.420411 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac412f9-65b5-47a8-b754-8b2de664ab57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:06.421026 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac412f9-65b5-47a8-b754-8b2de664ab57 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:06.421287 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac412f9-65b5-47a8-b754-8b2de664ab57 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:06.422163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac412f9-65b5-47a8-b754-8b2de664ab57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:06.422914 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac412f9-65b5-47a8-b754-8b2de664ab57 None admin] RBAC: Adding query filter params (role.id=1ce2279b741048d1a5abc82efefcdf15, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=6f4696c410f343709be200dee463bd1c) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:06.423228 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac412f9-65b5-47a8-b754-8b2de664ab57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:06.424654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac412f9-65b5-47a8-b754-8b2de664ab57 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:06.430706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 486/991] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:24:06 2022] GET /identity/v3/role_assignments?user.id=6f4696c410f343709be200dee463bd1c&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=1ce2279b741048d1a5abc82efefcdf15 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:06.583825 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d3f09-d685-4d67-a4bc-02dddfcdb37e None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:06.689466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d3f09-d685-4d67-a4bc-02dddfcdb37e None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:06.691159 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:06.726755 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034323c5-638a-496f-979a-73e8c48e62e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:06.727421 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034323c5-638a-496f-979a-73e8c48e62e1 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:06.727702 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034323c5-638a-496f-979a-73e8c48e62e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:06.727972 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034323c5-638a-496f-979a-73e8c48e62e1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:06.728548 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034323c5-638a-496f-979a-73e8c48e62e1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:06.729896 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034323c5-638a-496f-979a-73e8c48e62e1 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:06.739241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-034323c5-638a-496f-979a-73e8c48e62e1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 01:24:06.739241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:06.739241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:24:06.739241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:24:06.739241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:24:06.739241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:24:06.739241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:24:06.739241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:24:06.739241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 01:24:06.739241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:06.739241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:24:06.739241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:06.739241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:06.739241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:06.739241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:06.739241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:06.739241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:06.740272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:06.740272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:06.740272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:06.740272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:06.740272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:06.740272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:06.740272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:24:06.740272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:24:06.740272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:24:06.740272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:24:06.740272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:06.740272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:06.740272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:06.740272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:06.740272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:06.740272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:06.741117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:06.741117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:06.741117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:06.741117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:06.741117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:06.741117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:06.741117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:06.741117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:06.741117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:06.741117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:06.741117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:24:06.741117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:24:06.741117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 01:24:06.741117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:06.741117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 506/992] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:24:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:06.746944 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac412f9-65b5-47a8-b754-8b2de664ab57 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:06.835192 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:06.850940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac412f9-65b5-47a8-b754-8b2de664ab57 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:06.885129 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86259b-fd3c-403c-9b20-1dbe938aa993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:06.885731 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86259b-fd3c-403c-9b20-1dbe938aa993 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:06.886014 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86259b-fd3c-403c-9b20-1dbe938aa993 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:06.886289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86259b-fd3c-403c-9b20-1dbe938aa993 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:06.886941 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86259b-fd3c-403c-9b20-1dbe938aa993 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:06.887248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86259b-fd3c-403c-9b20-1dbe938aa993 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:06.888609 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86259b-fd3c-403c-9b20-1dbe938aa993 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:06.898097 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 487/993] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 26 01:24:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:06.899675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034323c5-638a-496f-979a-73e8c48e62e1 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:07.005668 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034323c5-638a-496f-979a-73e8c48e62e1 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:07.038998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d63033-74aa-42e2-b9c4-9cb95b0e0a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:07.039655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d63033-74aa-42e2-b9c4-9cb95b0e0a1e None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:07.039943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d63033-74aa-42e2-b9c4-9cb95b0e0a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:07.040218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d63033-74aa-42e2-b9c4-9cb95b0e0a1e None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:07.040846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d63033-74aa-42e2-b9c4-9cb95b0e0a1e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:07.041149 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d63033-74aa-42e2-b9c4-9cb95b0e0a1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:07.042494 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d63033-74aa-42e2-b9c4-9cb95b0e0a1e None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:07.047967 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 507/994] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 26 01:24:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:07.053722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86259b-fd3c-403c-9b20-1dbe938aa993 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:07.158572 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86259b-fd3c-403c-9b20-1dbe938aa993 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:07.192914 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a292ae-17c3-4073-a6c0-583bc3394d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:07.193526 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a292ae-17c3-4073-a6c0-583bc3394d26 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:07.193809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a292ae-17c3-4073-a6c0-583bc3394d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:07.194085 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a292ae-17c3-4073-a6c0-583bc3394d26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:07.194776 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a292ae-17c3-4073-a6c0-583bc3394d26 None admin] RBAC: Adding query filter params (interface=public, service_id=a77c2d2a8d3c4cb6a68c6b5b5285a9bf, region_id=RegionOne) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:07.195125 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a292ae-17c3-4073-a6c0-583bc3394d26 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:07.196749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a292ae-17c3-4073-a6c0-583bc3394d26 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:07.201884 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 488/995] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 26 01:24:07 2022] GET /identity/v3/endpoints?service_id=a77c2d2a8d3c4cb6a68c6b5b5285a9bf&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:07.208201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d63033-74aa-42e2-b9c4-9cb95b0e0a1e None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:07.239997 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:07.313091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d63033-74aa-42e2-b9c4-9cb95b0e0a1e None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:07.348903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457cf5f-7a18-4907-94b5-d0a4037c8912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:07.349666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457cf5f-7a18-4907-94b5-d0a4037c8912 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:07.350040 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457cf5f-7a18-4907-94b5-d0a4037c8912 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:07.350428 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457cf5f-7a18-4907-94b5-d0a4037c8912 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:07.351171 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457cf5f-7a18-4907-94b5-d0a4037c8912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:07.352619 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457cf5f-7a18-4907-94b5-d0a4037c8912 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:07.362924 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 508/996] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 26 01:24:07 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:24:08.361208 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a2b7e-5771-4afd-a79e-5c9211f27849 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:08.361766 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a2b7e-5771-4afd-a79e-5c9211f27849 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:08.361766 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a2b7e-5771-4afd-a79e-5c9211f27849 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:08.363313 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 489/997] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:08.368238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810772f3-79a3-4fcc-92ca-e95e04398732 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:08.368622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810772f3-79a3-4fcc-92ca-e95e04398732 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:08.368798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810772f3-79a3-4fcc-92ca-e95e04398732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:08.387312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-810772f3-79a3-4fcc-92ca-e95e04398732 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:08.388499 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-810772f3-79a3-4fcc-92ca-e95e04398732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:08.462712 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 509/998] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:08.616333 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9c2f6-7627-4b4e-b0a7-204ca6791489 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:08.616526 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9c2f6-7627-4b4e-b0a7-204ca6791489 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:08.616787 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9c2f6-7627-4b4e-b0a7-204ca6791489 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:08.618239 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 490/999] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:08.623216 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968dfa0-cfbb-44b4-a774-8d2103c27bf6 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:08.623501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968dfa0-cfbb-44b4-a774-8d2103c27bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:08.623770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968dfa0-cfbb-44b4-a774-8d2103c27bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:08.642480 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-8968dfa0-cfbb-44b4-a774-8d2103c27bf6 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:08.643685 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-8968dfa0-cfbb-44b4-a774-8d2103c27bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:08.662006 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:08.715726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 510/1000] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:08.733089 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9c2f6-7627-4b4e-b0a7-204ca6791489 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:08.749083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:08.837715 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9c2f6-7627-4b4e-b0a7-204ca6791489 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:08.871261 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd018c-5687-41ef-89aa-49ab11c8b2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:08.872071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd018c-5687-41ef-89aa-49ab11c8b2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:08.872491 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd018c-5687-41ef-89aa-49ab11c8b2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:08.872919 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd018c-5687-41ef-89aa-49ab11c8b2f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:08.873628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd018c-5687-41ef-89aa-49ab11c8b2f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:08.875262 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd018c-5687-41ef-89aa-49ab11c8b2f5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:08.884468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-51cd018c-5687-41ef-89aa-49ab11c8b2f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 01:24:08.884468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:08.884468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:24:08.884468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:24:08.884468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:24:08.884468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:24:08.884468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:24:08.884468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:24:08.884468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 01:24:08.884468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:08.884468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:24:08.884468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:08.884468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:08.884468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:08.884468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:08.884468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:08.884468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:08.885656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:08.885656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:08.885656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:08.885656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:08.885656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:08.885656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:08.885656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:24:08.885656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:24:08.885656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:24:08.885656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:24:08.885656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:08.885656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:08.885656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:08.885656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:08.885656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:08.885656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:08.886690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:08.886690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:08.886690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:08.886690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:08.886690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:08.886690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:08.886690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:08.886690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:08.886690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:08.886690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:08.886690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:24:08.886690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:24:08.886690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 01:24:08.886690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:08.889043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 491/1001] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 26 01:24:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:08.895192 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968dfa0-cfbb-44b4-a774-8d2103c27bf6 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:08.985892 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd018c-5687-41ef-89aa-49ab11c8b2f5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:09.007748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968dfa0-cfbb-44b4-a774-8d2103c27bf6 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:09.046202 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed386c9-a4aa-4b94-8fe3-9d95a20bd7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:09.047725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed386c9-a4aa-4b94-8fe3-9d95a20bd7bc None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:09.048278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed386c9-a4aa-4b94-8fe3-9d95a20bd7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:09.048556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed386c9-a4aa-4b94-8fe3-9d95a20bd7bc None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:09.049189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed386c9-a4aa-4b94-8fe3-9d95a20bd7bc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:09.049528 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed386c9-a4aa-4b94-8fe3-9d95a20bd7bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:09.050987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed386c9-a4aa-4b94-8fe3-9d95a20bd7bc None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:09.056738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 511/1002] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 26 01:24:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:09.062533 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed386c9-a4aa-4b94-8fe3-9d95a20bd7bc None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:09.087548 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:09.111430 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:09.136331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd018c-5687-41ef-89aa-49ab11c8b2f5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:09.180431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28030439-59f2-4601-bae7-7cdf48fe1397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:09.181067 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28030439-59f2-4601-bae7-7cdf48fe1397 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:09.181571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28030439-59f2-4601-bae7-7cdf48fe1397 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:09.181705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28030439-59f2-4601-bae7-7cdf48fe1397 None admin] PATH_INFO: `/v3/services/image` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:09.182221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28030439-59f2-4601-bae7-7cdf48fe1397 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:09.183598 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28030439-59f2-4601-bae7-7cdf48fe1397 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:09.185139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed386c9-a4aa-4b94-8fe3-9d95a20bd7bc None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:09.192826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-28030439-59f2-4601-bae7-7cdf48fe1397 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 01:24:09.192826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:09.192826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:24:09.192826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:24:09.192826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:24:09.192826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:24:09.192826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:24:09.192826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:24:09.192826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 01:24:09.192826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:09.192826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:24:09.192826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:09.192826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:09.192826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:09.192826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:09.192826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:09.192826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:09.193943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:09.193943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:09.193943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:09.193943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:09.193943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:09.193943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:09.193943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:24:09.193943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:24:09.193943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:24:09.193943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:24:09.193943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:09.193943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:09.193943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:09.193943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:09.193943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:09.193943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:09.194813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:09.194813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:09.194813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:09.194813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:09.194813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:09.194813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:09.194813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:09.194813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:09.194813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:09.194813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:09.194813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:24:09.194813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:24:09.194813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 01:24:09.194813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:09.199296 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 492/1003] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Sep 26 01:24:08 2022] GET /identity/v3/services/image => generated 86 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:24:09.200119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28030439-59f2-4601-bae7-7cdf48fe1397 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:09.233265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb29cd-3823-4658-8aa9-ab9fd65fc0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:09.234248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb29cd-3823-4658-8aa9-ab9fd65fc0fa None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:09.234528 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb29cd-3823-4658-8aa9-ab9fd65fc0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:09.234803 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb29cd-3823-4658-8aa9-ab9fd65fc0fa None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:09.235465 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb29cd-3823-4658-8aa9-ab9fd65fc0fa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:09.235786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb29cd-3823-4658-8aa9-ab9fd65fc0fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:09.237117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb29cd-3823-4658-8aa9-ab9fd65fc0fa None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:09.243179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 512/1004] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 26 01:24:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:09.248674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb29cd-3823-4658-8aa9-ab9fd65fc0fa None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:09.325014 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28030439-59f2-4601-bae7-7cdf48fe1397 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:09.348943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:09.369727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e79f3-45fb-4cdd-8737-6139597ce182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:09.370467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e79f3-45fb-4cdd-8737-6139597ce182 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:09.370746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e79f3-45fb-4cdd-8737-6139597ce182 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:09.371047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e79f3-45fb-4cdd-8737-6139597ce182 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:09.371980 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e79f3-45fb-4cdd-8737-6139597ce182 None admin] RBAC: Adding query filter params (name=image) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:09.372272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e79f3-45fb-4cdd-8737-6139597ce182 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:09.373951 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e79f3-45fb-4cdd-8737-6139597ce182 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:09.375513 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb29cd-3823-4658-8aa9-ab9fd65fc0fa None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:09.386285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 493/1005] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:24:09.387230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e79f3-45fb-4cdd-8737-6139597ce182 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:09.404070 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:09.426458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a63be3-0647-4c3b-bead-87b86fa549f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:09.427117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a63be3-0647-4c3b-bead-87b86fa549f1 None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:09.427401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a63be3-0647-4c3b-bead-87b86fa549f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:09.427667 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a63be3-0647-4c3b-bead-87b86fa549f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:09.428338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a63be3-0647-4c3b-bead-87b86fa549f1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:09.429674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a63be3-0647-4c3b-bead-87b86fa549f1 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:09.450899 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 513/1006] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:24:09 2022] POST /identity/v3/endpoints => generated 325 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:24:09.528198 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e79f3-45fb-4cdd-8737-6139597ce182 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:09.571956 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ffa7d-10e3-44a3-b312-3ad0b7fe5aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:09.572620 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ffa7d-10e3-44a3-b312-3ad0b7fe5aba None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:09.572895 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ffa7d-10e3-44a3-b312-3ad0b7fe5aba None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:09.573173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ffa7d-10e3-44a3-b312-3ad0b7fe5aba None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:09.573797 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ffa7d-10e3-44a3-b312-3ad0b7fe5aba None admin] RBAC: Adding query filter params (type=image) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:09.574097 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ffa7d-10e3-44a3-b312-3ad0b7fe5aba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:09.575552 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ffa7d-10e3-44a3-b312-3ad0b7fe5aba None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:09.586857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 494/1007] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:09 2022] GET /identity/v3/services?type=image => generated 122 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:24:09.589001 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c374287-31fc-4f6b-8a6a-062ea7605c21 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:09.589290 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c374287-31fc-4f6b-8a6a-062ea7605c21 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:09.589564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c374287-31fc-4f6b-8a6a-062ea7605c21 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:09.591278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 514/1008] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:09.597892 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13002ba-4c63-49bb-92ae-2d1109b46b70 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:09.598173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13002ba-4c63-49bb-92ae-2d1109b46b70 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:09.598448 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13002ba-4c63-49bb-92ae-2d1109b46b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:09.618639 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-f13002ba-4c63-49bb-92ae-2d1109b46b70 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:09.619925 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f13002ba-4c63-49bb-92ae-2d1109b46b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:09.690819 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:09.703009 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 495/1009] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:09 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:09.967250 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c374287-31fc-4f6b-8a6a-062ea7605c21 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:10.072410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c374287-31fc-4f6b-8a6a-062ea7605c21 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:10.106909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7b858-781d-467e-aa0d-9ee232972cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:10.107534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7b858-781d-467e-aa0d-9ee232972cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:10.107811 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7b858-781d-467e-aa0d-9ee232972cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:10.108083 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7b858-781d-467e-aa0d-9ee232972cc0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:10.108670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7b858-781d-467e-aa0d-9ee232972cc0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:10.110127 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7b858-781d-467e-aa0d-9ee232972cc0 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:10.119028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-f8c7b858-781d-467e-aa0d-9ee232972cc0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 01:24:10.119028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:10.119028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:24:10.119028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:24:10.119028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:24:10.119028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:24:10.119028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:24:10.119028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:24:10.119028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 01:24:10.119028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:10.119028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:24:10.119028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:10.119028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:10.119028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:10.119028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:10.119028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:10.119028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:10.120044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:10.120044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:10.120044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:10.120044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:10.120044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:10.120044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:10.120044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:24:10.120044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:24:10.120044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:24:10.120044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:24:10.120044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:10.120044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:10.120044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:10.120044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:10.120044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:10.120044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:10.123705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:10.123705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:10.123705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:10.123705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:10.123705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:10.123705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:10.123705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:10.123705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:10.123705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:10.123705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:10.123705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:24:10.123705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:24:10.123705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 01:24:10.123705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:10.123705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 515/1010] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:24:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:10.127367 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13002ba-4c63-49bb-92ae-2d1109b46b70 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:10.246168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13002ba-4c63-49bb-92ae-2d1109b46b70 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:10.280873 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86de90-3160-45a4-a1cd-5b909d9ece01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:10.281396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86de90-3160-45a4-a1cd-5b909d9ece01 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:10.281666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86de90-3160-45a4-a1cd-5b909d9ece01 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:10.281939 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86de90-3160-45a4-a1cd-5b909d9ece01 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:10.282566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86de90-3160-45a4-a1cd-5b909d9ece01 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:10.282892 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86de90-3160-45a4-a1cd-5b909d9ece01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:10.284249 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86de90-3160-45a4-a1cd-5b909d9ece01 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:10.289236 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 496/1011] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 26 01:24:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:10.294903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7b858-781d-467e-aa0d-9ee232972cc0 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:10.305476 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:10.405942 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7b858-781d-467e-aa0d-9ee232972cc0 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:10.442795 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c2aab-0d2f-4801-8327-2db23bcc23c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:10.443424 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c2aab-0d2f-4801-8327-2db23bcc23c1 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:10.443704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c2aab-0d2f-4801-8327-2db23bcc23c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:10.443975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c2aab-0d2f-4801-8327-2db23bcc23c1 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:10.444598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c2aab-0d2f-4801-8327-2db23bcc23c1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:10.444897 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c2aab-0d2f-4801-8327-2db23bcc23c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:10.446497 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c2aab-0d2f-4801-8327-2db23bcc23c1 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:10.451562 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 516/1012] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 26 01:24:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:24:10.457209 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86de90-3160-45a4-a1cd-5b909d9ece01 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:10.520186 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:10.561270 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86de90-3160-45a4-a1cd-5b909d9ece01 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:10.595755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf250b-57a1-4a50-92f7-b629faabc554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:10.596360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf250b-57a1-4a50-92f7-b629faabc554 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:10.596638 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf250b-57a1-4a50-92f7-b629faabc554 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:10.596906 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf250b-57a1-4a50-92f7-b629faabc554 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:10.597573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf250b-57a1-4a50-92f7-b629faabc554 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:10.598980 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf250b-57a1-4a50-92f7-b629faabc554 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:10.626863 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 497/1013] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:24:10 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:24:11.639027 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b227d-3d76-4293-8309-0bd2bd172ab3 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:11.639583 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b227d-3d76-4293-8309-0bd2bd172ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:11.639583 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b227d-3d76-4293-8309-0bd2bd172ab3 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:11.641528 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 517/1014] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:11.647074 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbe9b5-f3b7-4c25-8dd6-57362d6f37c1 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:11.647607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbe9b5-f3b7-4c25-8dd6-57362d6f37c1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:11.647607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbe9b5-f3b7-4c25-8dd6-57362d6f37c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:11.666818 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-abcbe9b5-f3b7-4c25-8dd6-57362d6f37c1 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:11.667988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-abcbe9b5-f3b7-4c25-8dd6-57362d6f37c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:11.743904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 498/1015] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:11 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:11.774039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24671b21-e536-4785-a831-5065748e7f40 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:11.774315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24671b21-e536-4785-a831-5065748e7f40 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:11.774591 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24671b21-e536-4785-a831-5065748e7f40 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:11.776084 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 518/1016] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:11.781972 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29acbe-5bec-4cf9-a101-f1f7268f3296 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:11.782318 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29acbe-5bec-4cf9-a101-f1f7268f3296 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:11.782525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29acbe-5bec-4cf9-a101-f1f7268f3296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:11.800672 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-7f29acbe-5bec-4cf9-a101-f1f7268f3296 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:11.801852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7f29acbe-5bec-4cf9-a101-f1f7268f3296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:11.837237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:11.872373 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 499/1017] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:11 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:12.008634 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24671b21-e536-4785-a831-5065748e7f40 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:12.079116 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:12.112583 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24671b21-e536-4785-a831-5065748e7f40 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:12.142358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29acbe-5bec-4cf9-a101-f1f7268f3296 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:12.148568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7fc2d-5b56-4d75-beb9-2f6b28071e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:12.149191 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7fc2d-5b56-4d75-beb9-2f6b28071e43 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:12.149466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7fc2d-5b56-4d75-beb9-2f6b28071e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:12.149733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7fc2d-5b56-4d75-beb9-2f6b28071e43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:12.150843 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7fc2d-5b56-4d75-beb9-2f6b28071e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:12.152685 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7fc2d-5b56-4d75-beb9-2f6b28071e43 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:12.154803 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 519/1018] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:12.160729 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7fc2d-5b56-4d75-beb9-2f6b28071e43 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:12.251080 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29acbe-5bec-4cf9-a101-f1f7268f3296 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:12.272317 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7fc2d-5b56-4d75-beb9-2f6b28071e43 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:12.285600 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8458607-23cc-4614-a1b2-8cbc7f8bf2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:12.286206 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8458607-23cc-4614-a1b2-8cbc7f8bf2df None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:12.286483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8458607-23cc-4614-a1b2-8cbc7f8bf2df None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:12.286755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8458607-23cc-4614-a1b2-8cbc7f8bf2df None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:12.287436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8458607-23cc-4614-a1b2-8cbc7f8bf2df None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:12.288797 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8458607-23cc-4614-a1b2-8cbc7f8bf2df None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:12.305275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 500/1019] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 26 01:24:12 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:24:12.317456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea407f0b-e32f-49b6-9c8d-13ffdfe99e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:12.318381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea407f0b-e32f-49b6-9c8d-13ffdfe99e3a None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:12.318866 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea407f0b-e32f-49b6-9c8d-13ffdfe99e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:12.319282 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea407f0b-e32f-49b6-9c8d-13ffdfe99e3a None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:12.320120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea407f0b-e32f-49b6-9c8d-13ffdfe99e3a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:12.322004 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea407f0b-e32f-49b6-9c8d-13ffdfe99e3a None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:12.327570 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:12.358537 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 520/1020] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 26 01:24:12 2022] POST /identity/v3/projects => generated 311 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:24:12.880676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ee271-e356-4bfe-ab03-898ff7e8a0b4 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:12.881199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ee271-e356-4bfe-ab03-898ff7e8a0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:12.881199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ee271-e356-4bfe-ab03-898ff7e8a0b4 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:12.882682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 501/1021] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:12.887709 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe7aad-8932-4f41-9e8d-dfdd085b31e0 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:12.888116 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe7aad-8932-4f41-9e8d-dfdd085b31e0 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:12.888288 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe7aad-8932-4f41-9e8d-dfdd085b31e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:12.908083 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-3bbe7aad-8932-4f41-9e8d-dfdd085b31e0 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:12.909259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-3bbe7aad-8932-4f41-9e8d-dfdd085b31e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:12.975796 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 521/1022] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:13.244211 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ee271-e356-4bfe-ab03-898ff7e8a0b4 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:13.277879 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:13.356231 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ee271-e356-4bfe-ab03-898ff7e8a0b4 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:13.390265 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cc19f-d2f2-45c5-8e8d-dc9fb80a7640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:13.390913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cc19f-d2f2-45c5-8e8d-dc9fb80a7640 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:13.391192 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cc19f-d2f2-45c5-8e8d-dc9fb80a7640 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:13.391463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cc19f-d2f2-45c5-8e8d-dc9fb80a7640 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:13.404171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cc19f-d2f2-45c5-8e8d-dc9fb80a7640 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:24:13.409102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-c90cc19f-d2f2-45c5-8e8d-dc9fb80a7640 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 01:24:13.409102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:13.409102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:13.409102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:13.409102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:13.409102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:13.409102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:13.409102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:13.409102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:13.409102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:13.409102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:13.409102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:13.409102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:24:13.409102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:24:13.409102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:24:13.409102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:24:13.410088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:24:13.410088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:24:13.410088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:24:13.410088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:24:13.410088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:13.410088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:13.410088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:13.410088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:13.410088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:13.410088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:13.410088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:13.410088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:13.410088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:13.410088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:13.410088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:13.410088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:13.410984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:13.410984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:13.410984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:13.410984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:13.410984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:24:13.410984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:24:13.410984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:24:13.410984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:24:13.410984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:24:13.410984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:24:13.410984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 01:24:13.410984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:13.410984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 502/1023] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Sep 26 01:24:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:13.416985 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe7aad-8932-4f41-9e8d-dfdd085b31e0 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:13.515468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe7aad-8932-4f41-9e8d-dfdd085b31e0 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:13.531563 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:13.551235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df562f4-5bf6-4538-86e8-a7fd8f31cebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:13.551839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df562f4-5bf6-4538-86e8-a7fd8f31cebd None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:13.552117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df562f4-5bf6-4538-86e8-a7fd8f31cebd None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:13.552389 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df562f4-5bf6-4538-86e8-a7fd8f31cebd None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:13.553044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df562f4-5bf6-4538-86e8-a7fd8f31cebd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:13.553347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df562f4-5bf6-4538-86e8-a7fd8f31cebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:13.554692 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df562f4-5bf6-4538-86e8-a7fd8f31cebd None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:13.563490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 522/1024] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 26 01:24:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:13.569160 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cc19f-d2f2-45c5-8e8d-dc9fb80a7640 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:13.665576 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:13.676692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cc19f-d2f2-45c5-8e8d-dc9fb80a7640 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:13.712085 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a18f6-1dd8-41c2-a3dc-f450cda3c036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:13.712770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a18f6-1dd8-41c2-a3dc-f450cda3c036 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:13.713053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a18f6-1dd8-41c2-a3dc-f450cda3c036 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:13.713377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a18f6-1dd8-41c2-a3dc-f450cda3c036 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:13.724692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a18f6-1dd8-41c2-a3dc-f450cda3c036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:13.726194 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a18f6-1dd8-41c2-a3dc-f450cda3c036 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:13.740601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-c08a18f6-1dd8-41c2-a3dc-f450cda3c036 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:13.740601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:13.740601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:13.740601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:13.740601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:13.740601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:13.740601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:13.740601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:13.740601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:13.740601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:13.740601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:13.740601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:13.740601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:24:13.740601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:24:13.740601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:24:13.740601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:24:13.741553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:13.741553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:13.741553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:13.741553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:13.741553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:13.741553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:13.741553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:13.741553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:13.741553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:13.741553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:13.741553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:13.741553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:13.741553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:13.741553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:13.741553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:13.741553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:13.741553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:24:13.747118 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:24:13.747118 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:13.747118 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:13.747118 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 503/1025] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:13.748970 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df562f4-5bf6-4538-86e8-a7fd8f31cebd None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:13.851108 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df562f4-5bf6-4538-86e8-a7fd8f31cebd None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:13.884112 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdeb55-c5b1-42e6-90a3-17cf4f98b61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:13.884707 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdeb55-c5b1-42e6-90a3-17cf4f98b61b None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:13.884985 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdeb55-c5b1-42e6-90a3-17cf4f98b61b None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:13.885254 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdeb55-c5b1-42e6-90a3-17cf4f98b61b None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:13.885884 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdeb55-c5b1-42e6-90a3-17cf4f98b61b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:13.886288 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdeb55-c5b1-42e6-90a3-17cf4f98b61b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:13.887661 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdeb55-c5b1-42e6-90a3-17cf4f98b61b None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:13.899987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 523/1026] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:13.905447 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a18f6-1dd8-41c2-a3dc-f450cda3c036 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:14.005875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a18f6-1dd8-41c2-a3dc-f450cda3c036 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:14.039629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c3fe7-f6bd-4b4d-bbef-dfdd8d818f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:14.040257 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c3fe7-f6bd-4b4d-bbef-dfdd8d818f60 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:14.040537 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c3fe7-f6bd-4b4d-bbef-dfdd8d818f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:14.040808 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c3fe7-f6bd-4b4d-bbef-dfdd8d818f60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:14.048924 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c3fe7-f6bd-4b4d-bbef-dfdd8d818f60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:14.050363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c3fe7-f6bd-4b4d-bbef-dfdd8d818f60 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:14.061506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-7a2c3fe7-f6bd-4b4d-bbef-dfdd8d818f60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 01:24:14.061506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:14.061506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:14.061506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:14.061506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:14.061506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:14.061506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:14.061506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:14.061506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:14.061506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:14.061506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:14.061506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:14.061506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:24:14.061506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:24:14.061506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:24:14.061506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:24:14.063195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:14.063195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:14.063195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:24:14.063195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:24:14.063195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:24:14.063195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:24:14.063195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:14.063195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:14.063195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:14.063195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:14.063195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:14.063195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:14.063195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:14.063195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:14.063195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:14.063195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:14.063195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:14.063195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:14.064157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:14.064157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:14.064157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:24:14.064157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:24:14.064157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:24:14.064157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:24:14.064157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:24:14.064157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:24:14.064157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 01:24:14.064157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:14.067126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 504/1027] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 26 01:24:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:14.068523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdeb55-c5b1-42e6-90a3-17cf4f98b61b None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:14.110539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:14.170850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdeb55-c5b1-42e6-90a3-17cf4f98b61b None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:14.206075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6861e-126a-4a4f-a0f6-2dba5ca4c95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:14.206678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6861e-126a-4a4f-a0f6-2dba5ca4c95d None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:14.206998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6861e-126a-4a4f-a0f6-2dba5ca4c95d None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:14.207273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6861e-126a-4a4f-a0f6-2dba5ca4c95d None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:14.207995 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6861e-126a-4a4f-a0f6-2dba5ca4c95d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:14.208299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6861e-126a-4a4f-a0f6-2dba5ca4c95d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:14.209709 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6861e-126a-4a4f-a0f6-2dba5ca4c95d None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:14.227412 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 524/1028] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 26 01:24:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:14.233008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c3fe7-f6bd-4b4d-bbef-dfdd8d818f60 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:14.237641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:14.334810 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c3fe7-f6bd-4b4d-bbef-dfdd8d818f60 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:14.369016 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cf542-7f05-4436-82bf-0e85a84e82ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:14.369542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cf542-7f05-4436-82bf-0e85a84e82ed None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:14.369823 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cf542-7f05-4436-82bf-0e85a84e82ed None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:14.370098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cf542-7f05-4436-82bf-0e85a84e82ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:14.450365 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cf542-7f05-4436-82bf-0e85a84e82ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:14.451932 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cf542-7f05-4436-82bf-0e85a84e82ed None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:14.456494 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:14.550501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4957252-abab-4419-b6f0-7e44c2aee3f1 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:14.550775 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4957252-abab-4419-b6f0-7e44c2aee3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:14.551072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4957252-abab-4419-b6f0-7e44c2aee3f1 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:14.552561 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 525/1029] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:24:14.557256 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f518f-9453-43d3-8deb-e890d4e1b0c9 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:14.557537 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f518f-9453-43d3-8deb-e890d4e1b0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:14.557811 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f518f-9453-43d3-8deb-e890d4e1b0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:14.564310 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 505/1030] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:24:14 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 01:24:14.566034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cf542-7f05-4436-82bf-0e85a84e82ed None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:14.576232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-847f518f-9453-43d3-8deb-e890d4e1b0c9 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:14.577435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-847f518f-9453-43d3-8deb-e890d4e1b0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:14.645666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 526/1031] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 01:24:14.646808 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad761aba-be2c-42b0-a8cf-1132f08d68fb None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:14.647141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad761aba-be2c-42b0-a8cf-1132f08d68fb None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:14.647393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad761aba-be2c-42b0-a8cf-1132f08d68fb None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:14.648608 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 527/1032] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:14.656345 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e1d63-b401-40e4-91df-9fdbf8469c50 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:14.656678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e1d63-b401-40e4-91df-9fdbf8469c50 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:14.656954 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e1d63-b401-40e4-91df-9fdbf8469c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:14.664380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cf542-7f05-4436-82bf-0e85a84e82ed None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:14.666770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:14.677091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-366e1d63-b401-40e4-91df-9fdbf8469c50 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:14.678282 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-366e1d63-b401-40e4-91df-9fdbf8469c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:14.699198 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:14.703539 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b56e82-4011-4444-9fc9-cd2d06391f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:14.704213 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b56e82-4011-4444-9fc9-cd2d06391f60 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:14.704493 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b56e82-4011-4444-9fc9-cd2d06391f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:14.704759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b56e82-4011-4444-9fc9-cd2d06391f60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:14.715168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b56e82-4011-4444-9fc9-cd2d06391f60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:14.716606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b56e82-4011-4444-9fc9-cd2d06391f60 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:14.735251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-08b56e82-4011-4444-9fc9-cd2d06391f60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:14.735251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:14.735251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:14.735251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:14.735251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:14.735251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:14.735251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:14.735251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:14.735251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:14.735251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:14.735251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:14.735251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:14.735251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:24:14.735251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:24:14.735251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:24:14.735251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:24:14.736472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:14.736472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:14.736472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:14.736472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:14.736472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:14.736472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:14.736472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:14.736472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:14.736472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:14.736472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:14.736472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:14.736472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:14.736472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:14.736472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:14.736472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:14.736472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:14.736472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:24:14.737417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:24:14.737417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:14.737417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:14.737417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 506/1033] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:24:14.741821 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b56e82-4011-4444-9fc9-cd2d06391f60 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:14.755987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 528/1034] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 01:24:14.840718 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b56e82-4011-4444-9fc9-cd2d06391f60 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:14.873847 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf7380-0a08-423c-9e5b-00051a394ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:14.875051 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf7380-0a08-423c-9e5b-00051a394ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:14.875329 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf7380-0a08-423c-9e5b-00051a394ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:14.875599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf7380-0a08-423c-9e5b-00051a394ff8 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:14.876222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf7380-0a08-423c-9e5b-00051a394ff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:14.876521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf7380-0a08-423c-9e5b-00051a394ff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:14.877876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf7380-0a08-423c-9e5b-00051a394ff8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:14.889581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 507/1035] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:24:14.895063 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e1d63-b401-40e4-91df-9fdbf8469c50 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:14.919404 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf7380-0a08-423c-9e5b-00051a394ff8 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:14.939175 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:15.000626 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e1d63-b401-40e4-91df-9fdbf8469c50 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:15.023197 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf7380-0a08-423c-9e5b-00051a394ff8 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:15.035829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431c75c-76c9-4dd2-b596-f5412557ce21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:15.036454 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431c75c-76c9-4dd2-b596-f5412557ce21 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:15.036729 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431c75c-76c9-4dd2-b596-f5412557ce21 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:15.036997 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431c75c-76c9-4dd2-b596-f5412557ce21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:15.043674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431c75c-76c9-4dd2-b596-f5412557ce21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:15.045084 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431c75c-76c9-4dd2-b596-f5412557ce21 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:15.056655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-0431c75c-76c9-4dd2-b596-f5412557ce21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:24:15.056655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:15.056655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:15.056655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:15.056655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:15.056655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:15.056655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:15.056655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:15.056655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:15.056655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:15.056655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:15.056655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:15.056655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:24:15.056655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:24:15.056655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:24:15.057611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:24:15.057611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:15.057611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:15.057611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:15.057611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:15.057611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:15.057611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:15.057611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:15.057611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:15.057611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:15.057611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:15.057611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:15.057611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:15.057611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:15.057611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:15.057611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:15.057611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:15.058518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:24:15.058518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:24:15.058518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:24:15.058518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:24:15.058518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:24:15.058518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:24:15.058518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:24:15.058518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:15.058984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d305ae3-5c55-4b2a-8e29-e95818e14a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:15.058984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d305ae3-5c55-4b2a-8e29-e95818e14a9e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:15.059129 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 529/1036] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:24:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:15.059211 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d305ae3-5c55-4b2a-8e29-e95818e14a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:15.059211 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d305ae3-5c55-4b2a-8e29-e95818e14a9e None admin] PATH_INFO: `/v3/services/image` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:15.059211 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d305ae3-5c55-4b2a-8e29-e95818e14a9e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:15.059849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431c75c-76c9-4dd2-b596-f5412557ce21 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:15.060251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d305ae3-5c55-4b2a-8e29-e95818e14a9e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:15.070126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-7d305ae3-5c55-4b2a-8e29-e95818e14a9e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 01:24:15.070126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:15.070126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:24:15.070126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:24:15.070126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:24:15.070126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:24:15.070126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:24:15.070126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:24:15.070126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 01:24:15.070126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:15.070126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:24:15.070126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:15.070126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:15.070126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:15.070126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:15.070126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:15.070126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:15.071654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:15.071654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:15.071654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:15.071654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:15.071654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:15.071654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:15.071654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:24:15.071654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:24:15.071654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:24:15.071654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:24:15.071654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:15.071654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:15.071654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:15.071654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:15.071654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:15.071654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:15.072632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:15.072632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:15.072632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:15.072632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:15.072632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:15.072632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:15.072632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:15.072632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:15.072632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:15.072632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:15.072632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:24:15.072632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:24:15.072632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 01:24:15.072632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:15.074977 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 508/1037] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Sep 26 01:24:14 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:24:15.075912 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d305ae3-5c55-4b2a-8e29-e95818e14a9e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:15.079471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:15.155756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:15.161483 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431c75c-76c9-4dd2-b596-f5412557ce21 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:15.174534 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d305ae3-5c55-4b2a-8e29-e95818e14a9e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:15.195824 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50faab34-a18a-47e7-95ab-b5859a784d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:15.196442 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faab34-a18a-47e7-95ab-b5859a784d00 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:15.196723 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faab34-a18a-47e7-95ab-b5859a784d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:15.197000 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faab34-a18a-47e7-95ab-b5859a784d00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:15.198110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50faab34-a18a-47e7-95ab-b5859a784d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:15.199562 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50faab34-a18a-47e7-95ab-b5859a784d00 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:15.201129 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 530/1038] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:15.201879 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50faab34-a18a-47e7-95ab-b5859a784d00 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:15.208140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5db09-df4e-4e2f-a3cf-c8d6d122d271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:15.208744 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5db09-df4e-4e2f-a3cf-c8d6d122d271 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:15.209024 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5db09-df4e-4e2f-a3cf-c8d6d122d271 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:15.209298 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5db09-df4e-4e2f-a3cf-c8d6d122d271 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:15.209980 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5db09-df4e-4e2f-a3cf-c8d6d122d271 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:15.210285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5db09-df4e-4e2f-a3cf-c8d6d122d271 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:15.211755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5db09-df4e-4e2f-a3cf-c8d6d122d271 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:15.224108 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 509/1039] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:24:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:15.224870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5db09-df4e-4e2f-a3cf-c8d6d122d271 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:15.291162 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:15.307686 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50faab34-a18a-47e7-95ab-b5859a784d00 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:15.324668 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5db09-df4e-4e2f-a3cf-c8d6d122d271 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:15.342219 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836f8da-568b-489d-be39-5816d2daceab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:15.342821 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836f8da-568b-489d-be39-5816d2daceab None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:15.343672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836f8da-568b-489d-be39-5816d2daceab None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:15.343943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836f8da-568b-489d-be39-5816d2daceab None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:15.344560 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836f8da-568b-489d-be39-5816d2daceab None admin] RBAC: Adding query filter params (name=image) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:15.344864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836f8da-568b-489d-be39-5816d2daceab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:15.346209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836f8da-568b-489d-be39-5816d2daceab None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:15.350928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 531/1040] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:15.350928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836f8da-568b-489d-be39-5816d2daceab None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:15.360804 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842c074-bd26-4ec7-ab31-cb4bc5be3727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:15.361409 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842c074-bd26-4ec7-ab31-cb4bc5be3727 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:15.361687 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842c074-bd26-4ec7-ab31-cb4bc5be3727 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:15.361961 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842c074-bd26-4ec7-ab31-cb4bc5be3727 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:15.362601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842c074-bd26-4ec7-ab31-cb4bc5be3727 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:15.364048 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842c074-bd26-4ec7-ab31-cb4bc5be3727 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:15.375311 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:15.387633 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 510/1041] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 26 01:24:15 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:24:15.388426 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842c074-bd26-4ec7-ab31-cb4bc5be3727 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:15.475185 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836f8da-568b-489d-be39-5816d2daceab None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:15.514285 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e2116-0d07-455c-b905-cbe41e549bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:15.515543 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e2116-0d07-455c-b905-cbe41e549bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:15.515977 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e2116-0d07-455c-b905-cbe41e549bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:15.516241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e2116-0d07-455c-b905-cbe41e549bc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:15.517004 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e2116-0d07-455c-b905-cbe41e549bc1 None admin] RBAC: Adding query filter params (role.id=1ce2279b741048d1a5abc82efefcdf15, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=3d6eaeb6bced49afabc7bdaa5e7cecfb) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:15.517318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e2116-0d07-455c-b905-cbe41e549bc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:15.518798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e2116-0d07-455c-b905-cbe41e549bc1 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:15.520462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842c074-bd26-4ec7-ab31-cb4bc5be3727 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:15.525191 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 532/1042] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:24:15 2022] GET /identity/v3/role_assignments?user.id=3d6eaeb6bced49afabc7bdaa5e7cecfb&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=1ce2279b741048d1a5abc82efefcdf15 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:15.569574 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb22de2-0889-4bd4-a97b-7998ad8b6e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:15.571309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb22de2-0889-4bd4-a97b-7998ad8b6e85 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:15.571593 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb22de2-0889-4bd4-a97b-7998ad8b6e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:15.571862 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb22de2-0889-4bd4-a97b-7998ad8b6e85 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:15.572506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb22de2-0889-4bd4-a97b-7998ad8b6e85 None admin] RBAC: Adding query filter params (type=image) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:15.572809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb22de2-0889-4bd4-a97b-7998ad8b6e85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:15.574201 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb22de2-0889-4bd4-a97b-7998ad8b6e85 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:15.581891 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 511/1043] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:15.587959 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e2116-0d07-455c-b905-cbe41e549bc1 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:15.605739 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:15.708798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e2116-0d07-455c-b905-cbe41e549bc1 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:15.743463 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38487c-6caa-41ff-80b1-ad2a752bcf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:15.743968 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38487c-6caa-41ff-80b1-ad2a752bcf5d None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:15.744246 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38487c-6caa-41ff-80b1-ad2a752bcf5d None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:15.744513 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38487c-6caa-41ff-80b1-ad2a752bcf5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:15.745205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38487c-6caa-41ff-80b1-ad2a752bcf5d None admin] RBAC: Adding query filter params (interface=public, service_id=b2e8d3aba019489c8a6bac7e7be8659a, region_id=RegionOne) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:15.745511 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38487c-6caa-41ff-80b1-ad2a752bcf5d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:15.746871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38487c-6caa-41ff-80b1-ad2a752bcf5d None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:15.752610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 533/1044] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 26 01:24:15 2022] GET /identity/v3/endpoints?service_id=b2e8d3aba019489c8a6bac7e7be8659a&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:15.758464 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb22de2-0889-4bd4-a97b-7998ad8b6e85 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:15.819210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:15.862952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb22de2-0889-4bd4-a97b-7998ad8b6e85 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:15.899761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675bb75-b440-41d2-9024-294b7bd47d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:15.900364 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675bb75-b440-41d2-9024-294b7bd47d1b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:15.900639 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675bb75-b440-41d2-9024-294b7bd47d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:15.900905 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675bb75-b440-41d2-9024-294b7bd47d1b None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:15.901494 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675bb75-b440-41d2-9024-294b7bd47d1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:15.902855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675bb75-b440-41d2-9024-294b7bd47d1b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:15.918914 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 512/1045] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 26 01:24:15 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:24:17.656504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9429c-3cda-43fa-a522-89146834547d None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:17.657017 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9429c-3cda-43fa-a522-89146834547d None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:17.657094 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9429c-3cda-43fa-a522-89146834547d None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:17.658595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 534/1046] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:17.663725 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4f651-9085-46a2-80e5-bca5ed6ddc6f None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:17.664114 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4f651-9085-46a2-80e5-bca5ed6ddc6f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:17.664279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4f651-9085-46a2-80e5-bca5ed6ddc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:17.669904 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99755674-a83e-487e-8cdc-825b2f4d1266 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:17.670191 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99755674-a83e-487e-8cdc-825b2f4d1266 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:17.670468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99755674-a83e-487e-8cdc-825b2f4d1266 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:17.673217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 535/1047] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:24:17.678323 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fee525-c69d-4bc1-ae48-b9dfe3ff63c0 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:17.678604 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fee525-c69d-4bc1-ae48-b9dfe3ff63c0 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:17.678913 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fee525-c69d-4bc1-ae48-b9dfe3ff63c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:17.683262 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-6bd4f651-9085-46a2-80e5-bca5ed6ddc6f None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:17.684470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6bd4f651-9085-46a2-80e5-bca5ed6ddc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:17.697103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-e6fee525-c69d-4bc1-ae48-b9dfe3ff63c0 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:17.698272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e6fee525-c69d-4bc1-ae48-b9dfe3ff63c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:17.755073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 513/1048] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:17.771606 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 536/1049] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 01:24:18.024191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4f651-9085-46a2-80e5-bca5ed6ddc6f None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:18.045446 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fee525-c69d-4bc1-ae48-b9dfe3ff63c0 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:18.053911 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:18.081272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:18.126965 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4f651-9085-46a2-80e5-bca5ed6ddc6f None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:18.150209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fee525-c69d-4bc1-ae48-b9dfe3ff63c0 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:18.160436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f59f7-7b54-4ddc-9c52-29e20486f1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:18.161062 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f59f7-7b54-4ddc-9c52-29e20486f1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:18.161335 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f59f7-7b54-4ddc-9c52-29e20486f1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:18.161602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f59f7-7b54-4ddc-9c52-29e20486f1b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:18.172329 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f59f7-7b54-4ddc-9c52-29e20486f1b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:24:18.177094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-714f59f7-7b54-4ddc-9c52-29e20486f1b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:24:18.177094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:18.177094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:18.177094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:18.177094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:18.177094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:18.177094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:18.177094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:18.177094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:18.177094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:18.177094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:18.177094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:18.177094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:24:18.177094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:24:18.177094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:24:18.177094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:24:18.178073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:24:18.178073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:24:18.178073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:24:18.178073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:24:18.178073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:18.178073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:18.178073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:18.178073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:18.178073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:18.178073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:18.178073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:18.178073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:18.178073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:18.178073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:18.178073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:18.178073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:18.178973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:18.178973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:18.178973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:18.178973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:18.178973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:24:18.178973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:24:18.178973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:24:18.178973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:24:18.178973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:24:18.178973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:24:18.178973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:24:18.178973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:18.178973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 514/1050] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:24:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:18.179701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b4c71-e3bc-4c06-bd45-d93d5f2c3115 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:18.180010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b4c71-e3bc-4c06-bd45-d93d5f2c3115 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:18.180241 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b4c71-e3bc-4c06-bd45-d93d5f2c3115 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:18.181940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 515/1051] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:18.187435 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b4c71-e3bc-4c06-bd45-d93d5f2c3115 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:18.189300 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046337d-4f4a-4537-bebb-96194a89ff48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:18.189933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046337d-4f4a-4537-bebb-96194a89ff48 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:18.190216 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046337d-4f4a-4537-bebb-96194a89ff48 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:18.190490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046337d-4f4a-4537-bebb-96194a89ff48 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:18.200937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046337d-4f4a-4537-bebb-96194a89ff48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:24:18.206292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-1046337d-4f4a-4537-bebb-96194a89ff48 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 01:24:18.206292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:18.206292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:18.206292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:18.206292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:18.206292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:18.206292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:18.206292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:18.206292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:18.206292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:18.206292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:18.206292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:18.206292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:24:18.206292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:24:18.206292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:24:18.206292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:24:18.207486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:24:18.207486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:24:18.207486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:24:18.207486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:24:18.207486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:18.207486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:18.207486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:18.207486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:18.207486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:18.207486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:18.207486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:18.207486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:18.207486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:18.207486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:18.207486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:18.207486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:18.208350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:18.208350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:18.208350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:18.208350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:18.208350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:24:18.208350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:24:18.208350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:24:18.208350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:24:18.208350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:24:18.208350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:24:18.208350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 01:24:18.208350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:18.208350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 537/1052] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Sep 26 01:24:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:18.209041 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27ca14-b0eb-4181-aeed-f41155a40e41 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:18.209041 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27ca14-b0eb-4181-aeed-f41155a40e41 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:18.209041 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27ca14-b0eb-4181-aeed-f41155a40e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:18.226505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-9c27ca14-b0eb-4181-aeed-f41155a40e41 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:18.227723 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-9c27ca14-b0eb-4181-aeed-f41155a40e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:18.287285 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:18.290724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b4c71-e3bc-4c06-bd45-d93d5f2c3115 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:18.294899 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 538/1053] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:18.295850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27ca14-b0eb-4181-aeed-f41155a40e41 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:18.319946 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:18.345295 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be10f9-bb57-448e-9735-a6a25f7ebb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:18.345903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be10f9-bb57-448e-9735-a6a25f7ebb53 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:18.346168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be10f9-bb57-448e-9735-a6a25f7ebb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:18.346438 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be10f9-bb57-448e-9735-a6a25f7ebb53 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:18.347131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be10f9-bb57-448e-9735-a6a25f7ebb53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:18.347429 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be10f9-bb57-448e-9735-a6a25f7ebb53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:18.348785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be10f9-bb57-448e-9735-a6a25f7ebb53 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:18.362305 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 516/1054] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:24:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:18.363316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be10f9-bb57-448e-9735-a6a25f7ebb53 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:18.410922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27ca14-b0eb-4181-aeed-f41155a40e41 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:18.448741 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f51d0-3f78-4486-864a-1414dc9f2fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:18.450012 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f51d0-3f78-4486-864a-1414dc9f2fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:18.450293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f51d0-3f78-4486-864a-1414dc9f2fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:18.450564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f51d0-3f78-4486-864a-1414dc9f2fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:18.451616 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f51d0-3f78-4486-864a-1414dc9f2fb7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:18.451924 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f51d0-3f78-4486-864a-1414dc9f2fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:18.454269 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f51d0-3f78-4486-864a-1414dc9f2fb7 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:18.462506 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 539/1055] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 26 01:24:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:18.468737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f51d0-3f78-4486-864a-1414dc9f2fb7 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:18.478666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be10f9-bb57-448e-9735-a6a25f7ebb53 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:18.514528 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f63c6-2140-4dbf-9ec7-c3d81cbc93e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:18.516006 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f63c6-2140-4dbf-9ec7-c3d81cbc93e8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:18.516434 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f63c6-2140-4dbf-9ec7-c3d81cbc93e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:18.516703 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f63c6-2140-4dbf-9ec7-c3d81cbc93e8 None admin] PATH_INFO: `/v3/users/d07653e8d0a9411f9e7fa7d2242aa701` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:18.530318 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f63c6-2140-4dbf-9ec7-c3d81cbc93e8 None admin] RBAC: Authorizing `identity:get_user(user_id=d07653e8d0a9411f9e7fa7d2242aa701)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:18.531545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:18.532774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f63c6-2140-4dbf-9ec7-c3d81cbc93e8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:18.534691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 517/1056] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:24:18 2022] GET /identity/v3/users/d07653e8d0a9411f9e7fa7d2242aa701 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:18.540389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f63c6-2140-4dbf-9ec7-c3d81cbc93e8 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:18.574904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:18.579920 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f51d0-3f78-4486-864a-1414dc9f2fb7 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:18.613950 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0a107-fc61-4290-a540-0e449e4ce8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:18.614564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0a107-fc61-4290-a540-0e449e4ce8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:18.614891 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0a107-fc61-4290-a540-0e449e4ce8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:18.615168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0a107-fc61-4290-a540-0e449e4ce8e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:18.626090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0a107-fc61-4290-a540-0e449e4ce8e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:18.627617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0a107-fc61-4290-a540-0e449e4ce8e4 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:18.639525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f63c6-2140-4dbf-9ec7-c3d81cbc93e8 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:18.641693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-20b0a107-fc61-4290-a540-0e449e4ce8e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:18.641693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:18.641693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:18.641693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:18.641693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:18.641693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:18.641693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:18.641693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:18.641693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:18.641693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:18.641693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:18.641693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:18.641693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:24:18.641693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:24:18.641693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:24:18.641693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:24:18.642640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:18.642640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:18.642640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:18.642640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:18.642640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:18.642640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:18.642640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:18.642640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:18.642640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:18.642640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:18.642640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:18.642640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:18.642640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:18.642640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:18.642640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:18.642640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:18.642640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:24:18.643592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:24:18.643592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:18.643592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:18.643592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 540/1057] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:24:18.643592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0a107-fc61-4290-a540-0e449e4ce8e4 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:18.677935 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269e2b7-fdd2-4832-ab7e-6d436e32818c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:18.678638 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269e2b7-fdd2-4832-ab7e-6d436e32818c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:18.678946 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269e2b7-fdd2-4832-ab7e-6d436e32818c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:18.679217 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269e2b7-fdd2-4832-ab7e-6d436e32818c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:18.745793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0a107-fc61-4290-a540-0e449e4ce8e4 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:18.746469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269e2b7-fdd2-4832-ab7e-6d436e32818c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:18.748103 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269e2b7-fdd2-4832-ab7e-6d436e32818c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:18.756711 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:18.780116 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:18.782017 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e0334-a6b6-4d63-a627-e4d38768c2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:18.782773 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e0334-a6b6-4d63-a627-e4d38768c2fe None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:18.783225 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e0334-a6b6-4d63-a627-e4d38768c2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:18.783503 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e0334-a6b6-4d63-a627-e4d38768c2fe None admin] PATH_INFO: `/v3/services/image` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:18.784084 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e0334-a6b6-4d63-a627-e4d38768c2fe None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:18.785416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e0334-a6b6-4d63-a627-e4d38768c2fe None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:18.793938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-495e0334-a6b6-4d63-a627-e4d38768c2fe None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 01:24:18.793938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:18.793938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:24:18.793938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:24:18.793938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:24:18.793938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:24:18.793938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:24:18.793938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:24:18.793938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 01:24:18.793938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:18.793938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:24:18.793938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:18.793938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:18.793938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:18.793938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:18.793938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:18.793938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:18.795133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:18.795133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:18.795133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:18.795133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:18.795133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:18.795133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:18.795133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:24:18.795133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:24:18.795133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:24:18.795133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:24:18.795133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:18.795133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:18.795133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:18.795133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:18.795133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:18.795133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:18.796568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:18.796568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:18.796568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:18.796568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:18.796568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:18.796568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:18.796568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:18.796568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:18.796568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:18.796568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:18.796568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:24:18.796568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:24:18.796568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 01:24:18.796568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:18.796568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 541/1058] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Sep 26 01:24:18 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:18.797397 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e0334-a6b6-4d63-a627-e4d38768c2fe None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:18.851095 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 518/1059] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:24:18 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 01:24:18.851922 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269e2b7-fdd2-4832-ab7e-6d436e32818c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:18.898059 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e0334-a6b6-4d63-a627-e4d38768c2fe None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:18.930912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f881dec-534a-4c50-9ac2-186d6b61e22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:18.931724 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f881dec-534a-4c50-9ac2-186d6b61e22b None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:18.932008 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f881dec-534a-4c50-9ac2-186d6b61e22b None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:18.932284 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f881dec-534a-4c50-9ac2-186d6b61e22b None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:18.932920 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f881dec-534a-4c50-9ac2-186d6b61e22b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:18.933220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f881dec-534a-4c50-9ac2-186d6b61e22b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:18.934554 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f881dec-534a-4c50-9ac2-186d6b61e22b None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:18.946676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 542/1060] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:18.947489 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f881dec-534a-4c50-9ac2-186d6b61e22b None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:18.948078 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269e2b7-fdd2-4832-ab7e-6d436e32818c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:18.980222 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:18.984649 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca04ed-f34e-4a4d-9864-83fbef189e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:18.985257 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca04ed-f34e-4a4d-9864-83fbef189e51 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:18.985534 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca04ed-f34e-4a4d-9864-83fbef189e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:18.985806 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca04ed-f34e-4a4d-9864-83fbef189e51 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:18.986430 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca04ed-f34e-4a4d-9864-83fbef189e51 None admin] RBAC: Adding query filter params (name=image) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:18.986734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca04ed-f34e-4a4d-9864-83fbef189e51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:18.988119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca04ed-f34e-4a4d-9864-83fbef189e51 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:18.989160 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:18.995133 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 519/1061] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:18.995950 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca04ed-f34e-4a4d-9864-83fbef189e51 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:19.046127 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f881dec-534a-4c50-9ac2-186d6b61e22b None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:19.080790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82388a3f-0917-4392-be0f-4d74fbe0c130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:19.081485 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82388a3f-0917-4392-be0f-4d74fbe0c130 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:19.081834 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82388a3f-0917-4392-be0f-4d74fbe0c130 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:19.082149 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82388a3f-0917-4392-be0f-4d74fbe0c130 None admin] PATH_INFO: `/v3/projects/f274190bc2974459828fa6b18aaf3d57` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:19.083429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82388a3f-0917-4392-be0f-4d74fbe0c130 None admin] RBAC: Authorizing `identity:get_project(project_id=f274190bc2974459828fa6b18aaf3d57)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:19.084845 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82388a3f-0917-4392-be0f-4d74fbe0c130 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:19.091623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 543/1062] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:24:18 2022] GET /identity/v3/projects/f274190bc2974459828fa6b18aaf3d57 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:19.091623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82388a3f-0917-4392-be0f-4d74fbe0c130 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:19.096947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca04ed-f34e-4a4d-9864-83fbef189e51 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:19.131905 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d9a98-4044-4f9a-9910-bb7dc959fa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:19.132525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d9a98-4044-4f9a-9910-bb7dc959fa76 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:19.132803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d9a98-4044-4f9a-9910-bb7dc959fa76 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:19.133073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d9a98-4044-4f9a-9910-bb7dc959fa76 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:19.140052 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d9a98-4044-4f9a-9910-bb7dc959fa76 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:19.141668 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d9a98-4044-4f9a-9910-bb7dc959fa76 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:19.152929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-ef7d9a98-4044-4f9a-9910-bb7dc959fa76 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 01:24:19.152929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:19.152929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:19.152929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:19.152929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:19.152929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:19.152929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:19.152929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:19.152929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:19.152929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:19.152929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:19.152929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:19.152929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:24:19.152929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:24:19.152929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:24:19.152929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:24:19.154084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:19.154084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:19.154084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:24:19.154084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:24:19.154084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:24:19.154084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:24:19.154084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:19.154084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:19.154084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:19.154084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:19.154084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:19.154084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:19.154084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:19.154084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:19.154084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:19.154084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:19.154084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:19.154084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:19.155090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:19.155090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:19.155090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:24:19.155090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:24:19.155090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:24:19.155090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:24:19.155090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:24:19.155090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:24:19.155090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 01:24:19.155090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:19.155090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 520/1063] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 26 01:24:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:19.155090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d9a98-4044-4f9a-9910-bb7dc959fa76 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:19.190932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82388a3f-0917-4392-be0f-4d74fbe0c130 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:19.192470 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:19.212585 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:19.226606 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8a112-12a5-43d0-bc49-de3d3a6226d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:19.227237 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8a112-12a5-43d0-bc49-de3d3a6226d3 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:19.227511 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8a112-12a5-43d0-bc49-de3d3a6226d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:19.227779 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8a112-12a5-43d0-bc49-de3d3a6226d3 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:19.228401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8a112-12a5-43d0-bc49-de3d3a6226d3 None admin] RBAC: Adding query filter params (type=image) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:19.228701 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8a112-12a5-43d0-bc49-de3d3a6226d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:19.230041 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8a112-12a5-43d0-bc49-de3d3a6226d3 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:19.234865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 544/1064] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:19.235707 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8a112-12a5-43d0-bc49-de3d3a6226d3 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:19.259102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d9a98-4044-4f9a-9910-bb7dc959fa76 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:19.292747 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff2bf6-5063-490f-91aa-a4103aa56628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:19.293349 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff2bf6-5063-490f-91aa-a4103aa56628 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:19.293631 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff2bf6-5063-490f-91aa-a4103aa56628 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:19.293901 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff2bf6-5063-490f-91aa-a4103aa56628 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:19.294618 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff2bf6-5063-490f-91aa-a4103aa56628 None admin] RBAC: Adding query filter params (role.id=50adf18edc1a47b2bae0876828a88dbf, scope.project.id=f274190bc2974459828fa6b18aaf3d57, user.id=d07653e8d0a9411f9e7fa7d2242aa701) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:19.294953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff2bf6-5063-490f-91aa-a4103aa56628 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:19.296452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff2bf6-5063-490f-91aa-a4103aa56628 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:19.301588 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 521/1065] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:24:19 2022] GET /identity/v3/role_assignments?user.id=d07653e8d0a9411f9e7fa7d2242aa701&scope.project.id=f274190bc2974459828fa6b18aaf3d57&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:19.302332 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff2bf6-5063-490f-91aa-a4103aa56628 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:19.347948 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8a112-12a5-43d0-bc49-de3d3a6226d3 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:19.387746 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed3c46-4409-4205-9637-c9905a6a89d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:19.388363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed3c46-4409-4205-9637-c9905a6a89d0 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:19.388637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed3c46-4409-4205-9637-c9905a6a89d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:19.388908 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed3c46-4409-4205-9637-c9905a6a89d0 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:19.389645 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed3c46-4409-4205-9637-c9905a6a89d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:19.390491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed3c46-4409-4205-9637-c9905a6a89d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:19.394339 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed3c46-4409-4205-9637-c9905a6a89d0 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:19.417596 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 545/1066] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 26 01:24:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:19.418719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed3c46-4409-4205-9637-c9905a6a89d0 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:19.443101 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff2bf6-5063-490f-91aa-a4103aa56628 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:19.449762 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:19.469922 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:19.484395 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b66467-bdbb-4c49-bbe0-db52deb60bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:19.485012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b66467-bdbb-4c49-bbe0-db52deb60bc4 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:19.485297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b66467-bdbb-4c49-bbe0-db52deb60bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:19.485569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b66467-bdbb-4c49-bbe0-db52deb60bc4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:19.486238 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b66467-bdbb-4c49-bbe0-db52deb60bc4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:19.487636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b66467-bdbb-4c49-bbe0-db52deb60bc4 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:19.515386 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 522/1067] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:24:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:24:19.551797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed3c46-4409-4205-9637-c9905a6a89d0 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:19.597464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094a817-cd1e-495c-9246-fcc83c9ca596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:19.598127 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094a817-cd1e-495c-9246-fcc83c9ca596 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:19.598411 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094a817-cd1e-495c-9246-fcc83c9ca596 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:19.598681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094a817-cd1e-495c-9246-fcc83c9ca596 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:19.610111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094a817-cd1e-495c-9246-fcc83c9ca596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:19.611601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094a817-cd1e-495c-9246-fcc83c9ca596 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:19.628088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-c094a817-cd1e-495c-9246-fcc83c9ca596 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:19.628088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:19.628088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:19.628088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:19.628088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:19.628088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:19.628088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:19.628088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:19.628088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:19.628088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:19.628088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:19.628088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:19.628088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:24:19.628088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:24:19.628088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:24:19.628088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:24:19.629110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:19.629110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:19.629110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:19.629110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:19.629110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:19.629110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:19.629110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:19.629110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:19.629110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:19.629110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:19.629110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:19.629110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:19.629110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:19.629110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:19.629110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:19.629110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:19.629110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:24:19.630005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:24:19.630005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:19.630005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:19.630005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 546/1068] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:19.635289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b66467-bdbb-4c49-bbe0-db52deb60bc4 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:19.745301 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b66467-bdbb-4c49-bbe0-db52deb60bc4 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:19.784689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ca13c-a283-4dd0-a5b6-11c811eb40a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:19.785352 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ca13c-a283-4dd0-a5b6-11c811eb40a2 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:19.785632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ca13c-a283-4dd0-a5b6-11c811eb40a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:19.785902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ca13c-a283-4dd0-a5b6-11c811eb40a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:19.786597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ca13c-a283-4dd0-a5b6-11c811eb40a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:19.786932 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ca13c-a283-4dd0-a5b6-11c811eb40a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:19.788294 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ca13c-a283-4dd0-a5b6-11c811eb40a2 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:19.805392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 523/1069] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:19.806700 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094a817-cd1e-495c-9246-fcc83c9ca596 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:19.883936 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:19.916229 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094a817-cd1e-495c-9246-fcc83c9ca596 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:19.951206 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e92d17-46ed-4db6-9ddb-f26a296d6dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:19.951830 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e92d17-46ed-4db6-9ddb-f26a296d6dcf None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:19.952111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e92d17-46ed-4db6-9ddb-f26a296d6dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:19.952412 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e92d17-46ed-4db6-9ddb-f26a296d6dcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:19.959072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e92d17-46ed-4db6-9ddb-f26a296d6dcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:19.960500 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e92d17-46ed-4db6-9ddb-f26a296d6dcf None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:19.971589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-00e92d17-46ed-4db6-9ddb-f26a296d6dcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:24:19.971589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:19.971589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:19.971589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:19.971589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:19.971589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:19.971589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:19.971589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:19.971589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:19.971589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:19.971589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:19.971589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:19.971589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:24:19.971589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:24:19.971589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:24:19.972507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:24:19.972507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:19.972507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:19.972507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:19.972507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:19.972507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:19.972507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:19.972507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:19.972507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:19.972507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:19.972507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:19.972507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:19.972507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:19.972507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:19.972507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:19.972507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:19.972507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:19.978381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:24:19.978381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:24:19.978381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:24:19.978381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:24:19.978381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:24:19.978381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:24:19.978381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:24:19.978381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:19.978381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 547/1070] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:24:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:19.980517 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ca13c-a283-4dd0-a5b6-11c811eb40a2 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:20.024709 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:20.091207 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ca13c-a283-4dd0-a5b6-11c811eb40a2 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:20.130331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320f138-9784-4d31-8a0e-f30f27fc8766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:20.131012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320f138-9784-4d31-8a0e-f30f27fc8766 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:20.131681 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320f138-9784-4d31-8a0e-f30f27fc8766 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:20.132435 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320f138-9784-4d31-8a0e-f30f27fc8766 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:20.133144 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320f138-9784-4d31-8a0e-f30f27fc8766 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:20.133456 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320f138-9784-4d31-8a0e-f30f27fc8766 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:20.134913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320f138-9784-4d31-8a0e-f30f27fc8766 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:20.156658 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 524/1071] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:24:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:20.158793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e92d17-46ed-4db6-9ddb-f26a296d6dcf None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:20.267393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e92d17-46ed-4db6-9ddb-f26a296d6dcf None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:20.297441 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:20.303731 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b4969-50b9-4928-bdeb-a36b0f32e744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:20.304432 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b4969-50b9-4928-bdeb-a36b0f32e744 None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:20.304712 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b4969-50b9-4928-bdeb-a36b0f32e744 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:20.304982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b4969-50b9-4928-bdeb-a36b0f32e744 None admin] PATH_INFO: `/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/3d6eaeb6bced49afabc7bdaa5e7cecfb/roles/1ce2279b741048d1a5abc82efefcdf15` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:20.307099 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b4969-50b9-4928-bdeb-a36b0f32e744 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fda1727cc3d47b9a1fae73c74f32c27, user_id=3d6eaeb6bced49afabc7bdaa5e7cecfb, role_id=1ce2279b741048d1a5abc82efefcdf15)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:20.308574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b4969-50b9-4928-bdeb-a36b0f32e744 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:20.322261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 548/1072] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:24:20 2022] PUT /identity/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/3d6eaeb6bced49afabc7bdaa5e7cecfb/roles/1ce2279b741048d1a5abc82efefcdf15 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:24:21.448869 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631ea06-6f34-43a6-8ca9-ece59ddd0aa6 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:21.449408 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631ea06-6f34-43a6-8ca9-ece59ddd0aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:21.449408 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631ea06-6f34-43a6-8ca9-ece59ddd0aa6 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:21.450821 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 525/1073] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:21.456502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fbdbc-beb9-48ab-be40-384eec066ec2 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:21.456916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fbdbc-beb9-48ab-be40-384eec066ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:21.457094 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fbdbc-beb9-48ab-be40-384eec066ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:21.476523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-5c1fbdbc-beb9-48ab-be40-384eec066ec2 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:21.477709 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-5c1fbdbc-beb9-48ab-be40-384eec066ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:21.547047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 549/1074] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:21.724777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5158c81-58b0-4f9e-814e-748e534191dc None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:21.725109 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5158c81-58b0-4f9e-814e-748e534191dc None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:21.725325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5158c81-58b0-4f9e-814e-748e534191dc None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:21.726766 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 526/1075] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:21.731676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bb7c1-383c-4161-b7f5-bd82f0f64377 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:21.731967 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bb7c1-383c-4161-b7f5-bd82f0f64377 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:21.732242 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bb7c1-383c-4161-b7f5-bd82f0f64377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:21.750876 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-2b1bb7c1-383c-4161-b7f5-bd82f0f64377 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:21.752042 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-2b1bb7c1-383c-4161-b7f5-bd82f0f64377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:21.815271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5158c81-58b0-4f9e-814e-748e534191dc None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:21.817182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 550/1076] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:21.918736 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:21.923674 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5158c81-58b0-4f9e-814e-748e534191dc None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:21.959308 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdab9b-bafb-4335-b4d3-568b7f9a1cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:21.959933 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdab9b-bafb-4335-b4d3-568b7f9a1cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:21.960213 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdab9b-bafb-4335-b4d3-568b7f9a1cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:21.960483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdab9b-bafb-4335-b4d3-568b7f9a1cf3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:21.971674 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdab9b-bafb-4335-b4d3-568b7f9a1cf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:24:21.976477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-a5bdab9b-bafb-4335-b4d3-568b7f9a1cf3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:24:21.976477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:21.976477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:21.976477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:21.976477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:21.976477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:21.976477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:21.976477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:21.976477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:21.976477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:21.976477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:21.976477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:21.976477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:24:21.976477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:24:21.976477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:24:21.976477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:24:21.977484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:24:21.977484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:24:21.977484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:24:21.977484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:24:21.977484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:21.977484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:21.977484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:21.977484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:21.977484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:21.977484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:21.977484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:21.977484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:21.977484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:21.977484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:21.977484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:21.977484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:21.980034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:21.980034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:21.980034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:21.980034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:21.980034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:24:21.980034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:24:21.980034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:24:21.980034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:24:21.980034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:24:21.980034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:24:21.980034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:24:21.980034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:21.980034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 527/1077] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:24:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:24:21.984061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bb7c1-383c-4161-b7f5-bd82f0f64377 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:22.037743 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:22.087951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bb7c1-383c-4161-b7f5-bd82f0f64377 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:22.090774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdab9b-bafb-4335-b4d3-568b7f9a1cf3 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:22.122041 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59df94-eeca-42f6-ad75-fef02769e0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:22.122641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59df94-eeca-42f6-ad75-fef02769e0db None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:22.122942 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59df94-eeca-42f6-ad75-fef02769e0db None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:22.123207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59df94-eeca-42f6-ad75-fef02769e0db None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:22.123863 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59df94-eeca-42f6-ad75-fef02769e0db None admin] RBAC: Adding query filter params (name=admin) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:22.124713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59df94-eeca-42f6-ad75-fef02769e0db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:22.126174 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59df94-eeca-42f6-ad75-fef02769e0db None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:22.134740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 551/1078] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:24:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:22.141246 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59df94-eeca-42f6-ad75-fef02769e0db None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:22.200071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdab9b-bafb-4335-b4d3-568b7f9a1cf3 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:22.237749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143b956-698c-4155-b84a-1050e56b7e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:22.238270 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143b956-698c-4155-b84a-1050e56b7e9b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:22.238547 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143b956-698c-4155-b84a-1050e56b7e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:22.240013 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143b956-698c-4155-b84a-1050e56b7e9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:22.250278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59df94-eeca-42f6-ad75-fef02769e0db None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:22.264240 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:22.270081 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:22.287795 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb81bdd-6675-49cb-973b-3bef76828986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:22.288418 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb81bdd-6675-49cb-973b-3bef76828986 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:22.288699 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb81bdd-6675-49cb-973b-3bef76828986 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:22.288972 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb81bdd-6675-49cb-973b-3bef76828986 None admin] PATH_INFO: `/v3/users/d07653e8d0a9411f9e7fa7d2242aa701` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:22.290100 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb81bdd-6675-49cb-973b-3bef76828986 None admin] RBAC: Authorizing `identity:get_user(user_id=d07653e8d0a9411f9e7fa7d2242aa701)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:22.291559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb81bdd-6675-49cb-973b-3bef76828986 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:22.293151 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 552/1079] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:24:22 2022] GET /identity/v3/users/d07653e8d0a9411f9e7fa7d2242aa701 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:24:22.298762 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb81bdd-6675-49cb-973b-3bef76828986 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:22.318191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143b956-698c-4155-b84a-1050e56b7e9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:22.319753 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143b956-698c-4155-b84a-1050e56b7e9b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:22.417179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb81bdd-6675-49cb-973b-3bef76828986 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:22.434804 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 528/1080] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:24:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 01:24:22.440538 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143b956-698c-4155-b84a-1050e56b7e9b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:22.453723 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89edda-95dc-44b5-b921-b459ffb79642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:22.454348 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89edda-95dc-44b5-b921-b459ffb79642 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:22.454738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89edda-95dc-44b5-b921-b459ffb79642 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:22.455038 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89edda-95dc-44b5-b921-b459ffb79642 None admin] PATH_INFO: `/v3/projects/f274190bc2974459828fa6b18aaf3d57` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:22.456148 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89edda-95dc-44b5-b921-b459ffb79642 None admin] RBAC: Authorizing `identity:get_project(project_id=f274190bc2974459828fa6b18aaf3d57)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:22.457559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89edda-95dc-44b5-b921-b459ffb79642 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:22.463841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 553/1081] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:24:22 2022] GET /identity/v3/projects/f274190bc2974459828fa6b18aaf3d57 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:24:22.464890 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89edda-95dc-44b5-b921-b459ffb79642 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:22.500546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:22.521881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:22.542554 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143b956-698c-4155-b84a-1050e56b7e9b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:22.573512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89edda-95dc-44b5-b921-b459ffb79642 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:22.576926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9580f-ea9a-45f1-88e4-89ed5ad69904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:22.578096 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9580f-ea9a-45f1-88e4-89ed5ad69904 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:22.578376 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9580f-ea9a-45f1-88e4-89ed5ad69904 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:22.578646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9580f-ea9a-45f1-88e4-89ed5ad69904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:22.588811 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9580f-ea9a-45f1-88e4-89ed5ad69904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:22.590249 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9580f-ea9a-45f1-88e4-89ed5ad69904 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:22.604883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-60e9580f-ea9a-45f1-88e4-89ed5ad69904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:22.604883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:22.604883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:22.604883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:22.604883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:22.604883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:22.604883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:22.604883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:22.604883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:22.604883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:22.604883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:22.604883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:22.604883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:24:22.604883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:24:22.604883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:24:22.604883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:24:22.606040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:22.606040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:22.606040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:22.606040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:22.606040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:22.606040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:22.606040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:22.606040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:22.606040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:22.606040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:22.606040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:22.606040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:22.606040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:22.606040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:22.606040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:22.606040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:22.606040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:24:22.607195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:24:22.607195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:22.607195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:22.607195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 529/1082] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:24:22.608251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dee343-73f0-42a6-a55e-855a59555296 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:22.608595 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dee343-73f0-42a6-a55e-855a59555296 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:22.609070 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dee343-73f0-42a6-a55e-855a59555296 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:22.609172 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec947bff-3b10-4b94-823b-16bdf7dbc088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:22.609803 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec947bff-3b10-4b94-823b-16bdf7dbc088 None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:22.610079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec947bff-3b10-4b94-823b-16bdf7dbc088 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:22.610347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec947bff-3b10-4b94-823b-16bdf7dbc088 None admin] PATH_INFO: `/v3/projects/f274190bc2974459828fa6b18aaf3d57/users/d07653e8d0a9411f9e7fa7d2242aa701/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:22.610602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 530/1083] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:22.612364 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dee343-73f0-42a6-a55e-855a59555296 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:22.612917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec947bff-3b10-4b94-823b-16bdf7dbc088 None admin] RBAC: Authorizing `identity:create_grant(project_id=f274190bc2974459828fa6b18aaf3d57, user_id=d07653e8d0a9411f9e7fa7d2242aa701, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:22.614532 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec947bff-3b10-4b94-823b-16bdf7dbc088 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:22.628469 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 554/1084] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:24:22 2022] PUT /identity/v3/projects/f274190bc2974459828fa6b18aaf3d57/users/d07653e8d0a9411f9e7fa7d2242aa701/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:24:22.639098 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dfe67-529f-4497-8b04-b652c721fa4a None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:22.639098 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dfe67-529f-4497-8b04-b652c721fa4a None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:22.639098 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dfe67-529f-4497-8b04-b652c721fa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:22.653773 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-d58dfe67-529f-4497-8b04-b652c721fa4a None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:22.655025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d58dfe67-529f-4497-8b04-b652c721fa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:22.727621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dee343-73f0-42a6-a55e-855a59555296 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:22.742860 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 555/1085] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:22.764787 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb43b5-0d75-418d-8b6e-dedbe12aba4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:22.765937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb43b5-0d75-418d-8b6e-dedbe12aba4b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:22.766225 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb43b5-0d75-418d-8b6e-dedbe12aba4b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:22.766504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb43b5-0d75-418d-8b6e-dedbe12aba4b None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:22.767338 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb43b5-0d75-418d-8b6e-dedbe12aba4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:22.767669 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb43b5-0d75-418d-8b6e-dedbe12aba4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:22.769092 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb43b5-0d75-418d-8b6e-dedbe12aba4b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:22.783140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 531/1086] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:22.783747 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:23.017178 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dfe67-529f-4497-8b04-b652c721fa4a None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:23.062715 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:23.124357 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dfe67-529f-4497-8b04-b652c721fa4a None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:23.158819 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1dea7-af28-42bb-bb41-26d1fefe19d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:23.159457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1dea7-af28-42bb-bb41-26d1fefe19d0 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:23.159730 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1dea7-af28-42bb-bb41-26d1fefe19d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:23.159995 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1dea7-af28-42bb-bb41-26d1fefe19d0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:23.169572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1dea7-af28-42bb-bb41-26d1fefe19d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:24:23.174318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-05d1dea7-af28-42bb-bb41-26d1fefe19d0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 01:24:23.174318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:23.174318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:23.174318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:23.174318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:23.174318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:23.174318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:23.174318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:23.174318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:23.174318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:23.174318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:23.174318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:23.174318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:24:23.174318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:24:23.174318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:24:23.174318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:24:23.175523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:24:23.175523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:24:23.175523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:24:23.175523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:24:23.175523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:23.175523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:23.175523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:23.175523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:23.175523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:23.175523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:23.175523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:23.175523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:23.175523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:23.175523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:23.175523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:23.175523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:23.176643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:23.176643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:23.176643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:23.176643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:23.176643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:24:23.176643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:24:23.176643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:24:23.176643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:24:23.176643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:24:23.176643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:24:23.176643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 01:24:23.176643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:23.178978 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 556/1087] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Sep 26 01:24:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:23.181299 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb43b5-0d75-418d-8b6e-dedbe12aba4b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:23.279202 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb43b5-0d75-418d-8b6e-dedbe12aba4b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:23.313374 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5b56e-f4cf-45dd-94d1-5b40deef8dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:23.313978 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5b56e-f4cf-45dd-94d1-5b40deef8dca None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:23.314258 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5b56e-f4cf-45dd-94d1-5b40deef8dca None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:23.314533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5b56e-f4cf-45dd-94d1-5b40deef8dca None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:23.315224 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5b56e-f4cf-45dd-94d1-5b40deef8dca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:23.315528 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5b56e-f4cf-45dd-94d1-5b40deef8dca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:23.316893 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5b56e-f4cf-45dd-94d1-5b40deef8dca None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:23.325047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 532/1088] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 26 01:24:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:23.331558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1dea7-af28-42bb-bb41-26d1fefe19d0 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:23.430617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:23.433789 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1dea7-af28-42bb-bb41-26d1fefe19d0 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:23.468183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736b1d4-c75f-4203-afbf-9584252e0b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:23.468925 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736b1d4-c75f-4203-afbf-9584252e0b22 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:23.469028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736b1d4-c75f-4203-afbf-9584252e0b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:23.469297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736b1d4-c75f-4203-afbf-9584252e0b22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:23.478932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736b1d4-c75f-4203-afbf-9584252e0b22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:23.480342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736b1d4-c75f-4203-afbf-9584252e0b22 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:23.494263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-a736b1d4-c75f-4203-afbf-9584252e0b22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:23.494263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:23.494263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:23.494263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:23.494263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:23.494263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:23.494263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:23.494263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:23.494263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:23.494263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:23.494263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:23.494263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:23.494263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:24:23.494263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:24:23.494263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:24:23.494263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:24:23.495371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:23.495371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:23.495371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:23.495371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:23.495371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:23.495371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:23.495371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:23.495371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:23.495371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:23.495371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:23.495371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:23.495371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:23.495371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:23.495371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:23.495371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:23.495371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:23.495371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:24:23.496293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:24:23.496293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:23.496293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:23.496293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 557/1089] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:23.501830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5b56e-f4cf-45dd-94d1-5b40deef8dca None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:23.534755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:23.602163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5b56e-f4cf-45dd-94d1-5b40deef8dca None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:23.635004 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5988617-ae1e-4d9c-aaf7-99f713237e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:23.635596 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5988617-ae1e-4d9c-aaf7-99f713237e1c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:23.635875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5988617-ae1e-4d9c-aaf7-99f713237e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:23.636150 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5988617-ae1e-4d9c-aaf7-99f713237e1c None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:23.636782 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5988617-ae1e-4d9c-aaf7-99f713237e1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:23.637085 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5988617-ae1e-4d9c-aaf7-99f713237e1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:23.638436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5988617-ae1e-4d9c-aaf7-99f713237e1c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:23.649936 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 533/1090] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:23.656947 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736b1d4-c75f-4203-afbf-9584252e0b22 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:23.754379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736b1d4-c75f-4203-afbf-9584252e0b22 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:23.786879 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752a6c7-558a-4b4f-a531-f4978b15a774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:23.787423 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752a6c7-558a-4b4f-a531-f4978b15a774 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:23.787700 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752a6c7-558a-4b4f-a531-f4978b15a774 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:23.787972 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752a6c7-558a-4b4f-a531-f4978b15a774 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:23.795158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752a6c7-558a-4b4f-a531-f4978b15a774 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:23.797292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752a6c7-558a-4b4f-a531-f4978b15a774 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:23.808030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-d752a6c7-558a-4b4f-a531-f4978b15a774 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 01:24:23.808030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:23.808030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:23.808030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:23.808030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:23.808030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:23.808030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:23.808030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:23.808030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:23.808030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:23.808030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:23.808030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:23.808030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:24:23.808030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:24:23.808030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:24:23.808030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:24:23.809167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:23.809167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:23.809167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:24:23.809167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:24:23.809167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:24:23.809167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:24:23.809167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:23.809167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:23.809167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:23.809167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:23.809167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:23.809167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:23.809167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:23.809167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:23.809167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:23.809167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:23.809167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:23.809167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:23.810635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:23.810635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:23.810635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:24:23.810635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:24:23.810635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:24:23.810635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:24:23.810635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:24:23.810635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:24:23.810635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 01:24:23.810635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:23.810635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 558/1091] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 26 01:24:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:23.815680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5988617-ae1e-4d9c-aaf7-99f713237e1c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:23.905981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:23.915395 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5988617-ae1e-4d9c-aaf7-99f713237e1c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:23.950653 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ac514-e8c4-4a7b-867d-3c2a164ff8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:23.951286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ac514-e8c4-4a7b-867d-3c2a164ff8bb None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:23.951569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ac514-e8c4-4a7b-867d-3c2a164ff8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:23.951847 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ac514-e8c4-4a7b-867d-3c2a164ff8bb None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:23.952710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ac514-e8c4-4a7b-867d-3c2a164ff8bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:23.953017 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ac514-e8c4-4a7b-867d-3c2a164ff8bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:23.954433 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ac514-e8c4-4a7b-867d-3c2a164ff8bb None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:23.971360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 534/1092] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 26 01:24:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:23.977238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752a6c7-558a-4b4f-a531-f4978b15a774 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:23.992784 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:24.075326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752a6c7-558a-4b4f-a531-f4978b15a774 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:24.107837 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f7123-5b87-4529-97d7-9d3a78f0dd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:24.108425 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f7123-5b87-4529-97d7-9d3a78f0dd39 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:24.109296 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f7123-5b87-4529-97d7-9d3a78f0dd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:24.109538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f7123-5b87-4529-97d7-9d3a78f0dd39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:24.172724 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f7123-5b87-4529-97d7-9d3a78f0dd39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:24.174141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f7123-5b87-4529-97d7-9d3a78f0dd39 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:24.187880 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:24.269909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 559/1093] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:24:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 01:24:24.275682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ac514-e8c4-4a7b-867d-3c2a164ff8bb None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:24.372965 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ac514-e8c4-4a7b-867d-3c2a164ff8bb None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:24.411552 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb72dd9-3f67-46d1-9d37-26188c94e32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:24.412197 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb72dd9-3f67-46d1-9d37-26188c94e32a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:24.412473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb72dd9-3f67-46d1-9d37-26188c94e32a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:24.412745 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb72dd9-3f67-46d1-9d37-26188c94e32a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:24.423622 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb72dd9-3f67-46d1-9d37-26188c94e32a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:24.425084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb72dd9-3f67-46d1-9d37-26188c94e32a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:24.440394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-eeb72dd9-3f67-46d1-9d37-26188c94e32a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:24.440394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:24.440394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:24.440394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:24.440394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:24.440394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:24.440394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:24.440394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:24.440394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:24.440394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:24.440394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:24.440394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:24.440394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:24:24.440394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:24:24.440394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:24:24.440394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:24:24.441345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:24.441345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:24.441345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:24.441345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:24.441345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:24.441345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:24.441345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:24.441345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:24.441345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:24.441345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:24.441345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:24.441345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:24.441345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:24.441345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:24.441345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:24.441345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:24.441345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:24:24.442231 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:24:24.442231 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:24:24.442231 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:24.442231 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 535/1094] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:24.447469 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f7123-5b87-4529-97d7-9d3a78f0dd39 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:24.541766 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f7123-5b87-4529-97d7-9d3a78f0dd39 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:24.554887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:24.575169 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645c641-2b4c-4b8a-8e6f-cf0e9ff60516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:24.575765 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645c641-2b4c-4b8a-8e6f-cf0e9ff60516 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:24.576037 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645c641-2b4c-4b8a-8e6f-cf0e9ff60516 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:24.576305 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645c641-2b4c-4b8a-8e6f-cf0e9ff60516 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:24.576931 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645c641-2b4c-4b8a-8e6f-cf0e9ff60516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:24.577745 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645c641-2b4c-4b8a-8e6f-cf0e9ff60516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:24.579205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645c641-2b4c-4b8a-8e6f-cf0e9ff60516 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:24.590113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 560/1095] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:24.596383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb72dd9-3f67-46d1-9d37-26188c94e32a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:24.599229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:24.700412 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb72dd9-3f67-46d1-9d37-26188c94e32a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:24.734676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb93cf-59da-45e2-9137-68464fb22185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:24.735605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb93cf-59da-45e2-9137-68464fb22185 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:24.735893 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb93cf-59da-45e2-9137-68464fb22185 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:24.736170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb93cf-59da-45e2-9137-68464fb22185 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:24.742751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb93cf-59da-45e2-9137-68464fb22185 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:24.744207 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb93cf-59da-45e2-9137-68464fb22185 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:24.755645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-a3cb93cf-59da-45e2-9137-68464fb22185 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:24:24.755645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:24.755645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:24.755645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:24.755645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:24.755645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:24.755645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:24.755645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:24.755645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:24.755645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:24.755645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:24.755645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:24.755645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:24:24.755645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:24:24.755645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:24:24.757566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:24:24.757566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:24.757566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:24.757566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:24.757566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:24.757566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:24.757566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:24.757566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:24.757566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:24.757566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:24.757566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:24.757566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:24.757566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:24.757566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:24.757566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:24.757566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:24.757566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:24.759820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:24:24.759820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:24:24.759820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:24:24.759820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:24:24.759820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:24:24.759820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:24:24.759820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:24:24.759820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:24.760983 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 536/1096] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:24:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:24:24.762609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645c641-2b4c-4b8a-8e6f-cf0e9ff60516 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:24.777228 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50222a6b-0fc6-4492-bb21-30faee4ee175 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:24.777512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50222a6b-0fc6-4492-bb21-30faee4ee175 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:24.777785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50222a6b-0fc6-4492-bb21-30faee4ee175 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:24.779254 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 537/1097] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:24:24.784813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a42f43-9668-4e1e-9c75-bfe3ed71ee6f None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:24.785092 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a42f43-9668-4e1e-9c75-bfe3ed71ee6f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:24.785364 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a42f43-9668-4e1e-9c75-bfe3ed71ee6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:24.803068 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-72a42f43-9668-4e1e-9c75-bfe3ed71ee6f None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:24.804246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-72a42f43-9668-4e1e-9c75-bfe3ed71ee6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:24.861046 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:24.870056 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645c641-2b4c-4b8a-8e6f-cf0e9ff60516 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:24.872274 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 538/1098] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 01:24:24.903523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41efe83-5ba2-40cb-a1c7-25a9afedaaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:24.904121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41efe83-5ba2-40cb-a1c7-25a9afedaaf2 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:24.904395 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41efe83-5ba2-40cb-a1c7-25a9afedaaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:24.904664 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41efe83-5ba2-40cb-a1c7-25a9afedaaf2 None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:24.905365 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41efe83-5ba2-40cb-a1c7-25a9afedaaf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:24.905674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41efe83-5ba2-40cb-a1c7-25a9afedaaf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:24.907120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41efe83-5ba2-40cb-a1c7-25a9afedaaf2 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:24.918517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 561/1099] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:24:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:24.924678 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a42f43-9668-4e1e-9c75-bfe3ed71ee6f None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:25.020723 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a42f43-9668-4e1e-9c75-bfe3ed71ee6f None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:25.052904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c2a52-f50e-47bf-ac8b-4eea5344fb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:25.053489 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c2a52-f50e-47bf-ac8b-4eea5344fb93 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:25.053761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c2a52-f50e-47bf-ac8b-4eea5344fb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:25.054030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c2a52-f50e-47bf-ac8b-4eea5344fb93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:25.054739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c2a52-f50e-47bf-ac8b-4eea5344fb93 None admin] RBAC: Adding query filter params (role.id=1ce2279b741048d1a5abc82efefcdf15, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=3d6eaeb6bced49afabc7bdaa5e7cecfb) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:25.055065 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c2a52-f50e-47bf-ac8b-4eea5344fb93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:25.056458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c2a52-f50e-47bf-ac8b-4eea5344fb93 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:25.062693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 539/1100] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:24:24 2022] GET /identity/v3/role_assignments?user.id=3d6eaeb6bced49afabc7bdaa5e7cecfb&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=1ce2279b741048d1a5abc82efefcdf15 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:24:25.145530 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41efe83-5ba2-40cb-a1c7-25a9afedaaf2 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:25.178894 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:25.253262 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41efe83-5ba2-40cb-a1c7-25a9afedaaf2 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:25.287929 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194c374-0f50-4e9c-af90-f345205b0aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:25.288478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194c374-0f50-4e9c-af90-f345205b0aaa None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:25.288761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194c374-0f50-4e9c-af90-f345205b0aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:25.289037 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194c374-0f50-4e9c-af90-f345205b0aaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:25.299861 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194c374-0f50-4e9c-af90-f345205b0aaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:24:25.304691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-5194c374-0f50-4e9c-af90-f345205b0aaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:24:25.304691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:25.304691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:25.304691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:25.304691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:25.304691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:25.304691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:25.304691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:25.304691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:25.304691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:25.304691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:25.304691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:25.304691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:24:25.304691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:24:25.304691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:24:25.304691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:24:25.305768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:24:25.305768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:24:25.305768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:24:25.305768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:24:25.305768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:25.305768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:25.305768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:25.305768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:25.305768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:25.305768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:25.305768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:25.305768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:25.305768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:25.305768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:25.305768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:25.305768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:25.306624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:25.306624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:25.306624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:25.306624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:25.306624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:24:25.306624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:24:25.306624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:24:25.306624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:24:25.306624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:24:25.306624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:24:25.306624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:24:25.306624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:25.306624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 562/1101] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:24:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:25.312641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c2a52-f50e-47bf-ac8b-4eea5344fb93 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:25.370397 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:25.420880 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c2a52-f50e-47bf-ac8b-4eea5344fb93 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:25.455428 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbe3ca-7ce0-472a-bc6d-912182c66144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:25.456035 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbe3ca-7ce0-472a-bc6d-912182c66144 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:25.456316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbe3ca-7ce0-472a-bc6d-912182c66144 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:25.456583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbe3ca-7ce0-472a-bc6d-912182c66144 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:25.457244 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbe3ca-7ce0-472a-bc6d-912182c66144 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:25.457537 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbe3ca-7ce0-472a-bc6d-912182c66144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:25.458912 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbe3ca-7ce0-472a-bc6d-912182c66144 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:25.467730 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 540/1102] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:24:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:24:25.473887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194c374-0f50-4e9c-af90-f345205b0aaa None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:25.588906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:25.599171 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194c374-0f50-4e9c-af90-f345205b0aaa None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:25.635561 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae92735-c42f-488e-880d-a9e585e9609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:25.636187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae92735-c42f-488e-880d-a9e585e9609b None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:25.636463 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae92735-c42f-488e-880d-a9e585e9609b None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:25.636730 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae92735-c42f-488e-880d-a9e585e9609b None admin] PATH_INFO: `/v3/users/d07653e8d0a9411f9e7fa7d2242aa701` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:25.637836 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae92735-c42f-488e-880d-a9e585e9609b None admin] RBAC: Authorizing `identity:get_user(user_id=d07653e8d0a9411f9e7fa7d2242aa701)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:25.639307 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae92735-c42f-488e-880d-a9e585e9609b None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:25.641127 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 563/1103] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:24:25 2022] GET /identity/v3/users/d07653e8d0a9411f9e7fa7d2242aa701 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:25.647212 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbe3ca-7ce0-472a-bc6d-912182c66144 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:25.749028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbe3ca-7ce0-472a-bc6d-912182c66144 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:25.768217 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:25.786216 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4b74b-38da-4421-9f46-a433c88226af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:25.786848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4b74b-38da-4421-9f46-a433c88226af None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:25.787184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4b74b-38da-4421-9f46-a433c88226af None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:25.787464 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4b74b-38da-4421-9f46-a433c88226af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:25.856215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4b74b-38da-4421-9f46-a433c88226af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:25.857579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4b74b-38da-4421-9f46-a433c88226af None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:25.957419 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 541/1104] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:24:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 01:24:25.963376 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae92735-c42f-488e-880d-a9e585e9609b None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:26.059202 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae92735-c42f-488e-880d-a9e585e9609b None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:26.092623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76534306-56c6-4db3-be63-f4ee4d7d4fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:26.093285 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76534306-56c6-4db3-be63-f4ee4d7d4fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:26.093560 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76534306-56c6-4db3-be63-f4ee4d7d4fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:26.093831 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76534306-56c6-4db3-be63-f4ee4d7d4fc4 None admin] PATH_INFO: `/v3/projects/f274190bc2974459828fa6b18aaf3d57` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:26.094973 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76534306-56c6-4db3-be63-f4ee4d7d4fc4 None admin] RBAC: Authorizing `identity:get_project(project_id=f274190bc2974459828fa6b18aaf3d57)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:26.096364 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76534306-56c6-4db3-be63-f4ee4d7d4fc4 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:26.097955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 564/1105] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:24:25 2022] GET /identity/v3/projects/f274190bc2974459828fa6b18aaf3d57 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:26.103994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4b74b-38da-4421-9f46-a433c88226af None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:26.122128 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:26.201150 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4b74b-38da-4421-9f46-a433c88226af None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:26.233147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40834209-867d-4027-91b0-104b94185bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:26.234257 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40834209-867d-4027-91b0-104b94185bba None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:26.234532 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40834209-867d-4027-91b0-104b94185bba None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:26.234804 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40834209-867d-4027-91b0-104b94185bba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:26.235546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40834209-867d-4027-91b0-104b94185bba None admin] RBAC: Adding query filter params (role.id=50adf18edc1a47b2bae0876828a88dbf, scope.project.id=f274190bc2974459828fa6b18aaf3d57, user.id=d07653e8d0a9411f9e7fa7d2242aa701) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:26.235851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40834209-867d-4027-91b0-104b94185bba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:26.237273 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40834209-867d-4027-91b0-104b94185bba None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:26.243130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 542/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:24:26 2022] GET /identity/v3/role_assignments?user.id=d07653e8d0a9411f9e7fa7d2242aa701&scope.project.id=f274190bc2974459828fa6b18aaf3d57&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:28.430620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc9cb8-532b-4812-812b-bcf2fc6a6f04 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:28.431100 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc9cb8-532b-4812-812b-bcf2fc6a6f04 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:28.431209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc9cb8-532b-4812-812b-bcf2fc6a6f04 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:28.432527 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 565/1107] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:28.438459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae5814-6d33-470a-b2e1-31f491c8d5f5 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:28.438865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae5814-6d33-470a-b2e1-31f491c8d5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:28.439033 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae5814-6d33-470a-b2e1-31f491c8d5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:28.457092 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-13ae5814-6d33-470a-b2e1-31f491c8d5f5 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:28.458262 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-13ae5814-6d33-470a-b2e1-31f491c8d5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:28.521651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 543/1108] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:28.794934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc9cb8-532b-4812-812b-bcf2fc6a6f04 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:28.823428 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:28.894696 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc9cb8-532b-4812-812b-bcf2fc6a6f04 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:28.927686 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21eaba-7cc6-4772-9463-85b855d64089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:28.928288 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21eaba-7cc6-4772-9463-85b855d64089 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:28.928568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21eaba-7cc6-4772-9463-85b855d64089 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:28.928843 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21eaba-7cc6-4772-9463-85b855d64089 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:28.929958 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21eaba-7cc6-4772-9463-85b855d64089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:28.931400 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21eaba-7cc6-4772-9463-85b855d64089 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:28.932940 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 566/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:28.938893 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae5814-6d33-470a-b2e1-31f491c8d5f5 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:28.953313 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:29.035233 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae5814-6d33-470a-b2e1-31f491c8d5f5 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:29.067409 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb1116-b946-497c-8881-a1903101b199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:29.067936 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb1116-b946-497c-8881-a1903101b199 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:29.068211 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb1116-b946-497c-8881-a1903101b199 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:29.068480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb1116-b946-497c-8881-a1903101b199 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:29.069123 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb1116-b946-497c-8881-a1903101b199 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:29.070524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb1116-b946-497c-8881-a1903101b199 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:29.092403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 544/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 26 01:24:28 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:24:31.265335 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8448edf-571b-4e8c-a948-7d87c708bd24 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:31.265898 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8448edf-571b-4e8c-a948-7d87c708bd24 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:31.265898 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8448edf-571b-4e8c-a948-7d87c708bd24 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:31.267194 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 567/1111] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:31.272352 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b51811-a972-4db7-808a-4acee28403c3 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:31.272727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b51811-a972-4db7-808a-4acee28403c3 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:31.272901 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b51811-a972-4db7-808a-4acee28403c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:31.291353 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-97b51811-a972-4db7-808a-4acee28403c3 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:31.292532 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-97b51811-a972-4db7-808a-4acee28403c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:31.358161 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:31.365371 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 545/1112] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 01:24:31.632478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8448edf-571b-4e8c-a948-7d87c708bd24 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:31.723325 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:31.729983 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8448edf-571b-4e8c-a948-7d87c708bd24 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:31.762430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91eb6a-cec8-476c-aa56-534a0671c78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:31.763053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91eb6a-cec8-476c-aa56-534a0671c78a None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:31.763328 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91eb6a-cec8-476c-aa56-534a0671c78a None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:31.763592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91eb6a-cec8-476c-aa56-534a0671c78a None admin] PATH_INFO: `/v3/roles/e1504eb5f35c468086d3b269e2c72011` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:31.764971 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91eb6a-cec8-476c-aa56-534a0671c78a None admin] RBAC: Authorizing `identity:get_role(role_id=e1504eb5f35c468086d3b269e2c72011)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:31.766312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91eb6a-cec8-476c-aa56-534a0671c78a None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:31.767620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 568/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:24:31 2022] GET /identity/v3/roles/e1504eb5f35c468086d3b269e2c72011 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:31.773311 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b51811-a972-4db7-808a-4acee28403c3 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:31.869823 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b51811-a972-4db7-808a-4acee28403c3 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:31.903117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27f02c-7214-4046-82d3-91778c8fb656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:31.903677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27f02c-7214-4046-82d3-91778c8fb656 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:31.903958 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27f02c-7214-4046-82d3-91778c8fb656 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:31.904234 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27f02c-7214-4046-82d3-91778c8fb656 None admin] PATH_INFO: `/v3/users/03e61b49290643e7909ca6a07a6bb94a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:31.917753 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27f02c-7214-4046-82d3-91778c8fb656 None admin] RBAC: Authorizing `identity:get_user(user_id=03e61b49290643e7909ca6a07a6bb94a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:31.919203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27f02c-7214-4046-82d3-91778c8fb656 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:31.920751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 546/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:24:31 2022] GET /identity/v3/users/03e61b49290643e7909ca6a07a6bb94a => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:31.926655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91eb6a-cec8-476c-aa56-534a0671c78a None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:32.021209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91eb6a-cec8-476c-aa56-534a0671c78a None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:32.053655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0df4e1-b000-4b29-adb8-bf59f6f3eb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:32.054231 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0df4e1-b000-4b29-adb8-bf59f6f3eb53 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:32.054504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0df4e1-b000-4b29-adb8-bf59f6f3eb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:32.054771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0df4e1-b000-4b29-adb8-bf59f6f3eb53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:32.085907 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:32.122377 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0df4e1-b000-4b29-adb8-bf59f6f3eb53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:32.123824 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0df4e1-b000-4b29-adb8-bf59f6f3eb53 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:32.217334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 569/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:24:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 01:24:32.223721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27f02c-7214-4046-82d3-91778c8fb656 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:32.278036 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:32.321836 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27f02c-7214-4046-82d3-91778c8fb656 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:32.354563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f06e6-8fd3-414f-95a3-d2aa0231e5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:32.355207 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f06e6-8fd3-414f-95a3-d2aa0231e5ff None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:32.355489 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f06e6-8fd3-414f-95a3-d2aa0231e5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:32.355758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f06e6-8fd3-414f-95a3-d2aa0231e5ff None admin] PATH_INFO: `/v3/projects/f274190bc2974459828fa6b18aaf3d57` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:32.356855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f06e6-8fd3-414f-95a3-d2aa0231e5ff None admin] RBAC: Authorizing `identity:get_project(project_id=f274190bc2974459828fa6b18aaf3d57)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:32.358276 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f06e6-8fd3-414f-95a3-d2aa0231e5ff None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:32.360411 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 547/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:24:32 2022] GET /identity/v3/projects/f274190bc2974459828fa6b18aaf3d57 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:32.366581 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0df4e1-b000-4b29-adb8-bf59f6f3eb53 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:32.425367 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:32.461378 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0df4e1-b000-4b29-adb8-bf59f6f3eb53 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:32.494813 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da598952-f893-4d3c-8b30-e2ee951af8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:32.495364 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da598952-f893-4d3c-8b30-e2ee951af8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:32.495640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da598952-f893-4d3c-8b30-e2ee951af8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:32.495909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da598952-f893-4d3c-8b30-e2ee951af8a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:32.496619 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da598952-f893-4d3c-8b30-e2ee951af8a7 None admin] RBAC: Adding query filter params (role.id=e1504eb5f35c468086d3b269e2c72011, scope.project.id=f274190bc2974459828fa6b18aaf3d57, user.id=03e61b49290643e7909ca6a07a6bb94a) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:32.496923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da598952-f893-4d3c-8b30-e2ee951af8a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:32.498326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da598952-f893-4d3c-8b30-e2ee951af8a7 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:32.503531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 570/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:24:32 2022] GET /identity/v3/role_assignments?user.id=03e61b49290643e7909ca6a07a6bb94a&scope.project.id=f274190bc2974459828fa6b18aaf3d57&role.id=e1504eb5f35c468086d3b269e2c72011 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:34.601875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee577b-a2cc-4ce1-a6b1-35b86b9f3bc7 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:34.602398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee577b-a2cc-4ce1-a6b1-35b86b9f3bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:34.602398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee577b-a2cc-4ce1-a6b1-35b86b9f3bc7 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:34.603740 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 548/1118] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:34.609203 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790457f2-f47c-43d7-b98a-6114df9e834b None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:34.609575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790457f2-f47c-43d7-b98a-6114df9e834b None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:34.609755 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790457f2-f47c-43d7-b98a-6114df9e834b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:34.628839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-790457f2-f47c-43d7-b98a-6114df9e834b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:34.630018 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-790457f2-f47c-43d7-b98a-6114df9e834b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:34.694364 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 571/1119] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:34.965426 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee577b-a2cc-4ce1-a6b1-35b86b9f3bc7 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:35.064641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee577b-a2cc-4ce1-a6b1-35b86b9f3bc7 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:35.087758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:35.099241 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5d6ac-6f12-4a2e-9bd9-c4b545d398dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:35.099852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5d6ac-6f12-4a2e-9bd9-c4b545d398dc None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:35.100130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5d6ac-6f12-4a2e-9bd9-c4b545d398dc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:35.100401 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5d6ac-6f12-4a2e-9bd9-c4b545d398dc None admin] PATH_INFO: `/v3/roles/e1504eb5f35c468086d3b269e2c72011` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:35.101766 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5d6ac-6f12-4a2e-9bd9-c4b545d398dc None admin] RBAC: Authorizing `identity:get_role(role_id=e1504eb5f35c468086d3b269e2c72011)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:35.103154 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5d6ac-6f12-4a2e-9bd9-c4b545d398dc None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:35.104430 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 549/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:24:34 2022] GET /identity/v3/roles/e1504eb5f35c468086d3b269e2c72011 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:35.110403 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790457f2-f47c-43d7-b98a-6114df9e834b None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:35.167208 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:35.207634 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790457f2-f47c-43d7-b98a-6114df9e834b None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:35.240782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75eaff-cfc8-4764-a6a6-2859f16d7491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:35.241338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75eaff-cfc8-4764-a6a6-2859f16d7491 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:35.241618 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75eaff-cfc8-4764-a6a6-2859f16d7491 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:35.241891 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75eaff-cfc8-4764-a6a6-2859f16d7491 None admin] PATH_INFO: `/v3/users/03e61b49290643e7909ca6a07a6bb94a` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:35.243022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75eaff-cfc8-4764-a6a6-2859f16d7491 None admin] RBAC: Authorizing `identity:get_user(user_id=03e61b49290643e7909ca6a07a6bb94a)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:35.244445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75eaff-cfc8-4764-a6a6-2859f16d7491 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:35.246010 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 572/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:24:35 2022] GET /identity/v3/users/03e61b49290643e7909ca6a07a6bb94a => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:35.251870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5d6ac-6f12-4a2e-9bd9-c4b545d398dc None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:35.348694 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5d6ac-6f12-4a2e-9bd9-c4b545d398dc None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:35.380999 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b77582-a26b-41c2-881c-3acb7a274f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:35.381600 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b77582-a26b-41c2-881c-3acb7a274f82 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:35.381875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b77582-a26b-41c2-881c-3acb7a274f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:35.382142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b77582-a26b-41c2-881c-3acb7a274f82 None admin] PATH_INFO: `/v3/projects/f274190bc2974459828fa6b18aaf3d57` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:35.383262 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b77582-a26b-41c2-881c-3acb7a274f82 None admin] RBAC: Authorizing `identity:get_project(project_id=f274190bc2974459828fa6b18aaf3d57)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:35.384661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b77582-a26b-41c2-881c-3acb7a274f82 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:35.386211 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 550/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:24:35 2022] GET /identity/v3/projects/f274190bc2974459828fa6b18aaf3d57 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:35.392788 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75eaff-cfc8-4764-a6a6-2859f16d7491 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:35.489337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75eaff-cfc8-4764-a6a6-2859f16d7491 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:35.515054 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:35.524123 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d4ee8-53e9-46d8-9228-eaf21028b7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:35.524766 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d4ee8-53e9-46d8-9228-eaf21028b7df None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:35.525046 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d4ee8-53e9-46d8-9228-eaf21028b7df None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:35.525319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d4ee8-53e9-46d8-9228-eaf21028b7df None admin] PATH_INFO: `/v3/projects/f274190bc2974459828fa6b18aaf3d57/users/03e61b49290643e7909ca6a07a6bb94a/roles/e1504eb5f35c468086d3b269e2c72011` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:35.527456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d4ee8-53e9-46d8-9228-eaf21028b7df None admin] RBAC: Authorizing `identity:create_grant(project_id=f274190bc2974459828fa6b18aaf3d57, user_id=03e61b49290643e7909ca6a07a6bb94a, role_id=e1504eb5f35c468086d3b269e2c72011)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:35.528867 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d4ee8-53e9-46d8-9228-eaf21028b7df None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:35.540371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 573/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:24:35 2022] PUT /identity/v3/projects/f274190bc2974459828fa6b18aaf3d57/users/03e61b49290643e7909ca6a07a6bb94a/roles/e1504eb5f35c468086d3b269e2c72011 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:24:37.656708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0b3a5-f235-49c4-b7e0-8f56f90455c3 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:37.657254 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0b3a5-f235-49c4-b7e0-8f56f90455c3 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:37.657369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0b3a5-f235-49c4-b7e0-8f56f90455c3 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:37.658614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 551/1124] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:37.663832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3a634-cbe0-4831-8631-4b725d310cf1 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:37.664246 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3a634-cbe0-4831-8631-4b725d310cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:37.664337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3a634-cbe0-4831-8631-4b725d310cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:37.682246 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-65e3a634-cbe0-4831-8631-4b725d310cf1 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:37.683445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-65e3a634-cbe0-4831-8631-4b725d310cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:37.747549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 574/1125] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:38.015486 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0b3a5-f235-49c4-b7e0-8f56f90455c3 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:38.073978 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:38.114549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0b3a5-f235-49c4-b7e0-8f56f90455c3 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:38.147117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d79315-98ef-42a6-b639-0597cf8cf927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:38.147721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d79315-98ef-42a6-b639-0597cf8cf927 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:38.147996 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d79315-98ef-42a6-b639-0597cf8cf927 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:38.148264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d79315-98ef-42a6-b639-0597cf8cf927 None admin] PATH_INFO: `/v3/roles/e1504eb5f35c468086d3b269e2c72011` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:38.149624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d79315-98ef-42a6-b639-0597cf8cf927 None admin] RBAC: Authorizing `identity:get_role(role_id=e1504eb5f35c468086d3b269e2c72011)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:38.150998 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d79315-98ef-42a6-b639-0597cf8cf927 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:38.152262 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 552/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:24:38 2022] GET /identity/v3/roles/e1504eb5f35c468086d3b269e2c72011 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:38.158073 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3a634-cbe0-4831-8631-4b725d310cf1 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:38.252614 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3a634-cbe0-4831-8631-4b725d310cf1 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:38.268612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:38.286638 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f877e-e58b-43e5-bbac-766dfaf0ab6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:38.287270 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f877e-e58b-43e5-bbac-766dfaf0ab6e None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:38.287550 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f877e-e58b-43e5-bbac-766dfaf0ab6e None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:38.287829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f877e-e58b-43e5-bbac-766dfaf0ab6e None admin] PATH_INFO: `/v3/users/03e61b49290643e7909ca6a07a6bb94a` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:38.288933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f877e-e58b-43e5-bbac-766dfaf0ab6e None admin] RBAC: Authorizing `identity:get_user(user_id=03e61b49290643e7909ca6a07a6bb94a)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:38.290332 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f877e-e58b-43e5-bbac-766dfaf0ab6e None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:38.291908 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 575/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:24:38 2022] GET /identity/v3/users/03e61b49290643e7909ca6a07a6bb94a => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:38.297627 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d79315-98ef-42a6-b639-0597cf8cf927 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:38.392675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d79315-98ef-42a6-b639-0597cf8cf927 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:38.418533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:38.426993 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e4dea-4568-4e5c-b0ad-ef5951446a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:38.427587 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e4dea-4568-4e5c-b0ad-ef5951446a74 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:38.427863 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e4dea-4568-4e5c-b0ad-ef5951446a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:38.428134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e4dea-4568-4e5c-b0ad-ef5951446a74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:38.493140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e4dea-4568-4e5c-b0ad-ef5951446a74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:38.494551 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e4dea-4568-4e5c-b0ad-ef5951446a74 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:38.587340 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 553/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:24:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 01:24:38.593118 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f877e-e58b-43e5-bbac-766dfaf0ab6e None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:38.689998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f877e-e58b-43e5-bbac-766dfaf0ab6e None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:38.722015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691670af-2487-48fc-933a-cc3753b48dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:38.722612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691670af-2487-48fc-933a-cc3753b48dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:38.722912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691670af-2487-48fc-933a-cc3753b48dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:38.723184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691670af-2487-48fc-933a-cc3753b48dd0 None admin] PATH_INFO: `/v3/projects/f274190bc2974459828fa6b18aaf3d57` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:38.724265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691670af-2487-48fc-933a-cc3753b48dd0 None admin] RBAC: Authorizing `identity:get_project(project_id=f274190bc2974459828fa6b18aaf3d57)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:38.725666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691670af-2487-48fc-933a-cc3753b48dd0 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:38.727308 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 576/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:24:38 2022] GET /identity/v3/projects/f274190bc2974459828fa6b18aaf3d57 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:38.733578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e4dea-4568-4e5c-b0ad-ef5951446a74 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:38.761592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:38.833545 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e4dea-4568-4e5c-b0ad-ef5951446a74 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:38.866096 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b9a77-c172-466a-a7fa-6e19773dd887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:38.866626 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b9a77-c172-466a-a7fa-6e19773dd887 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:38.866931 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b9a77-c172-466a-a7fa-6e19773dd887 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:38.867203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b9a77-c172-466a-a7fa-6e19773dd887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:38.867911 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b9a77-c172-466a-a7fa-6e19773dd887 None admin] RBAC: Adding query filter params (role.id=e1504eb5f35c468086d3b269e2c72011, scope.project.id=f274190bc2974459828fa6b18aaf3d57, user.id=03e61b49290643e7909ca6a07a6bb94a) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:38.868214 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b9a77-c172-466a-a7fa-6e19773dd887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:38.869619 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b9a77-c172-466a-a7fa-6e19773dd887 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:38.875160 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 554/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:24:38 2022] GET /identity/v3/role_assignments?user.id=03e61b49290643e7909ca6a07a6bb94a&scope.project.id=f274190bc2974459828fa6b18aaf3d57&role.id=e1504eb5f35c468086d3b269e2c72011 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:41.002024 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34a125-3ce4-4c91-86e7-a15f94bdfe81 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:41.002563 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34a125-3ce4-4c91-86e7-a15f94bdfe81 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:41.002563 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34a125-3ce4-4c91-86e7-a15f94bdfe81 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:41.003906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 577/1131] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:41.009123 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7273eb-c81c-46a2-b6af-1ba876c0e9e7 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:41.009528 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7273eb-c81c-46a2-b6af-1ba876c0e9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:41.009674 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7273eb-c81c-46a2-b6af-1ba876c0e9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:41.028195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-9d7273eb-c81c-46a2-b6af-1ba876c0e9e7 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:41.029384 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-9d7273eb-c81c-46a2-b6af-1ba876c0e9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:41.094305 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 555/1132] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:41.363560 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34a125-3ce4-4c91-86e7-a15f94bdfe81 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:41.416634 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:41.463492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34a125-3ce4-4c91-86e7-a15f94bdfe81 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:41.496432 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4bef9-9ab4-4e4e-92a4-98af2df5e2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:41.497041 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4bef9-9ab4-4e4e-92a4-98af2df5e2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:41.497318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4bef9-9ab4-4e4e-92a4-98af2df5e2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:41.497589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4bef9-9ab4-4e4e-92a4-98af2df5e2b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:41.498682 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4bef9-9ab4-4e4e-92a4-98af2df5e2b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:41.500119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4bef9-9ab4-4e4e-92a4-98af2df5e2b3 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:41.501692 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 578/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:41.507668 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7273eb-c81c-46a2-b6af-1ba876c0e9e7 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:41.530438 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:41.604430 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7273eb-c81c-46a2-b6af-1ba876c0e9e7 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:41.637728 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f305b62-a4df-4e48-a96c-e34fb9a8910d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:41.638260 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f305b62-a4df-4e48-a96c-e34fb9a8910d None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:41.638539 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f305b62-a4df-4e48-a96c-e34fb9a8910d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:41.638811 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f305b62-a4df-4e48-a96c-e34fb9a8910d None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:41.639479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f305b62-a4df-4e48-a96c-e34fb9a8910d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:41.640895 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f305b62-a4df-4e48-a96c-e34fb9a8910d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:41.667024 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 556/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 26 01:24:41 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:24:43.809498 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47cd36-8064-43c0-bdcb-1cfc756859ba None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:43.810031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47cd36-8064-43c0-bdcb-1cfc756859ba None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:43.810031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47cd36-8064-43c0-bdcb-1cfc756859ba None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:43.811389 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 579/1135] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:43.817108 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ac61e-d6df-4f1d-bfe1-d0694a9073dd None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:43.817478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ac61e-d6df-4f1d-bfe1-d0694a9073dd None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:43.817656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ac61e-d6df-4f1d-bfe1-d0694a9073dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:43.836220 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-0e8ac61e-d6df-4f1d-bfe1-d0694a9073dd None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:43.837389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0e8ac61e-d6df-4f1d-bfe1-d0694a9073dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:43.900353 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 557/1136] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:44.172394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47cd36-8064-43c0-bdcb-1cfc756859ba None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:44.270885 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47cd36-8064-43c0-bdcb-1cfc756859ba None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:44.290424 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:44.304644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40b809-998d-4e94-8561-e11ce0f84143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:44.305251 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40b809-998d-4e94-8561-e11ce0f84143 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:44.305526 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40b809-998d-4e94-8561-e11ce0f84143 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:44.305793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40b809-998d-4e94-8561-e11ce0f84143 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:44.306900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40b809-998d-4e94-8561-e11ce0f84143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:44.308301 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40b809-998d-4e94-8561-e11ce0f84143 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:44.309819 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 580/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:24:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:44.315560 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ac61e-d6df-4f1d-bfe1-d0694a9073dd None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:44.318607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:44.414477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ac61e-d6df-4f1d-bfe1-d0694a9073dd None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:44.448385 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee47195-a91c-45e4-a016-9b4471867783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:44.448917 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee47195-a91c-45e4-a016-9b4471867783 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:44.449195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee47195-a91c-45e4-a016-9b4471867783 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:44.449467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee47195-a91c-45e4-a016-9b4471867783 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:44.450122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee47195-a91c-45e4-a016-9b4471867783 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:44.451555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee47195-a91c-45e4-a016-9b4471867783 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:44.472884 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 558/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 26 01:24:44 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:24:46.683749 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea82360-8224-4c34-aa48-91943d13e671 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:46.684278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea82360-8224-4c34-aa48-91943d13e671 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:46.684278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea82360-8224-4c34-aa48-91943d13e671 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:46.685563 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 581/1139] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:46.691218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52254af1-2c72-4043-9e50-8baecfefe6ad None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:46.691618 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52254af1-2c72-4043-9e50-8baecfefe6ad None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:46.691758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52254af1-2c72-4043-9e50-8baecfefe6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:46.709905 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-52254af1-2c72-4043-9e50-8baecfefe6ad None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:46.711136 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-52254af1-2c72-4043-9e50-8baecfefe6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:46.765782 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:46.777965 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 559/1140] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:47.049287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea82360-8224-4c34-aa48-91943d13e671 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:47.147933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea82360-8224-4c34-aa48-91943d13e671 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:47.180332 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002b4c3-ee17-4a26-a77b-1740e0745cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:47.180939 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002b4c3-ee17-4a26-a77b-1740e0745cda None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:47.181217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002b4c3-ee17-4a26-a77b-1740e0745cda None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:47.181488 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002b4c3-ee17-4a26-a77b-1740e0745cda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:47.191271 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002b4c3-ee17-4a26-a77b-1740e0745cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:24:47.196245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-5002b4c3-ee17-4a26-a77b-1740e0745cda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:24:47.196245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:47.196245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:47.196245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:47.196245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:47.196245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:47.196245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:47.196245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:47.196245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:47.196245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:47.196245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:47.196245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:47.196245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:24:47.196245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:24:47.196245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:24:47.196245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:24:47.197297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:24:47.197297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:24:47.197297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:24:47.197297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:24:47.197297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:47.197297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:47.197297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:47.197297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:47.197297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:47.197297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:47.197297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:47.197297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:47.197297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:47.197297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:47.197297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:47.197297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:47.198157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:47.198157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:47.198157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:47.198157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:47.198157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:24:47.198157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:24:47.198157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:24:47.198157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:24:47.198157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:24:47.198157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:24:47.198157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:24:47.198157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:47.198157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 582/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:24:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:47.203258 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52254af1-2c72-4043-9e50-8baecfefe6ad None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:47.299200 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52254af1-2c72-4043-9e50-8baecfefe6ad None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:47.332555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5359ec3-9bfe-454f-a5bf-c3bac42171be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:47.333080 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5359ec3-9bfe-454f-a5bf-c3bac42171be None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:47.333356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5359ec3-9bfe-454f-a5bf-c3bac42171be None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:47.333626 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5359ec3-9bfe-454f-a5bf-c3bac42171be None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:47.334274 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5359ec3-9bfe-454f-a5bf-c3bac42171be None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:47.334572 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5359ec3-9bfe-454f-a5bf-c3bac42171be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:47.335952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5359ec3-9bfe-454f-a5bf-c3bac42171be None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:47.343612 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 560/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:24:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:47.349751 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002b4c3-ee17-4a26-a77b-1740e0745cda None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:47.398213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:47.449503 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002b4c3-ee17-4a26-a77b-1740e0745cda None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:47.483314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a03dec-72e5-4ba8-8e82-6bdd0fc639ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:47.483925 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a03dec-72e5-4ba8-8e82-6bdd0fc639ae None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:47.484202 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a03dec-72e5-4ba8-8e82-6bdd0fc639ae None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:47.484469 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a03dec-72e5-4ba8-8e82-6bdd0fc639ae None admin] PATH_INFO: `/v3/users/407b9122310b46628e720b952b9b23ab` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:47.497188 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a03dec-72e5-4ba8-8e82-6bdd0fc639ae None admin] RBAC: Authorizing `identity:get_user(user_id=407b9122310b46628e720b952b9b23ab)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:47.498598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a03dec-72e5-4ba8-8e82-6bdd0fc639ae None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:47.500194 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 583/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:24:47 2022] GET /identity/v3/users/407b9122310b46628e720b952b9b23ab => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:47.506520 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5359ec3-9bfe-454f-a5bf-c3bac42171be None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:47.557516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:47.605520 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5359ec3-9bfe-454f-a5bf-c3bac42171be None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:47.638250 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149eef9-9279-4a14-8de9-ed1f733806e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:47.638853 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149eef9-9279-4a14-8de9-ed1f733806e5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:47.639133 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149eef9-9279-4a14-8de9-ed1f733806e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:47.639402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149eef9-9279-4a14-8de9-ed1f733806e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:47.704961 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149eef9-9279-4a14-8de9-ed1f733806e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:47.706371 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149eef9-9279-4a14-8de9-ed1f733806e5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:47.755801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:47.801520 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 561/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:24:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 01:24:47.807464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a03dec-72e5-4ba8-8e82-6bdd0fc639ae None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:47.903239 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a03dec-72e5-4ba8-8e82-6bdd0fc639ae None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:47.910259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:47.936499 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a4d6b-b1d8-4486-ae30-eb97d1b610d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:47.937109 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a4d6b-b1d8-4486-ae30-eb97d1b610d4 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:47.937386 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a4d6b-b1d8-4486-ae30-eb97d1b610d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:47.937657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a4d6b-b1d8-4486-ae30-eb97d1b610d4 None admin] PATH_INFO: `/v3/projects/dcd583dafc51491aa0a0f86cca71b629` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:47.939340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a4d6b-b1d8-4486-ae30-eb97d1b610d4 None admin] RBAC: Authorizing `identity:get_project(project_id=dcd583dafc51491aa0a0f86cca71b629)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:47.940756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a4d6b-b1d8-4486-ae30-eb97d1b610d4 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:47.942346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 584/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:24:47 2022] GET /identity/v3/projects/dcd583dafc51491aa0a0f86cca71b629 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:47.948611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149eef9-9279-4a14-8de9-ed1f733806e5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:48.045885 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149eef9-9279-4a14-8de9-ed1f733806e5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:48.079113 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231727e7-4feb-45b8-a710-7594af710216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:48.080412 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231727e7-4feb-45b8-a710-7594af710216 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:48.080686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231727e7-4feb-45b8-a710-7594af710216 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:48.080954 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231727e7-4feb-45b8-a710-7594af710216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:48.081666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231727e7-4feb-45b8-a710-7594af710216 None admin] RBAC: Adding query filter params (role.id=50adf18edc1a47b2bae0876828a88dbf, scope.project.id=dcd583dafc51491aa0a0f86cca71b629, user.id=407b9122310b46628e720b952b9b23ab) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:48.081972 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231727e7-4feb-45b8-a710-7594af710216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:48.083411 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231727e7-4feb-45b8-a710-7594af710216 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:48.088603 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 562/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:24:47 2022] GET /identity/v3/role_assignments?user.id=407b9122310b46628e720b952b9b23ab&scope.project.id=dcd583dafc51491aa0a0f86cca71b629&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:50.235201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b139a-c021-456c-b73a-196216c1ac68 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:50.235776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b139a-c021-456c-b73a-196216c1ac68 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:50.235878 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b139a-c021-456c-b73a-196216c1ac68 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:50.237222 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 585/1147] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:50.242211 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5254712-d890-494b-9c6c-a1d2a0b5cd8a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:50.242650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5254712-d890-494b-9c6c-a1d2a0b5cd8a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:50.242751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5254712-d890-494b-9c6c-a1d2a0b5cd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:50.261761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-e5254712-d890-494b-9c6c-a1d2a0b5cd8a None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:50.262978 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e5254712-d890-494b-9c6c-a1d2a0b5cd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:50.274205 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:50.328268 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 563/1148] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:50.593264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b139a-c021-456c-b73a-196216c1ac68 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:50.698733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b139a-c021-456c-b73a-196216c1ac68 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:50.731901 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bee3e-85a3-482b-8786-d9cb6ba7ff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:50.732547 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bee3e-85a3-482b-8786-d9cb6ba7ff6a None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:50.732828 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bee3e-85a3-482b-8786-d9cb6ba7ff6a None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:50.733099 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bee3e-85a3-482b-8786-d9cb6ba7ff6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:50.743172 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bee3e-85a3-482b-8786-d9cb6ba7ff6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:24:50.747912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-ed8bee3e-85a3-482b-8786-d9cb6ba7ff6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:24:50.747912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:50.747912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:50.747912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:50.747912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:50.747912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:50.747912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:50.747912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:50.747912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:50.747912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:50.747912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:50.747912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:50.747912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:24:50.747912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:24:50.747912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:24:50.747912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:24:50.749097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:24:50.749097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:24:50.749097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:24:50.749097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:24:50.749097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:50.749097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:50.749097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:50.749097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:50.749097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:50.749097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:50.749097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:50.749097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:50.749097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:50.749097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:50.749097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:50.749097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:50.750393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:50.750393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:50.750393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:50.750393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:50.750393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:24:50.750393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:24:50.750393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:24:50.750393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:24:50.750393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:24:50.750393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:24:50.750393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:24:50.750393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:50.750393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 586/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:24:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:50.755075 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5254712-d890-494b-9c6c-a1d2a0b5cd8a None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:50.852955 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5254712-d890-494b-9c6c-a1d2a0b5cd8a None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:50.885279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205cc5c-e4c3-4fdf-afd4-f0b42e13ddaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:50.885876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205cc5c-e4c3-4fdf-afd4-f0b42e13ddaa None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:50.886156 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205cc5c-e4c3-4fdf-afd4-f0b42e13ddaa None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:50.886428 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205cc5c-e4c3-4fdf-afd4-f0b42e13ddaa None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:50.887119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205cc5c-e4c3-4fdf-afd4-f0b42e13ddaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:50.887424 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205cc5c-e4c3-4fdf-afd4-f0b42e13ddaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:50.888781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205cc5c-e4c3-4fdf-afd4-f0b42e13ddaa None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:50.897005 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 564/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:24:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:50.902790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bee3e-85a3-482b-8786-d9cb6ba7ff6a None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:50.936751 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:51.002121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bee3e-85a3-482b-8786-d9cb6ba7ff6a None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:51.034646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84b5f0-9df9-4181-bbd8-4e855f0c80fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:51.035286 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84b5f0-9df9-4181-bbd8-4e855f0c80fe None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:51.035564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84b5f0-9df9-4181-bbd8-4e855f0c80fe None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:51.035836 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84b5f0-9df9-4181-bbd8-4e855f0c80fe None admin] PATH_INFO: `/v3/users/407b9122310b46628e720b952b9b23ab` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:51.036935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84b5f0-9df9-4181-bbd8-4e855f0c80fe None admin] RBAC: Authorizing `identity:get_user(user_id=407b9122310b46628e720b952b9b23ab)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:51.038342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84b5f0-9df9-4181-bbd8-4e855f0c80fe None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:51.039923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 587/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:24:50 2022] GET /identity/v3/users/407b9122310b46628e720b952b9b23ab => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:51.045700 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205cc5c-e4c3-4fdf-afd4-f0b42e13ddaa None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:51.056822 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:51.142941 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205cc5c-e4c3-4fdf-afd4-f0b42e13ddaa None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:51.174663 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2a8cd-44be-40a4-9026-f6ca4f04f5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:51.175296 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2a8cd-44be-40a4-9026-f6ca4f04f5ac None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:51.175571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2a8cd-44be-40a4-9026-f6ca4f04f5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:51.175839 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2a8cd-44be-40a4-9026-f6ca4f04f5ac None admin] PATH_INFO: `/v3/projects/dcd583dafc51491aa0a0f86cca71b629` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:51.176918 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2a8cd-44be-40a4-9026-f6ca4f04f5ac None admin] RBAC: Authorizing `identity:get_project(project_id=dcd583dafc51491aa0a0f86cca71b629)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:51.178317 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2a8cd-44be-40a4-9026-f6ca4f04f5ac None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:51.179904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 565/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:24:51 2022] GET /identity/v3/projects/dcd583dafc51491aa0a0f86cca71b629 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:51.185776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84b5f0-9df9-4181-bbd8-4e855f0c80fe None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:51.280750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84b5f0-9df9-4181-bbd8-4e855f0c80fe None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:51.282240 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:51.313354 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2017cb-d1b7-4486-8217-33c4e0ae3890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:51.314516 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2017cb-d1b7-4486-8217-33c4e0ae3890 None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:51.314783 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2017cb-d1b7-4486-8217-33c4e0ae3890 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:51.315086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2017cb-d1b7-4486-8217-33c4e0ae3890 None admin] PATH_INFO: `/v3/projects/dcd583dafc51491aa0a0f86cca71b629/users/407b9122310b46628e720b952b9b23ab/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:51.316933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2017cb-d1b7-4486-8217-33c4e0ae3890 None admin] RBAC: Authorizing `identity:create_grant(project_id=dcd583dafc51491aa0a0f86cca71b629, user_id=407b9122310b46628e720b952b9b23ab, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:51.318325 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2017cb-d1b7-4486-8217-33c4e0ae3890 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:51.331544 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 588/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:24:51 2022] PUT /identity/v3/projects/dcd583dafc51491aa0a0f86cca71b629/users/407b9122310b46628e720b952b9b23ab/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:24:53.419580 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c7820-d105-4332-ac60-8c373d0cdd80 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:53.419994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c7820-d105-4332-ac60-8c373d0cdd80 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:53.420124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c7820-d105-4332-ac60-8c373d0cdd80 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:53.421444 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 566/1154] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:53.427270 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801fb01-1b2d-4c31-9a2e-52313fae3396 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:53.427711 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801fb01-1b2d-4c31-9a2e-52313fae3396 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:53.427821 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801fb01-1b2d-4c31-9a2e-52313fae3396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:53.445506 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-f801fb01-1b2d-4c31-9a2e-52313fae3396 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:53.446962 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f801fb01-1b2d-4c31-9a2e-52313fae3396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:53.510834 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 589/1155] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:53.776968 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c7820-d105-4332-ac60-8c373d0cdd80 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:53.853717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:53.877970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c7820-d105-4332-ac60-8c373d0cdd80 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:53.909959 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155cd6f-0857-4726-bdd3-4022af28ed23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:53.910573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155cd6f-0857-4726-bdd3-4022af28ed23 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:53.910876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155cd6f-0857-4726-bdd3-4022af28ed23 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:53.911154 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155cd6f-0857-4726-bdd3-4022af28ed23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:53.921345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155cd6f-0857-4726-bdd3-4022af28ed23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:24:53.926624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-6155cd6f-0857-4726-bdd3-4022af28ed23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:24:53.926624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:53.926624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:53.926624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:53.926624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:53.926624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:53.926624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:53.926624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:53.926624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:53.926624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:53.926624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:53.926624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:53.926624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:24:53.926624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:24:53.926624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:24:53.926624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:24:53.927765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:24:53.927765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:24:53.927765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:24:53.927765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:24:53.927765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:53.927765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:53.927765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:53.927765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:53.927765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:53.927765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:53.927765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:53.927765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:53.927765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:53.927765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:53.927765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:53.927765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:53.929010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:53.929010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:53.929010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:53.929010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:53.929010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:24:53.929010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:24:53.929010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:24:53.929010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:24:53.929010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:24:53.929010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:24:53.929010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:24:53.929010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:24:53.929010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 567/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:24:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:53.933733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801fb01-1b2d-4c31-9a2e-52313fae3396 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:54.021746 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:54.031562 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801fb01-1b2d-4c31-9a2e-52313fae3396 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:54.064736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7fdc0-bd5b-4dd4-82d7-6ea889f316a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:54.065328 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7fdc0-bd5b-4dd4-82d7-6ea889f316a0 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:54.065607 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7fdc0-bd5b-4dd4-82d7-6ea889f316a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:54.065879 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7fdc0-bd5b-4dd4-82d7-6ea889f316a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:54.066528 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7fdc0-bd5b-4dd4-82d7-6ea889f316a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:54.066854 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7fdc0-bd5b-4dd4-82d7-6ea889f316a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:54.068189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7fdc0-bd5b-4dd4-82d7-6ea889f316a0 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:54.076137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 590/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:24:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:54.082027 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155cd6f-0857-4726-bdd3-4022af28ed23 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:54.178694 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155cd6f-0857-4726-bdd3-4022af28ed23 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:54.210371 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b6ed4-0df4-4d3d-ab7f-6f8e58e38e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:54.211007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b6ed4-0df4-4d3d-ab7f-6f8e58e38e59 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:54.211289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b6ed4-0df4-4d3d-ab7f-6f8e58e38e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:54.211560 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b6ed4-0df4-4d3d-ab7f-6f8e58e38e59 None admin] PATH_INFO: `/v3/users/407b9122310b46628e720b952b9b23ab` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:54.212664 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b6ed4-0df4-4d3d-ab7f-6f8e58e38e59 None admin] RBAC: Authorizing `identity:get_user(user_id=407b9122310b46628e720b952b9b23ab)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:54.214069 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b6ed4-0df4-4d3d-ab7f-6f8e58e38e59 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:54.215614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 568/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:24:54 2022] GET /identity/v3/users/407b9122310b46628e720b952b9b23ab => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:54.221749 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7fdc0-bd5b-4dd4-82d7-6ea889f316a0 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:54.317456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7fdc0-bd5b-4dd4-82d7-6ea889f316a0 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:54.349618 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab704222-f56d-4b21-ba0b-ced7aee36d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:54.350195 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab704222-f56d-4b21-ba0b-ced7aee36d18 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:54.350468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab704222-f56d-4b21-ba0b-ced7aee36d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:54.350736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab704222-f56d-4b21-ba0b-ced7aee36d18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:54.372864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:54.417837 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab704222-f56d-4b21-ba0b-ced7aee36d18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:54.419285 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab704222-f56d-4b21-ba0b-ced7aee36d18 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:54.512654 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 591/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:24:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 01:24:54.519288 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b6ed4-0df4-4d3d-ab7f-6f8e58e38e59 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:54.523017 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:54.617182 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b6ed4-0df4-4d3d-ab7f-6f8e58e38e59 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:54.649169 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e1846-2a6d-4f81-9ddb-d24430222204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:54.649774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e1846-2a6d-4f81-9ddb-d24430222204 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:54.650050 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e1846-2a6d-4f81-9ddb-d24430222204 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:54.650323 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e1846-2a6d-4f81-9ddb-d24430222204 None admin] PATH_INFO: `/v3/projects/dcd583dafc51491aa0a0f86cca71b629` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:54.651441 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e1846-2a6d-4f81-9ddb-d24430222204 None admin] RBAC: Authorizing `identity:get_project(project_id=dcd583dafc51491aa0a0f86cca71b629)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:54.652852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e1846-2a6d-4f81-9ddb-d24430222204 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:54.654413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 569/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:24:54 2022] GET /identity/v3/projects/dcd583dafc51491aa0a0f86cca71b629 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:54.660511 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab704222-f56d-4b21-ba0b-ced7aee36d18 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:54.713671 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:54.757664 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab704222-f56d-4b21-ba0b-ced7aee36d18 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:54.790044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71849a3-e05e-4717-8cbf-40a81871dc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:54.790626 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71849a3-e05e-4717-8cbf-40a81871dc7f None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:54.790930 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71849a3-e05e-4717-8cbf-40a81871dc7f None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:54.791200 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71849a3-e05e-4717-8cbf-40a81871dc7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:54.791908 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71849a3-e05e-4717-8cbf-40a81871dc7f None admin] RBAC: Adding query filter params (role.id=50adf18edc1a47b2bae0876828a88dbf, scope.project.id=dcd583dafc51491aa0a0f86cca71b629, user.id=407b9122310b46628e720b952b9b23ab) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:54.792211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71849a3-e05e-4717-8cbf-40a81871dc7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:54.793604 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71849a3-e05e-4717-8cbf-40a81871dc7f None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:54.799720 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 592/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:24:54 2022] GET /identity/v3/role_assignments?user.id=407b9122310b46628e720b952b9b23ab&scope.project.id=dcd583dafc51491aa0a0f86cca71b629&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:24:56.939423 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002782c6-f11b-4c79-81a7-89920d33d230 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:56.939958 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002782c6-f11b-4c79-81a7-89920d33d230 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:56.939958 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002782c6-f11b-4c79-81a7-89920d33d230 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:56.941292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 570/1162] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:24:56.946843 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d34ca3-0dcc-4102-949a-2b78918ff2eb None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:56.947242 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d34ca3-0dcc-4102-949a-2b78918ff2eb None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:56.947390 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d34ca3-0dcc-4102-949a-2b78918ff2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:56.966240 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-35d34ca3-0dcc-4102-949a-2b78918ff2eb None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:24:56.967456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-35d34ca3-0dcc-4102-949a-2b78918ff2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:24:57.031583 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 593/1163] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:24:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:24:57.297694 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002782c6-f11b-4c79-81a7-89920d33d230 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:57.371089 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:57.403161 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002782c6-f11b-4c79-81a7-89920d33d230 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:57.435987 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d898967-1662-4730-a261-78c7de7cd16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:57.436584 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d898967-1662-4730-a261-78c7de7cd16a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:57.436857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d898967-1662-4730-a261-78c7de7cd16a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:57.437124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d898967-1662-4730-a261-78c7de7cd16a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:57.501948 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d898967-1662-4730-a261-78c7de7cd16a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:57.503536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d898967-1662-4730-a261-78c7de7cd16a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:57.567860 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:57.598807 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 571/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:24:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 01:24:57.604683 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d34ca3-0dcc-4102-949a-2b78918ff2eb None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:57.651183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:24:57.702017 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d34ca3-0dcc-4102-949a-2b78918ff2eb None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:57.735444 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9106fa-7573-48ae-85cc-afd952865569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:57.736061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9106fa-7573-48ae-85cc-afd952865569 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:57.736335 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9106fa-7573-48ae-85cc-afd952865569 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:57.736604 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9106fa-7573-48ae-85cc-afd952865569 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:57.743051 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9106fa-7573-48ae-85cc-afd952865569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:57.744466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9106fa-7573-48ae-85cc-afd952865569 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:57.756132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-bb9106fa-7573-48ae-85cc-afd952865569 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 26 01:24:57.756132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:57.756132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 26 01:24:57.756132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 26 01:24:57.756132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:24:57.756132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:24:57.756132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:24:57.756132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:24:57.756132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 26 01:24:57.756132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:57.756132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:24:57.756132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:57.756132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:24:57.756132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:24:57.756132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:24:57.756132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:24:57.756132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:24:57.757314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:24:57.757314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:24:57.757314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:24:57.757314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:24:57.757314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:24:57.757314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:24:57.757314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:24:57.757314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:24:57.757314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:24:57.757314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:24:57.757314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:24:57.757314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:24:57.757314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:24:57.757314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:24:57.757314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:24:57.757314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:24:57.758166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:24:57.758166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:24:57.758166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:24:57.758166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:24:57.758166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:24:57.758166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:24:57.758166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:24:57.758166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:24:57.758166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:24:57.758166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:24:57.758166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 26 01:24:57.758166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:24:57.758166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 26 01:24:57.758166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:24:57.758166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 594/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 26 01:24:57 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:24:57.763304 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d898967-1662-4730-a261-78c7de7cd16a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:24:57.859007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d898967-1662-4730-a261-78c7de7cd16a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:24:57.892463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cdec3-487e-41fa-932f-22a88e4b3402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:24:57.893048 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cdec3-487e-41fa-932f-22a88e4b3402 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:24:57.893323 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cdec3-487e-41fa-932f-22a88e4b3402 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:24:57.893590 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cdec3-487e-41fa-932f-22a88e4b3402 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:24:57.894214 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cdec3-487e-41fa-932f-22a88e4b3402 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:24:57.894513 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cdec3-487e-41fa-932f-22a88e4b3402 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:24:57.895896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cdec3-487e-41fa-932f-22a88e4b3402 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:24:57.902778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 572/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 26 01:24:57 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:25:00.106445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24656fa3-f64a-4206-a846-a15248c14559 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:00.107024 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24656fa3-f64a-4206-a846-a15248c14559 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:00.107024 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24656fa3-f64a-4206-a846-a15248c14559 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:00.108350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 595/1167] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:25:00.114095 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df292aac-14bc-4dee-9e14-bc7ea3370ca9 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:00.114525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df292aac-14bc-4dee-9e14-bc7ea3370ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:00.114644 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df292aac-14bc-4dee-9e14-bc7ea3370ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:00.132636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-df292aac-14bc-4dee-9e14-bc7ea3370ca9 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:25:00.133840 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-df292aac-14bc-4dee-9e14-bc7ea3370ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:25:00.161997 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:00.199484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 573/1168] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:25:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:25:00.466589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24656fa3-f64a-4206-a846-a15248c14559 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:00.565434 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24656fa3-f64a-4206-a846-a15248c14559 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:00.574174 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:00.599841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1714d-cb2c-425b-9107-006b4e8fd4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:00.600432 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1714d-cb2c-425b-9107-006b4e8fd4c5 None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:00.600709 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1714d-cb2c-425b-9107-006b4e8fd4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:00.600979 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1714d-cb2c-425b-9107-006b4e8fd4c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:00.601638 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1714d-cb2c-425b-9107-006b4e8fd4c5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:25:00.603005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1714d-cb2c-425b-9107-006b4e8fd4c5 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:25:00.617963 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 596/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Mon Sep 26 01:25:00 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:25:02.757849 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a26cad-8036-4a4c-92df-aaf61b2dc56c None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:02.758380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a26cad-8036-4a4c-92df-aaf61b2dc56c None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:02.758380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a26cad-8036-4a4c-92df-aaf61b2dc56c None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:02.759736 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 574/1170] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:25:02.764844 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882410de-c146-4c6f-bb0b-ddbc96832228 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:02.765246 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882410de-c146-4c6f-bb0b-ddbc96832228 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:02.765401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882410de-c146-4c6f-bb0b-ddbc96832228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:02.783463 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-882410de-c146-4c6f-bb0b-ddbc96832228 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:25:02.784644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-882410de-c146-4c6f-bb0b-ddbc96832228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:25:02.849501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 597/1171] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:25:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:25:03.118093 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a26cad-8036-4a4c-92df-aaf61b2dc56c None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:03.217277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a26cad-8036-4a4c-92df-aaf61b2dc56c None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:03.249953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5a157-4837-45c1-b34a-97960d71de7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:03.250573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5a157-4837-45c1-b34a-97960d71de7b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:03.251407 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5a157-4837-45c1-b34a-97960d71de7b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:03.251724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5a157-4837-45c1-b34a-97960d71de7b None admin] PATH_INFO: `/v3/domains/4bbb376c74bd4f6799106d596835f783` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:03.261835 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5a157-4837-45c1-b34a-97960d71de7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=4bbb376c74bd4f6799106d596835f783)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:25:03.263303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5a157-4837-45c1-b34a-97960d71de7b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:25:03.264842 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 575/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Mon Sep 26 01:25:03 2022] GET /identity/v3/domains/4bbb376c74bd4f6799106d596835f783 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:25:03.271178 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882410de-c146-4c6f-bb0b-ddbc96832228 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:03.362668 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:03.366663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882410de-c146-4c6f-bb0b-ddbc96832228 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:03.402318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ce5ec-beea-4158-9404-2f0e8f09b88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:03.402882 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ce5ec-beea-4158-9404-2f0e8f09b88a None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:03.403164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ce5ec-beea-4158-9404-2f0e8f09b88a None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:03.403433 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ce5ec-beea-4158-9404-2f0e8f09b88a None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:03.404072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ce5ec-beea-4158-9404-2f0e8f09b88a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:25:03.405488 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ce5ec-beea-4158-9404-2f0e8f09b88a None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:25:03.432078 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 598/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 26 01:25:03 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:25:05.593347 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b75f39-1d36-4605-9fc4-10687d91ed80 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:05.593856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b75f39-1d36-4605-9fc4-10687d91ed80 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:05.593949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b75f39-1d36-4605-9fc4-10687d91ed80 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:05.595404 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 576/1174] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:25:05.600564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beb68c-7e6e-4baf-92c6-9f2c7c0569ec None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:05.600961 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beb68c-7e6e-4baf-92c6-9f2c7c0569ec None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:05.601162 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beb68c-7e6e-4baf-92c6-9f2c7c0569ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:05.625572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-90beb68c-7e6e-4baf-92c6-9f2c7c0569ec None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:25:05.627459 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-90beb68c-7e6e-4baf-92c6-9f2c7c0569ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:25:05.693601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 599/1175] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:25:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:25:05.961422 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b75f39-1d36-4605-9fc4-10687d91ed80 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:05.989539 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:06.061462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b75f39-1d36-4605-9fc4-10687d91ed80 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:06.094711 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eade31-7923-4d14-b1a8-e1066f31890f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:06.095420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eade31-7923-4d14-b1a8-e1066f31890f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:06.095698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eade31-7923-4d14-b1a8-e1066f31890f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:06.095998 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eade31-7923-4d14-b1a8-e1066f31890f None admin] PATH_INFO: `/v3/domains/4bbb376c74bd4f6799106d596835f783` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:06.097109 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eade31-7923-4d14-b1a8-e1066f31890f None admin] RBAC: Authorizing `identity:get_domain(domain_id=4bbb376c74bd4f6799106d596835f783)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:25:06.098532 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eade31-7923-4d14-b1a8-e1066f31890f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:25:06.100103 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 577/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Mon Sep 26 01:25:05 2022] GET /identity/v3/domains/4bbb376c74bd4f6799106d596835f783 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:25:06.105759 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beb68c-7e6e-4baf-92c6-9f2c7c0569ec None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:06.182197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:06.201713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beb68c-7e6e-4baf-92c6-9f2c7c0569ec None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:06.234968 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394fda8-6693-4edd-8935-0c5d056abb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:06.235694 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394fda8-6693-4edd-8935-0c5d056abb99 None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:06.235972 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394fda8-6693-4edd-8935-0c5d056abb99 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:06.236244 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394fda8-6693-4edd-8935-0c5d056abb99 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:06.236892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394fda8-6693-4edd-8935-0c5d056abb99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:25:06.238303 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394fda8-6693-4edd-8935-0c5d056abb99 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:25:06.259150 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 600/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 26 01:25:06 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:25:08.438987 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ea4b9-977b-4902-b925-98a322c63b31 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:08.439459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ea4b9-977b-4902-b925-98a322c63b31 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:08.439549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ea4b9-977b-4902-b925-98a322c63b31 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:08.440847 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 578/1178] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:25:08.446503 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52525c9e-9171-407a-8daf-f963e96f841c None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:08.446935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52525c9e-9171-407a-8daf-f963e96f841c None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:08.447068 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52525c9e-9171-407a-8daf-f963e96f841c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:08.467035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-52525c9e-9171-407a-8daf-f963e96f841c None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:25:08.468260 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-52525c9e-9171-407a-8daf-f963e96f841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:25:08.535016 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 601/1179] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:25:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:25:08.812466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ea4b9-977b-4902-b925-98a322c63b31 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:08.904911 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:08.913240 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ea4b9-977b-4902-b925-98a322c63b31 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:08.945290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff642d44-843c-4034-85cc-55e032c12199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:08.945916 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff642d44-843c-4034-85cc-55e032c12199 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:08.946191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff642d44-843c-4034-85cc-55e032c12199 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:08.946718 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff642d44-843c-4034-85cc-55e032c12199 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:08.957648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff642d44-843c-4034-85cc-55e032c12199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:25:08.962377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-ff642d44-843c-4034-85cc-55e032c12199 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:25:08.962377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:25:08.962377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:25:08.962377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:25:08.962377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:25:08.962377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:25:08.962377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:25:08.962377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:25:08.962377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:25:08.962377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:25:08.962377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:25:08.962377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:25:08.962377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:25:08.962377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:25:08.962377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:25:08.962377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:25:08.963505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:25:08.963505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:25:08.963505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:25:08.963505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:25:08.963505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:25:08.963505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:25:08.963505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:25:08.963505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:25:08.963505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:25:08.963505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:25:08.963505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:25:08.963505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:25:08.963505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:25:08.963505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:25:08.963505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:25:08.963505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:25:08.964755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:25:08.964755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:25:08.964755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:25:08.964755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:25:08.964755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:25:08.964755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:25:08.964755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:25:08.964755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:25:08.964755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:25:08.964755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:25:08.964755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:25:08.964755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:25:08.964755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 579/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:25:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:25:08.969439 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52525c9e-9171-407a-8daf-f963e96f841c None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:09.033576 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:09.067793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52525c9e-9171-407a-8daf-f963e96f841c None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:09.102337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55257a8-1a6a-4c82-9949-0e033e7fe379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:09.102958 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55257a8-1a6a-4c82-9949-0e033e7fe379 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:09.103235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55257a8-1a6a-4c82-9949-0e033e7fe379 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:09.103509 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55257a8-1a6a-4c82-9949-0e033e7fe379 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:09.104160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55257a8-1a6a-4c82-9949-0e033e7fe379 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:25:09.104460 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55257a8-1a6a-4c82-9949-0e033e7fe379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:25:09.105808 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55257a8-1a6a-4c82-9949-0e033e7fe379 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:25:09.113599 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 602/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:25:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:25:09.119619 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff642d44-843c-4034-85cc-55e032c12199 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:09.216255 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff642d44-843c-4034-85cc-55e032c12199 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:09.247709 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6eee01-74a0-4dec-8870-fdfa7e3d56d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:09.248341 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6eee01-74a0-4dec-8870-fdfa7e3d56d9 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:09.248615 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6eee01-74a0-4dec-8870-fdfa7e3d56d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:09.248884 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6eee01-74a0-4dec-8870-fdfa7e3d56d9 None admin] PATH_INFO: `/v3/users/486ced8528ad45a2aea13718e513fc1d` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:09.261988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6eee01-74a0-4dec-8870-fdfa7e3d56d9 None admin] RBAC: Authorizing `identity:get_user(user_id=486ced8528ad45a2aea13718e513fc1d)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:25:09.263432 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6eee01-74a0-4dec-8870-fdfa7e3d56d9 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:25:09.264974 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 580/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:25:09 2022] GET /identity/v3/users/486ced8528ad45a2aea13718e513fc1d => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:25:09.270749 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55257a8-1a6a-4c82-9949-0e033e7fe379 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:09.367504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55257a8-1a6a-4c82-9949-0e033e7fe379 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:09.392007 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:09.400645 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5f121-4287-4c4e-a3af-7917054feee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:09.401247 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5f121-4287-4c4e-a3af-7917054feee6 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:09.401527 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5f121-4287-4c4e-a3af-7917054feee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:09.401799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5f121-4287-4c4e-a3af-7917054feee6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:09.475227 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5f121-4287-4c4e-a3af-7917054feee6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:25:09.476703 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5f121-4287-4c4e-a3af-7917054feee6 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:25:09.574047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 603/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:25:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 01:25:09.579268 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6eee01-74a0-4dec-8870-fdfa7e3d56d9 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:09.594401 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:09.680430 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6eee01-74a0-4dec-8870-fdfa7e3d56d9 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:09.713417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec6144-b7cb-479f-a0b5-198d3fae2994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:09.714039 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec6144-b7cb-479f-a0b5-198d3fae2994 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:09.714319 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec6144-b7cb-479f-a0b5-198d3fae2994 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:09.714591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec6144-b7cb-479f-a0b5-198d3fae2994 None admin] PATH_INFO: `/v3/projects/5481a3eaa96241879edb36448ca0c1ba` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:09.715746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec6144-b7cb-479f-a0b5-198d3fae2994 None admin] RBAC: Authorizing `identity:get_project(project_id=5481a3eaa96241879edb36448ca0c1ba)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:25:09.717166 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec6144-b7cb-479f-a0b5-198d3fae2994 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:25:09.718750 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 581/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:25:09 2022] GET /identity/v3/projects/5481a3eaa96241879edb36448ca0c1ba => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:25:09.725405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5f121-4287-4c4e-a3af-7917054feee6 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:09.752426 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:09.823059 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5f121-4287-4c4e-a3af-7917054feee6 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:09.855038 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b5be8-8b43-42a9-b8cd-ac703e93c56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:09.855618 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b5be8-8b43-42a9-b8cd-ac703e93c56c None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:09.855893 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b5be8-8b43-42a9-b8cd-ac703e93c56c None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:09.856164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b5be8-8b43-42a9-b8cd-ac703e93c56c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:09.856873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b5be8-8b43-42a9-b8cd-ac703e93c56c None admin] RBAC: Adding query filter params (role.id=50adf18edc1a47b2bae0876828a88dbf, scope.project.id=5481a3eaa96241879edb36448ca0c1ba, user.id=486ced8528ad45a2aea13718e513fc1d) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:25:09.857175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b5be8-8b43-42a9-b8cd-ac703e93c56c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:25:09.858575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b5be8-8b43-42a9-b8cd-ac703e93c56c None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:25:09.864360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 604/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:25:09 2022] GET /identity/v3/role_assignments?user.id=486ced8528ad45a2aea13718e513fc1d&scope.project.id=5481a3eaa96241879edb36448ca0c1ba&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:25:11.963784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ba44d-f271-4cab-b4a5-d3e976ea4222 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:11.964356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ba44d-f271-4cab-b4a5-d3e976ea4222 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:11.964356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ba44d-f271-4cab-b4a5-d3e976ea4222 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:11.965622 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 582/1186] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:25:11.971253 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74add377-8e02-4c11-88ab-f61d40ce934c None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:11.971915 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74add377-8e02-4c11-88ab-f61d40ce934c None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:11.971915 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74add377-8e02-4c11-88ab-f61d40ce934c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:11.989521 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-74add377-8e02-4c11-88ab-f61d40ce934c None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:25:11.990700 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-74add377-8e02-4c11-88ab-f61d40ce934c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:25:12.054723 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 605/1187] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:25:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:25:12.326205 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ba44d-f271-4cab-b4a5-d3e976ea4222 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:12.410063 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:12.430737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ba44d-f271-4cab-b4a5-d3e976ea4222 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:12.464029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f09005-5c06-4c14-90c1-df5d086904c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:12.464649 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f09005-5c06-4c14-90c1-df5d086904c1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:12.464929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f09005-5c06-4c14-90c1-df5d086904c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:12.465202 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f09005-5c06-4c14-90c1-df5d086904c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:12.474917 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f09005-5c06-4c14-90c1-df5d086904c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:25:12.479680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-d8f09005-5c06-4c14-90c1-df5d086904c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:25:12.479680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:25:12.479680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:25:12.479680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:25:12.479680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:25:12.479680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:25:12.479680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:25:12.479680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:25:12.479680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:25:12.479680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:25:12.479680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:25:12.479680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:25:12.479680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:25:12.479680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:25:12.479680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:25:12.479680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:25:12.480698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:25:12.480698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:25:12.480698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:25:12.480698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:25:12.480698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:25:12.480698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:25:12.480698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:25:12.480698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:25:12.480698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:25:12.480698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:25:12.480698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:25:12.480698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:25:12.480698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:25:12.480698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:25:12.480698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:25:12.480698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:25:12.481571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:25:12.481571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:25:12.481571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:25:12.481571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:25:12.481571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:25:12.481571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:25:12.481571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:25:12.481571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:25:12.481571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:25:12.481571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:25:12.481571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:25:12.481571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:25:12.481571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 583/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:25:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:25:12.487414 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74add377-8e02-4c11-88ab-f61d40ce934c None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:12.510587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:12.583025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74add377-8e02-4c11-88ab-f61d40ce934c None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:12.615388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ec81d-8630-4922-a186-6b9be7c76761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:12.615989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ec81d-8630-4922-a186-6b9be7c76761 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:12.616266 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ec81d-8630-4922-a186-6b9be7c76761 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:12.616535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ec81d-8630-4922-a186-6b9be7c76761 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:12.617189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ec81d-8630-4922-a186-6b9be7c76761 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:25:12.617487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ec81d-8630-4922-a186-6b9be7c76761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:25:12.618868 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ec81d-8630-4922-a186-6b9be7c76761 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:25:12.627848 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 606/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:25:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:25:12.635275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f09005-5c06-4c14-90c1-df5d086904c1 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:12.732025 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f09005-5c06-4c14-90c1-df5d086904c1 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:12.764746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fad78-01b0-4af6-adba-751b43dfaefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:12.765357 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fad78-01b0-4af6-adba-751b43dfaefb None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:12.765634 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fad78-01b0-4af6-adba-751b43dfaefb None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:12.765903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fad78-01b0-4af6-adba-751b43dfaefb None admin] PATH_INFO: `/v3/users/486ced8528ad45a2aea13718e513fc1d` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:12.767033 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fad78-01b0-4af6-adba-751b43dfaefb None admin] RBAC: Authorizing `identity:get_user(user_id=486ced8528ad45a2aea13718e513fc1d)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:25:12.768599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fad78-01b0-4af6-adba-751b43dfaefb None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:25:12.770146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 584/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:25:12 2022] GET /identity/v3/users/486ced8528ad45a2aea13718e513fc1d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:25:12.775992 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ec81d-8630-4922-a186-6b9be7c76761 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:12.857274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:12.873041 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ec81d-8630-4922-a186-6b9be7c76761 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:12.907060 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0631472-63de-4bd8-a25e-3d01a08c3ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:12.907674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0631472-63de-4bd8-a25e-3d01a08c3ade None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:12.908610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0631472-63de-4bd8-a25e-3d01a08c3ade None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:12.908889 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0631472-63de-4bd8-a25e-3d01a08c3ade None admin] PATH_INFO: `/v3/projects/5481a3eaa96241879edb36448ca0c1ba` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:12.909981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0631472-63de-4bd8-a25e-3d01a08c3ade None admin] RBAC: Authorizing `identity:get_project(project_id=5481a3eaa96241879edb36448ca0c1ba)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:25:12.911417 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0631472-63de-4bd8-a25e-3d01a08c3ade None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:25:12.913012 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 607/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:25:12 2022] GET /identity/v3/projects/5481a3eaa96241879edb36448ca0c1ba => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:25:12.918982 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fad78-01b0-4af6-adba-751b43dfaefb None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:12.935840 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:13.024852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fad78-01b0-4af6-adba-751b43dfaefb None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:13.059222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d533074-49eb-45e8-b656-ec5da820eca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:13.059868 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d533074-49eb-45e8-b656-ec5da820eca0 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:13.060147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d533074-49eb-45e8-b656-ec5da820eca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:13.060420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d533074-49eb-45e8-b656-ec5da820eca0 None admin] PATH_INFO: `/v3/projects/5481a3eaa96241879edb36448ca0c1ba/users/486ced8528ad45a2aea13718e513fc1d/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:13.062313 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d533074-49eb-45e8-b656-ec5da820eca0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5481a3eaa96241879edb36448ca0c1ba, user_id=486ced8528ad45a2aea13718e513fc1d, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:25:13.063755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d533074-49eb-45e8-b656-ec5da820eca0 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:25:13.076358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 585/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:25:12 2022] PUT /identity/v3/projects/5481a3eaa96241879edb36448ca0c1ba/users/486ced8528ad45a2aea13718e513fc1d/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:25:15.195503 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76a119-4c50-4e3b-80eb-cc30cae7bfaf None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:15.196070 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76a119-4c50-4e3b-80eb-cc30cae7bfaf None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:15.196070 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76a119-4c50-4e3b-80eb-cc30cae7bfaf None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:15.197627 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 608/1193] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:25:15.203017 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c24e7-34ff-4f08-9954-10454f262ab4 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:15.203437 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c24e7-34ff-4f08-9954-10454f262ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:15.203569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c24e7-34ff-4f08-9954-10454f262ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:15.221823 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-071c24e7-34ff-4f08-9954-10454f262ab4 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:25:15.223030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-071c24e7-34ff-4f08-9954-10454f262ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:25:15.282228 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:15.288774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 586/1194] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:25:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:25:15.558106 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76a119-4c50-4e3b-80eb-cc30cae7bfaf None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:15.656507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76a119-4c50-4e3b-80eb-cc30cae7bfaf None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:15.688415 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4efd98-f90e-4799-97af-09308dec9f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:15.689015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4efd98-f90e-4799-97af-09308dec9f43 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:15.689866 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4efd98-f90e-4799-97af-09308dec9f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:15.690132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4efd98-f90e-4799-97af-09308dec9f43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:15.700028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4efd98-f90e-4799-97af-09308dec9f43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:25:15.704726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-7d4efd98-f90e-4799-97af-09308dec9f43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:25:15.704726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:25:15.704726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:25:15.704726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:25:15.704726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:25:15.704726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:25:15.704726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:25:15.704726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:25:15.704726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:25:15.704726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:25:15.704726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:25:15.704726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:25:15.704726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:25:15.704726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:25:15.704726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:25:15.704726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:25:15.705815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:25:15.705815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:25:15.705815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:25:15.705815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:25:15.705815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:25:15.705815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:25:15.705815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:25:15.705815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:25:15.705815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:25:15.705815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:25:15.705815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:25:15.705815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:25:15.705815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:25:15.705815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:25:15.705815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:25:15.705815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:25:15.706681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:25:15.706681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:25:15.706681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:25:15.706681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:25:15.706681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:25:15.706681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:25:15.706681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:25:15.706681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:25:15.706681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:25:15.706681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:25:15.706681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:25:15.706681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:25:15.706681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 609/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:25:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:25:15.711899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c24e7-34ff-4f08-9954-10454f262ab4 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:15.807727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c24e7-34ff-4f08-9954-10454f262ab4 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:15.840841 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e9733-ffc4-4f23-a7c7-3676689cbaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:15.841382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e9733-ffc4-4f23-a7c7-3676689cbaac None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:15.841661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e9733-ffc4-4f23-a7c7-3676689cbaac None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:15.841935 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e9733-ffc4-4f23-a7c7-3676689cbaac None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:15.842589 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e9733-ffc4-4f23-a7c7-3676689cbaac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:25:15.842917 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e9733-ffc4-4f23-a7c7-3676689cbaac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:25:15.844281 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e9733-ffc4-4f23-a7c7-3676689cbaac None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:25:15.852907 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 587/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:25:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:25:15.858670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4efd98-f90e-4799-97af-09308dec9f43 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:15.874027 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:15.955548 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4efd98-f90e-4799-97af-09308dec9f43 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:15.987826 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d33af-e7d1-4b47-9674-0e937f67ac7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:15.988426 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d33af-e7d1-4b47-9674-0e937f67ac7c None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:15.988707 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d33af-e7d1-4b47-9674-0e937f67ac7c None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:15.988979 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d33af-e7d1-4b47-9674-0e937f67ac7c None admin] PATH_INFO: `/v3/users/486ced8528ad45a2aea13718e513fc1d` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:15.990082 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d33af-e7d1-4b47-9674-0e937f67ac7c None admin] RBAC: Authorizing `identity:get_user(user_id=486ced8528ad45a2aea13718e513fc1d)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:25:15.991519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d33af-e7d1-4b47-9674-0e937f67ac7c None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:25:15.993068 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 610/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 26 01:25:15 2022] GET /identity/v3/users/486ced8528ad45a2aea13718e513fc1d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:25:15.998732 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e9733-ffc4-4f23-a7c7-3676689cbaac None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:16.057177 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:16.098036 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e9733-ffc4-4f23-a7c7-3676689cbaac None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:16.131102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6017bab-e0fd-43fd-b8ba-baa03618f958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:16.131695 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6017bab-e0fd-43fd-b8ba-baa03618f958 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:16.131974 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6017bab-e0fd-43fd-b8ba-baa03618f958 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:16.132244 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6017bab-e0fd-43fd-b8ba-baa03618f958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:16.196155 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6017bab-e0fd-43fd-b8ba-baa03618f958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:25:16.197832 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6017bab-e0fd-43fd-b8ba-baa03618f958 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:25:16.253350 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:16.294176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 588/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:25:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 01:25:16.300118 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d33af-e7d1-4b47-9674-0e937f67ac7c None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:16.378486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:16.398035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d33af-e7d1-4b47-9674-0e937f67ac7c None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:16.432061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fe5ef-2d34-49ce-ae8a-bd9a0e0cc985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:16.432678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fe5ef-2d34-49ce-ae8a-bd9a0e0cc985 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:16.432955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fe5ef-2d34-49ce-ae8a-bd9a0e0cc985 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:16.433225 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fe5ef-2d34-49ce-ae8a-bd9a0e0cc985 None admin] PATH_INFO: `/v3/projects/5481a3eaa96241879edb36448ca0c1ba` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:16.434324 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fe5ef-2d34-49ce-ae8a-bd9a0e0cc985 None admin] RBAC: Authorizing `identity:get_project(project_id=5481a3eaa96241879edb36448ca0c1ba)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:25:16.435762 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fe5ef-2d34-49ce-ae8a-bd9a0e0cc985 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:25:16.437370 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 611/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 26 01:25:16 2022] GET /identity/v3/projects/5481a3eaa96241879edb36448ca0c1ba => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:25:16.443592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6017bab-e0fd-43fd-b8ba-baa03618f958 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:25:16.539953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6017bab-e0fd-43fd-b8ba-baa03618f958 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:25:16.572910 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28727559-4bef-4467-84f2-7d7016c741f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:25:16.573496 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28727559-4bef-4467-84f2-7d7016c741f9 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:25:16.573774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28727559-4bef-4467-84f2-7d7016c741f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:25:16.574046 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28727559-4bef-4467-84f2-7d7016c741f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:25:16.574752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28727559-4bef-4467-84f2-7d7016c741f9 None admin] RBAC: Adding query filter params (role.id=50adf18edc1a47b2bae0876828a88dbf, scope.project.id=5481a3eaa96241879edb36448ca0c1ba, user.id=486ced8528ad45a2aea13718e513fc1d) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:25:16.575083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28727559-4bef-4467-84f2-7d7016c741f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:25:16.576490 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28727559-4bef-4467-84f2-7d7016c741f9 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:25:16.582616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 589/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:25:16 2022] GET /identity/v3/role_assignments?user.id=486ced8528ad45a2aea13718e513fc1d&scope.project.id=5481a3eaa96241879edb36448ca0c1ba&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:25:26.428395 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=26 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:25:26.579511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=88 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:12.226680 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b44012-331f-4946-85a7-d125f089397b None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:12.227495 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b44012-331f-4946-85a7-d125f089397b None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:12.227495 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b44012-331f-4946-85a7-d125f089397b None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:12.228751 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 612/1201] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:26:12.235057 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e7102-af69-442e-941b-4b635343f00c None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:12.235818 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e7102-af69-442e-941b-4b635343f00c None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:12.235818 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e7102-af69-442e-941b-4b635343f00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:12.256479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-6d1e7102-af69-442e-941b-4b635343f00c None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:26:12.257658 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6d1e7102-af69-442e-941b-4b635343f00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:26:12.348295 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 590/1202] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:26:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:26:12.633172 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b44012-331f-4946-85a7-d125f089397b None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:12.760939 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b44012-331f-4946-85a7-d125f089397b None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:12.811973 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e3f8a-0d8d-4ae8-9448-a569c6891f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:12.813033 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e3f8a-0d8d-4ae8-9448-a569c6891f17 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:12.814052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e3f8a-0d8d-4ae8-9448-a569c6891f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:12.814489 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e3f8a-0d8d-4ae8-9448-a569c6891f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:12.827550 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e3f8a-0d8d-4ae8-9448-a569c6891f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:12.830113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e3f8a-0d8d-4ae8-9448-a569c6891f17 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:12.847750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-363e3f8a-0d8d-4ae8-9448-a569c6891f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:12.847750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:12.847750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:12.847750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:12.847750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:12.847750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:12.847750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:12.847750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:12.847750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:12.847750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:12.847750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:12.847750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:12.847750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:26:12.847750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:26:12.847750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:26:12.847750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:26:12.848916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:12.848916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:12.848916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:12.848916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:12.848916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:12.848916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:12.848916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:12.848916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:12.848916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:12.848916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:12.848916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:12.848916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:12.848916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:12.848916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:12.848916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:12.848916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:12.848916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:26:12.849902 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:26:12.849902 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:12.849902 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:26:12.849902 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 613/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:12.855029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e7102-af69-442e-941b-4b635343f00c None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:12.985175 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e7102-af69-442e-941b-4b635343f00c None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:13.028908 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:13.035553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42022d10-7d92-40a7-8a1b-a4b4e71fc014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:13.036168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42022d10-7d92-40a7-8a1b-a4b4e71fc014 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:13.036450 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42022d10-7d92-40a7-8a1b-a4b4e71fc014 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:13.036723 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42022d10-7d92-40a7-8a1b-a4b4e71fc014 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:13.040253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42022d10-7d92-40a7-8a1b-a4b4e71fc014 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:13.040253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42022d10-7d92-40a7-8a1b-a4b4e71fc014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:13.040253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42022d10-7d92-40a7-8a1b-a4b4e71fc014 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:13.053717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 591/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:13.059734 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e3f8a-0d8d-4ae8-9448-a569c6891f17 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:13.132299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:13.191389 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e3f8a-0d8d-4ae8-9448-a569c6891f17 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:13.237376 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00e95a-00cf-48e6-b76e-39bc4da3473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:13.238032 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00e95a-00cf-48e6-b76e-39bc4da3473e None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:13.238259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00e95a-00cf-48e6-b76e-39bc4da3473e None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:13.238509 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00e95a-00cf-48e6-b76e-39bc4da3473e None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:13.239315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00e95a-00cf-48e6-b76e-39bc4da3473e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:13.240771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00e95a-00cf-48e6-b76e-39bc4da3473e None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:13.270695 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 614/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 26 01:26:13 2022] POST /identity/v3/users => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:26:15.690568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254a6f2-e355-4751-92d7-ae52554cdfa5 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:15.691170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254a6f2-e355-4751-92d7-ae52554cdfa5 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:15.691170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254a6f2-e355-4751-92d7-ae52554cdfa5 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:15.692714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 592/1206] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:26:15.698977 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9d27f-6387-48d0-9260-efdf7b469c1e None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:15.699408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9d27f-6387-48d0-9260-efdf7b469c1e None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:15.699632 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9d27f-6387-48d0-9260-efdf7b469c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:15.722031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-f7d9d27f-6387-48d0-9260-efdf7b469c1e None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:26:15.723758 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f7d9d27f-6387-48d0-9260-efdf7b469c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:26:15.806380 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 615/1207] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:26:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:26:16.095655 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254a6f2-e355-4751-92d7-ae52554cdfa5 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:16.223497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254a6f2-e355-4751-92d7-ae52554cdfa5 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:16.264294 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572af189-4f07-454b-b03c-8d9234310b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:16.264923 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572af189-4f07-454b-b03c-8d9234310b53 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:16.265203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572af189-4f07-454b-b03c-8d9234310b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:16.265470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572af189-4f07-454b-b03c-8d9234310b53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:16.278172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572af189-4f07-454b-b03c-8d9234310b53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:26:16.283415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-572af189-4f07-454b-b03c-8d9234310b53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:26:16.283415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:16.283415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:16.283415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:16.283415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:16.283415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:16.283415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:16.283415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:16.283415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:16.283415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:16.283415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:16.283415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:16.283415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:26:16.283415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:26:16.283415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:26:16.283415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:26:16.284431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:26:16.284431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:26:16.284431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:26:16.284431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:26:16.284431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:16.284431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:16.284431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:16.284431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:16.284431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:16.284431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:16.284431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:16.284431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:16.284431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:16.284431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:16.284431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:16.284431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:16.285953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:16.285953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:16.285953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:16.285953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:16.285953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:26:16.285953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:26:16.285953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:26:16.285953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:26:16.285953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:26:16.285953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:26:16.285953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:26:16.285953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:16.285953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 593/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:26:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:26:16.290571 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9d27f-6387-48d0-9260-efdf7b469c1e None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:16.341551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:16.419952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9d27f-6387-48d0-9260-efdf7b469c1e None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:16.460187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3166b-0b7a-4562-a637-bccefbdee3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:16.460806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3166b-0b7a-4562-a637-bccefbdee3fe None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:16.461096 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3166b-0b7a-4562-a637-bccefbdee3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:16.461396 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3166b-0b7a-4562-a637-bccefbdee3fe None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:16.462030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3166b-0b7a-4562-a637-bccefbdee3fe None admin] RBAC: Adding query filter params (name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:16.462332 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3166b-0b7a-4562-a637-bccefbdee3fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:16.463759 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3166b-0b7a-4562-a637-bccefbdee3fe None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:16.473162 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 616/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:26:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:26:16.479254 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572af189-4f07-454b-b03c-8d9234310b53 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:16.538201 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:16.604363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572af189-4f07-454b-b03c-8d9234310b53 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:16.647805 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc308ee-2e0c-4ada-9e36-88538aeb1ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:16.648448 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc308ee-2e0c-4ada-9e36-88538aeb1ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:16.648728 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc308ee-2e0c-4ada-9e36-88538aeb1ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:16.648997 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc308ee-2e0c-4ada-9e36-88538aeb1ca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:16.660599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc308ee-2e0c-4ada-9e36-88538aeb1ca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:16.662104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc308ee-2e0c-4ada-9e36-88538aeb1ca9 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:16.677322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-2dc308ee-2e0c-4ada-9e36-88538aeb1ca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:16.677322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:16.677322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:16.677322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:16.677322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:16.677322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:16.677322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:16.677322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:16.677322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:16.677322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:16.677322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:16.677322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:16.677322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:26:16.677322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:26:16.677322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:26:16.677322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:26:16.678394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:16.678394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:16.678394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:16.678394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:16.678394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:16.678394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:16.678394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:16.678394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:16.678394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:16.678394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:16.678394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:16.678394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:16.678394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:16.678394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:16.678394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:16.678394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:16.678394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:26:16.679852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:26:16.679852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:16.679852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:16.684157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3166b-0b7a-4562-a637-bccefbdee3fe None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:16.684676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 594/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:16.800856 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:16.804850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3166b-0b7a-4562-a637-bccefbdee3fe None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:16.843884 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c6c4d-88da-4427-ada9-20f6135830b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:16.844482 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c6c4d-88da-4427-ada9-20f6135830b1 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:16.844829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c6c4d-88da-4427-ada9-20f6135830b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:16.845103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c6c4d-88da-4427-ada9-20f6135830b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:16.845845 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c6c4d-88da-4427-ada9-20f6135830b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:16.846148 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c6c4d-88da-4427-ada9-20f6135830b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:16.847534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c6c4d-88da-4427-ada9-20f6135830b1 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:16.859950 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 617/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:16.866080 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc308ee-2e0c-4ada-9e36-88538aeb1ca9 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:16.972467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc308ee-2e0c-4ada-9e36-88538aeb1ca9 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:16.974006 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:17.011695 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762f330-5eda-45da-8866-c2a5f24915db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:17.012317 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762f330-5eda-45da-8866-c2a5f24915db None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:17.012677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762f330-5eda-45da-8866-c2a5f24915db None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:17.012873 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762f330-5eda-45da-8866-c2a5f24915db None admin] PATH_INFO: `/v3/users/placement` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:17.021556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762f330-5eda-45da-8866-c2a5f24915db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:17.023169 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762f330-5eda-45da-8866-c2a5f24915db None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:17.035568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-0762f330-5eda-45da-8866-c2a5f24915db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 01:26:17.035568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:17.035568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:17.035568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:17.035568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:17.035568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:17.035568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:17.035568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:17.035568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:17.035568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:17.035568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:17.035568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:17.035568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:26:17.035568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:26:17.035568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:26:17.035568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:26:17.036651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:17.036651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:17.036651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:26:17.036651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:26:17.036651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:26:17.036651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:26:17.036651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:17.036651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:17.036651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:17.036651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:17.036651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:17.036651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:17.036651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:17.036651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:17.036651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:17.036651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:17.036651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:17.036651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:17.042646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:17.042646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:17.042646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:26:17.042646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:26:17.042646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:26:17.042646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:26:17.042646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:26:17.042646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:26:17.042646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 01:26:17.042646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:17.042646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 595/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:26:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:17.043362 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c6c4d-88da-4427-ada9-20f6135830b1 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:17.166105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c6c4d-88da-4427-ada9-20f6135830b1 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:17.203776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7aaf05-71f9-44ae-abf5-832e352dc088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:17.204497 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aaf05-71f9-44ae-abf5-832e352dc088 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:17.204798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aaf05-71f9-44ae-abf5-832e352dc088 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:17.205132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aaf05-71f9-44ae-abf5-832e352dc088 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:17.205972 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7aaf05-71f9-44ae-abf5-832e352dc088 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:17.206281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7aaf05-71f9-44ae-abf5-832e352dc088 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:17.207850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7aaf05-71f9-44ae-abf5-832e352dc088 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:17.228586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 618/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Sep 26 01:26:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:17.234026 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762f330-5eda-45da-8866-c2a5f24915db None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:17.361878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762f330-5eda-45da-8866-c2a5f24915db None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:17.404529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc1fc3-70bd-48ee-9e17-30f74408a08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:17.405238 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc1fc3-70bd-48ee-9e17-30f74408a08d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:17.405519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc1fc3-70bd-48ee-9e17-30f74408a08d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:17.405792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc1fc3-70bd-48ee-9e17-30f74408a08d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:17.441850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:17.486311 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc1fc3-70bd-48ee-9e17-30f74408a08d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:17.487738 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc1fc3-70bd-48ee-9e17-30f74408a08d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:17.603828 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 596/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:26:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 01:26:17.609736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7aaf05-71f9-44ae-abf5-832e352dc088 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:17.631713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:17.733179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7aaf05-71f9-44ae-abf5-832e352dc088 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:17.776957 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ae45f-01b4-4929-8184-035846175c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:17.777800 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ae45f-01b4-4929-8184-035846175c48 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:17.778084 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ae45f-01b4-4929-8184-035846175c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:17.778367 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ae45f-01b4-4929-8184-035846175c48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:17.791056 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ae45f-01b4-4929-8184-035846175c48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:17.793177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ae45f-01b4-4929-8184-035846175c48 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:17.812438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-d25ae45f-01b4-4929-8184-035846175c48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:17.812438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:17.812438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:17.812438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:17.812438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:17.812438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:17.812438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:17.812438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:17.812438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:17.812438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:17.812438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:17.812438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:17.812438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:26:17.812438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:26:17.812438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:26:17.812438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:26:17.814518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:17.814518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:17.814518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:17.814518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:17.814518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:17.814518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:17.814518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:17.814518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:17.814518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:17.814518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:17.814518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:17.814518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:17.814518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:17.814518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:17.814518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:17.814518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:17.814518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:26:17.815603 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:26:17.815603 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:17.815603 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:26:17.815603 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 619/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:17.821817 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc1fc3-70bd-48ee-9e17-30f74408a08d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:17.894465 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:17.944996 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc1fc3-70bd-48ee-9e17-30f74408a08d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:17.989247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde41c6b-3fee-499f-a948-d1331ba43eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:17.990217 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde41c6b-3fee-499f-a948-d1331ba43eca None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:17.990506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde41c6b-3fee-499f-a948-d1331ba43eca None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:17.990787 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde41c6b-3fee-499f-a948-d1331ba43eca None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:17.991516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde41c6b-3fee-499f-a948-d1331ba43eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:17.991988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde41c6b-3fee-499f-a948-d1331ba43eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:17.993839 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde41c6b-3fee-499f-a948-d1331ba43eca None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:18.010083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 597/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:18.015926 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ae45f-01b4-4929-8184-035846175c48 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:18.090216 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:18.132857 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ae45f-01b4-4929-8184-035846175c48 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:18.170629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc3402-30d9-4595-b1dc-63b3bc5ec625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:18.171309 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc3402-30d9-4595-b1dc-63b3bc5ec625 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:18.171576 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc3402-30d9-4595-b1dc-63b3bc5ec625 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:18.171851 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc3402-30d9-4595-b1dc-63b3bc5ec625 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:18.179159 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc3402-30d9-4595-b1dc-63b3bc5ec625 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:18.180594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc3402-30d9-4595-b1dc-63b3bc5ec625 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:18.192334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-b0bc3402-30d9-4595-b1dc-63b3bc5ec625 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:26:18.192334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:18.192334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:18.192334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:18.192334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:18.192334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:18.192334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:18.192334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:18.192334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:18.192334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:18.192334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:18.192334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:18.192334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:26:18.192334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:26:18.192334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:26:18.193472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:26:18.193472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:18.193472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:18.193472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:18.193472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:18.193472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:18.193472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:18.193472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:18.193472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:18.193472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:18.193472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:18.193472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:18.193472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:18.193472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:18.193472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:18.193472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:18.193472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:18.194719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:26:18.194719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:26:18.194719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:26:18.194719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:26:18.194719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:26:18.194719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:26:18.194719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:26:18.194719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:26:18.194719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 620/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:26:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:26:18.199514 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde41c6b-3fee-499f-a948-d1331ba43eca None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:18.309069 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde41c6b-3fee-499f-a948-d1331ba43eca None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:18.334271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:18.346378 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3dc55-4f3e-4e3b-a55c-e41140c783aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:18.346983 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3dc55-4f3e-4e3b-a55c-e41140c783aa None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:18.347181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3dc55-4f3e-4e3b-a55c-e41140c783aa None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:18.347458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3dc55-4f3e-4e3b-a55c-e41140c783aa None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:18.348141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3dc55-4f3e-4e3b-a55c-e41140c783aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:18.348441 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3dc55-4f3e-4e3b-a55c-e41140c783aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:18.349864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3dc55-4f3e-4e3b-a55c-e41140c783aa None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:18.363837 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 598/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:26:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:18.370033 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc3402-30d9-4595-b1dc-63b3bc5ec625 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:18.487204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc3402-30d9-4595-b1dc-63b3bc5ec625 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:18.519807 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:18.526072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ed8f5-16c4-4ea1-a29f-7cf7f21ed10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:18.526674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ed8f5-16c4-4ea1-a29f-7cf7f21ed10a None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:18.526989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ed8f5-16c4-4ea1-a29f-7cf7f21ed10a None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:18.527263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ed8f5-16c4-4ea1-a29f-7cf7f21ed10a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:18.527998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ed8f5-16c4-4ea1-a29f-7cf7f21ed10a None admin] RBAC: Adding query filter params (role.id=8801886a5f4e4695a29b60c6eb347932, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=df7a1b839a6f4bdb9870217fa4d2527c) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:18.528356 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ed8f5-16c4-4ea1-a29f-7cf7f21ed10a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:18.529724 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ed8f5-16c4-4ea1-a29f-7cf7f21ed10a None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:18.535264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 621/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:26:18 2022] GET /identity/v3/role_assignments?user.id=df7a1b839a6f4bdb9870217fa4d2527c&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=8801886a5f4e4695a29b60c6eb347932 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:26:20.911576 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede3531-5498-46a1-8cbe-b593f376d8fa None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:20.912222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede3531-5498-46a1-8cbe-b593f376d8fa None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:20.912222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede3531-5498-46a1-8cbe-b593f376d8fa None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:20.913831 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 599/1220] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:26:20.919777 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82870ceb-2c73-42cb-b95e-5c09ac8fb725 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:20.920352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82870ceb-2c73-42cb-b95e-5c09ac8fb725 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:20.920352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82870ceb-2c73-42cb-b95e-5c09ac8fb725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:20.939009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-82870ceb-2c73-42cb-b95e-5c09ac8fb725 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:26:20.940213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-82870ceb-2c73-42cb-b95e-5c09ac8fb725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:26:21.013648 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 622/1221] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:26:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:26:21.300090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede3531-5498-46a1-8cbe-b593f376d8fa None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:21.428425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede3531-5498-46a1-8cbe-b593f376d8fa None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:21.473991 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a52eb-a4ad-4943-bc01-1bad78005580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:21.474625 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a52eb-a4ad-4943-bc01-1bad78005580 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:21.474935 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a52eb-a4ad-4943-bc01-1bad78005580 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:21.475211 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a52eb-a4ad-4943-bc01-1bad78005580 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:21.488942 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a52eb-a4ad-4943-bc01-1bad78005580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:26:21.496522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-d90a52eb-a4ad-4943-bc01-1bad78005580 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:26:21.496522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:21.496522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:21.496522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:21.496522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:21.496522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:21.496522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:21.496522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:21.496522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:21.496522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:21.496522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:21.496522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:21.496522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:26:21.496522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:26:21.496522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:26:21.496522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:26:21.497763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:26:21.497763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:26:21.497763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:26:21.497763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:26:21.497763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:21.497763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:21.497763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:21.497763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:21.497763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:21.497763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:21.497763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:21.497763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:21.497763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:21.497763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:21.497763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:21.497763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:21.498698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:21.498698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:21.498698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:21.498698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:21.498698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:26:21.498698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:26:21.498698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:26:21.498698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:26:21.498698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:26:21.498698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:26:21.498698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:26:21.498698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:21.498698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 600/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:26:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:21.504969 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82870ceb-2c73-42cb-b95e-5c09ac8fb725 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:21.606430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82870ceb-2c73-42cb-b95e-5c09ac8fb725 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:21.631706 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:21.644163 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733d6aa-d80b-4b8c-a910-a9d6afa1f951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:21.644841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733d6aa-d80b-4b8c-a910-a9d6afa1f951 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:21.645120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733d6aa-d80b-4b8c-a910-a9d6afa1f951 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:21.645392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733d6aa-d80b-4b8c-a910-a9d6afa1f951 None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:21.646168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733d6aa-d80b-4b8c-a910-a9d6afa1f951 None admin] RBAC: Adding query filter params (name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:21.646360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733d6aa-d80b-4b8c-a910-a9d6afa1f951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:21.647822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733d6aa-d80b-4b8c-a910-a9d6afa1f951 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:21.656210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 623/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:26:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:21.664175 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a52eb-a4ad-4943-bc01-1bad78005580 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:21.727200 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:21.792509 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a52eb-a4ad-4943-bc01-1bad78005580 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:21.830460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5eaa10-157f-415e-8ae2-4723e62513b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:21.831125 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5eaa10-157f-415e-8ae2-4723e62513b9 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:21.831400 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5eaa10-157f-415e-8ae2-4723e62513b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:21.831668 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5eaa10-157f-415e-8ae2-4723e62513b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:21.842903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5eaa10-157f-415e-8ae2-4723e62513b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:21.845360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5eaa10-157f-415e-8ae2-4723e62513b9 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:21.861953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-dc5eaa10-157f-415e-8ae2-4723e62513b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:21.861953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:21.861953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:21.861953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:21.861953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:21.861953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:21.861953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:21.861953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:21.861953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:21.861953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:21.861953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:21.861953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:21.861953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:26:21.861953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:26:21.861953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:26:21.861953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:26:21.863277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:21.863277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:21.863277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:21.863277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:21.863277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:21.863277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:21.863277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:21.863277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:21.863277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:21.863277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:21.863277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:21.863277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:21.863277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:21.863277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:21.863277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:21.863277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:21.863277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:26:21.864173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:26:21.864173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:21.864173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:21.864173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 601/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:21.869064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733d6aa-d80b-4b8c-a910-a9d6afa1f951 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:21.978424 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733d6aa-d80b-4b8c-a910-a9d6afa1f951 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:22.020037 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10565d0e-f88b-4037-ba90-2c62160317a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:22.020633 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10565d0e-f88b-4037-ba90-2c62160317a3 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:22.020911 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10565d0e-f88b-4037-ba90-2c62160317a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:22.021180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10565d0e-f88b-4037-ba90-2c62160317a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:22.021814 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10565d0e-f88b-4037-ba90-2c62160317a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:22.022149 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10565d0e-f88b-4037-ba90-2c62160317a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:22.023773 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10565d0e-f88b-4037-ba90-2c62160317a3 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:22.038249 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 624/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:26:22.044201 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5eaa10-157f-415e-8ae2-4723e62513b9 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:22.159097 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:22.166136 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5eaa10-157f-415e-8ae2-4723e62513b9 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:22.204444 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2978ab0-b04c-4880-8eb8-8cb437185316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:22.205122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2978ab0-b04c-4880-8eb8-8cb437185316 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:22.205435 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2978ab0-b04c-4880-8eb8-8cb437185316 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:22.205672 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2978ab0-b04c-4880-8eb8-8cb437185316 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:22.214644 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2978ab0-b04c-4880-8eb8-8cb437185316 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:22.216304 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2978ab0-b04c-4880-8eb8-8cb437185316 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:22.229735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-a2978ab0-b04c-4880-8eb8-8cb437185316 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 01:26:22.229735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:22.229735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:22.229735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:22.229735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:22.229735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:22.229735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:22.229735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:22.229735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:22.229735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:22.229735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:22.229735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:22.229735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:26:22.229735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:26:22.229735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:26:22.229735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:26:22.230784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:22.230784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:22.230784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:26:22.230784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:26:22.230784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:26:22.230784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:26:22.230784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:22.230784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:22.230784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:22.230784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:22.230784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:22.230784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:22.230784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:22.230784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:22.230784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:22.230784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:22.230784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:22.230784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:22.232413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:22.232413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:22.232413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:26:22.232413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:26:22.232413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:26:22.232413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:26:22.232413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:26:22.232413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:26:22.232413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 01:26:22.232413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:22.232413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 602/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:26:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:22.237426 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10565d0e-f88b-4037-ba90-2c62160317a3 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:22.285053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:22.344013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10565d0e-f88b-4037-ba90-2c62160317a3 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:22.383073 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd611c1d-8161-4918-87c9-e540c7db336b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:22.383675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd611c1d-8161-4918-87c9-e540c7db336b None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:22.383953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd611c1d-8161-4918-87c9-e540c7db336b None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:22.384223 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd611c1d-8161-4918-87c9-e540c7db336b None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:22.384940 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd611c1d-8161-4918-87c9-e540c7db336b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:22.385246 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd611c1d-8161-4918-87c9-e540c7db336b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:22.386694 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd611c1d-8161-4918-87c9-e540c7db336b None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:22.404833 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 625/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Sep 26 01:26:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:26:22.412009 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2978ab0-b04c-4880-8eb8-8cb437185316 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:22.529790 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2978ab0-b04c-4880-8eb8-8cb437185316 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:22.565933 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f4895-dc36-499a-9c8f-c5bd4900076b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:22.566556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f4895-dc36-499a-9c8f-c5bd4900076b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:22.566859 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f4895-dc36-499a-9c8f-c5bd4900076b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:22.567127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f4895-dc36-499a-9c8f-c5bd4900076b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:22.577735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f4895-dc36-499a-9c8f-c5bd4900076b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:22.579216 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f4895-dc36-499a-9c8f-c5bd4900076b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:22.593650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-685f4895-dc36-499a-9c8f-c5bd4900076b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:22.593650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:22.593650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:22.593650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:22.593650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:22.593650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:22.593650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:22.593650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:22.593650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:22.593650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:22.593650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:22.593650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:22.593650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:26:22.593650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:26:22.593650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:26:22.593650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:26:22.596018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:22.596018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:22.596018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:22.596018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:22.596018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:22.596018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:22.596018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:22.596018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:22.596018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:22.596018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:22.596018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:22.596018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:22.596018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:22.596018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:22.596018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:22.596018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:22.596018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:26:22.597176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:26:22.597176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:22.597176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:22.597176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 603/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:22.601335 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd611c1d-8161-4918-87c9-e540c7db336b None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:22.705825 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd611c1d-8161-4918-87c9-e540c7db336b None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:22.708608 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:22.751315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1f59b-0004-4d94-8f22-03c9c4733b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:22.751984 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1f59b-0004-4d94-8f22-03c9c4733b4c None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:22.752271 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1f59b-0004-4d94-8f22-03c9c4733b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:22.752615 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1f59b-0004-4d94-8f22-03c9c4733b4c None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:22.753267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1f59b-0004-4d94-8f22-03c9c4733b4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:22.753569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1f59b-0004-4d94-8f22-03c9c4733b4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:22.754952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1f59b-0004-4d94-8f22-03c9c4733b4c None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:22.769156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 626/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:26:22.775078 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f4895-dc36-499a-9c8f-c5bd4900076b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:22.785394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:22.885691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f4895-dc36-499a-9c8f-c5bd4900076b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:22.927625 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3f837-b572-465e-9da9-9960c7d54f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:22.928510 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3f837-b572-465e-9da9-9960c7d54f0b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:22.928944 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3f837-b572-465e-9da9-9960c7d54f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:22.929345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3f837-b572-465e-9da9-9960c7d54f0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:22.937251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3f837-b572-465e-9da9-9960c7d54f0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:22.939012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3f837-b572-465e-9da9-9960c7d54f0b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:22.953721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-d8a3f837-b572-465e-9da9-9960c7d54f0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:26:22.953721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:22.953721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:22.953721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:22.953721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:22.953721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:22.953721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:22.953721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:22.953721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:22.953721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:22.953721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:22.953721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:22.953721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:26:22.953721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:26:22.953721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:26:22.955398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:26:22.955398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:22.955398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:22.955398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:22.955398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:22.955398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:22.955398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:22.955398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:22.955398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:22.955398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:22.955398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:22.955398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:22.955398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:22.955398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:22.955398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:22.955398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:22.955398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:22.956480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:26:22.956480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:26:22.956480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:26:22.956480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:26:22.956480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:26:22.956480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:26:22.956480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:26:22.956480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:22.956480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 604/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:26:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:22.962253 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1f59b-0004-4d94-8f22-03c9c4733b4c None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:23.075103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1f59b-0004-4d94-8f22-03c9c4733b4c None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:23.117704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782004d-2feb-4feb-8005-0a9e7c2f7f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:23.118862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782004d-2feb-4feb-8005-0a9e7c2f7f99 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:23.119164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782004d-2feb-4feb-8005-0a9e7c2f7f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:23.119576 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782004d-2feb-4feb-8005-0a9e7c2f7f99 None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:23.120292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782004d-2feb-4feb-8005-0a9e7c2f7f99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:23.120625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782004d-2feb-4feb-8005-0a9e7c2f7f99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:23.122431 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782004d-2feb-4feb-8005-0a9e7c2f7f99 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:23.137322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 627/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:26:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:26:23.143833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3f837-b572-465e-9da9-9960c7d54f0b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:23.212976 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:23.253151 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3f837-b572-465e-9da9-9960c7d54f0b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:23.292534 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff611a3-ecdb-4598-8de1-b352478cd7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:23.293202 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff611a3-ecdb-4598-8de1-b352478cd7b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:23.293482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff611a3-ecdb-4598-8de1-b352478cd7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:23.293756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff611a3-ecdb-4598-8de1-b352478cd7b4 None admin] PATH_INFO: `/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/df7a1b839a6f4bdb9870217fa4d2527c/roles/8801886a5f4e4695a29b60c6eb347932` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:23.310730 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff611a3-ecdb-4598-8de1-b352478cd7b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fda1727cc3d47b9a1fae73c74f32c27, user_id=df7a1b839a6f4bdb9870217fa4d2527c, role_id=8801886a5f4e4695a29b60c6eb347932)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:23.312275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff611a3-ecdb-4598-8de1-b352478cd7b4 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:23.324978 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 605/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:26:23 2022] PUT /identity/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/df7a1b839a6f4bdb9870217fa4d2527c/roles/8801886a5f4e4695a29b60c6eb347932 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:26:25.732797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074727c-b096-4b71-a51c-49cf1f7ec274 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:25.733350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074727c-b096-4b71-a51c-49cf1f7ec274 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:25.733350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074727c-b096-4b71-a51c-49cf1f7ec274 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:25.735039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 628/1233] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:26:25.740307 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbdc63-e569-4f5a-89a3-3c85b3333167 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:25.740758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbdc63-e569-4f5a-89a3-3c85b3333167 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:25.740853 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbdc63-e569-4f5a-89a3-3c85b3333167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:25.760098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-7abbdc63-e569-4f5a-89a3-3c85b3333167 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:26:25.761335 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7abbdc63-e569-4f5a-89a3-3c85b3333167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:26:25.833043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 606/1234] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:26:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:26:26.171610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074727c-b096-4b71-a51c-49cf1f7ec274 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:26.204793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:26.293698 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074727c-b096-4b71-a51c-49cf1f7ec274 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:26.330511 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fabff-4865-4108-b72b-0b616ea2470e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:26.331164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fabff-4865-4108-b72b-0b616ea2470e None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:26.331431 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fabff-4865-4108-b72b-0b616ea2470e None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:26.331703 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fabff-4865-4108-b72b-0b616ea2470e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:26.341998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fabff-4865-4108-b72b-0b616ea2470e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:26:26.347320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-7a5fabff-4865-4108-b72b-0b616ea2470e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:26:26.347320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:26.347320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:26.347320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:26.347320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:26.347320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:26.347320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:26.347320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:26.347320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:26.347320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:26.347320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:26.347320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:26.347320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:26:26.347320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:26:26.347320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:26:26.347320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:26:26.348294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:26:26.348294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:26:26.348294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:26:26.348294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:26:26.348294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:26.348294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:26.348294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:26.348294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:26.348294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:26.348294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:26.348294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:26.348294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:26.348294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:26.348294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:26.348294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:26.348294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:26.349212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:26.349212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:26.349212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:26.349212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:26.349212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:26:26.349212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:26:26.349212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:26:26.349212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:26:26.349212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:26:26.349212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:26:26.349212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 01:26:26.349212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:26:26.349212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 629/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 26 01:26:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:26.354354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbdc63-e569-4f5a-89a3-3c85b3333167 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:26.404486 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:26.471934 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbdc63-e569-4f5a-89a3-3c85b3333167 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:26.512193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdfd48-810b-410e-ac62-aaf09c566f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:26.512841 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdfd48-810b-410e-ac62-aaf09c566f56 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:26.513141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdfd48-810b-410e-ac62-aaf09c566f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:26.513432 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdfd48-810b-410e-ac62-aaf09c566f56 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:26.514168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdfd48-810b-410e-ac62-aaf09c566f56 None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:26.514512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdfd48-810b-410e-ac62-aaf09c566f56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:26.515987 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdfd48-810b-410e-ac62-aaf09c566f56 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:26.525685 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 607/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 26 01:26:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:26.532168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fabff-4865-4108-b72b-0b616ea2470e None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:26.635828 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:26.655243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fabff-4865-4108-b72b-0b616ea2470e None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:26.696146 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94b484-3acc-4b55-bb9f-0c23e255e0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:26.697186 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94b484-3acc-4b55-bb9f-0c23e255e0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:26.697545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94b484-3acc-4b55-bb9f-0c23e255e0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:26.698087 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94b484-3acc-4b55-bb9f-0c23e255e0f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:26.709601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94b484-3acc-4b55-bb9f-0c23e255e0f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:26.711416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94b484-3acc-4b55-bb9f-0c23e255e0f0 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:26.730408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-ba94b484-3acc-4b55-bb9f-0c23e255e0f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:26.730408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:26.730408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:26.730408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:26.730408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:26.730408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:26.730408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:26.730408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:26.730408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:26.730408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:26.730408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:26.730408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:26.730408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:26:26.730408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:26:26.730408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:26:26.730408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:26:26.731812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:26.731812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:26.731812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:26.731812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:26.731812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:26.731812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:26.731812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:26.731812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:26.731812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:26.731812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:26.731812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:26.731812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:26.731812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:26.731812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:26.731812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:26.731812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:26.731812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:26:26.732721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:26:26.732721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:26.732721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:26:26.732721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 630/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:26.738917 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdfd48-810b-410e-ac62-aaf09c566f56 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:26.855567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdfd48-810b-410e-ac62-aaf09c566f56 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:26.866807 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:26.895560 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1ca83-91d7-41c4-ac14-fa744fd8d12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:26.896245 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1ca83-91d7-41c4-ac14-fa744fd8d12b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:26.896525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1ca83-91d7-41c4-ac14-fa744fd8d12b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:26.896822 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1ca83-91d7-41c4-ac14-fa744fd8d12b None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:26.897537 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1ca83-91d7-41c4-ac14-fa744fd8d12b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:26.897826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1ca83-91d7-41c4-ac14-fa744fd8d12b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:26.899258 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1ca83-91d7-41c4-ac14-fa744fd8d12b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:26.911890 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 608/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:26.918021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94b484-3acc-4b55-bb9f-0c23e255e0f0 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:27.027476 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94b484-3acc-4b55-bb9f-0c23e255e0f0 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:27.064147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307588b5-dd59-4893-b1ab-5a1b12bff7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:27.064819 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307588b5-dd59-4893-b1ab-5a1b12bff7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:27.065221 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307588b5-dd59-4893-b1ab-5a1b12bff7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:27.065502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307588b5-dd59-4893-b1ab-5a1b12bff7a3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:27.068853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:27.076059 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307588b5-dd59-4893-b1ab-5a1b12bff7a3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:27.077920 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307588b5-dd59-4893-b1ab-5a1b12bff7a3 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:27.091872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-307588b5-dd59-4893-b1ab-5a1b12bff7a3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 01:26:27.091872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:27.091872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:27.091872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:27.091872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:27.091872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:27.091872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:27.091872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:27.091872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:27.091872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:27.091872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:27.091872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:27.091872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:26:27.091872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:26:27.091872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:26:27.091872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:26:27.093131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:27.093131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:27.093131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:26:27.093131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:26:27.093131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:26:27.093131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:26:27.093131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:27.093131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:27.093131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:27.093131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:27.093131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:27.093131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:27.093131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:27.093131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:27.093131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:27.093131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:27.093131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:27.093131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:27.094310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:27.094310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:27.094310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:26:27.094310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:26:27.094310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:26:27.094310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:26:27.094310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:26:27.094310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:26:27.094310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 01:26:27.094310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:26:27.098932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 631/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:26:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:27.100045 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1ca83-91d7-41c4-ac14-fa744fd8d12b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:27.224264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1ca83-91d7-41c4-ac14-fa744fd8d12b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:27.262451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae10098-fa50-459d-a5fe-704ecd17c033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:27.263105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae10098-fa50-459d-a5fe-704ecd17c033 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:27.263386 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae10098-fa50-459d-a5fe-704ecd17c033 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:27.263720 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae10098-fa50-459d-a5fe-704ecd17c033 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:27.264389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae10098-fa50-459d-a5fe-704ecd17c033 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:27.264728 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae10098-fa50-459d-a5fe-704ecd17c033 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:27.266133 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae10098-fa50-459d-a5fe-704ecd17c033 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:27.286216 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 609/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Sep 26 01:26:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:27.293397 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307588b5-dd59-4893-b1ab-5a1b12bff7a3 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:27.409133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307588b5-dd59-4893-b1ab-5a1b12bff7a3 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:27.451435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f0fcc-83da-4fcd-865b-3e123ff44aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:27.452231 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f0fcc-83da-4fcd-865b-3e123ff44aba None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:27.452597 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f0fcc-83da-4fcd-865b-3e123ff44aba None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:27.452944 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f0fcc-83da-4fcd-865b-3e123ff44aba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:27.524560 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:27.533862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f0fcc-83da-4fcd-865b-3e123ff44aba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:27.535391 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f0fcc-83da-4fcd-865b-3e123ff44aba None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:27.662313 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 632/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:26:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 01:26:27.663856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae10098-fa50-459d-a5fe-704ecd17c033 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:27.697368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:27.787232 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae10098-fa50-459d-a5fe-704ecd17c033 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:27.828340 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac355b-69c6-4124-9aeb-67f3b75cfb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:27.829362 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac355b-69c6-4124-9aeb-67f3b75cfb4b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:27.829737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac355b-69c6-4124-9aeb-67f3b75cfb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:27.830090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac355b-69c6-4124-9aeb-67f3b75cfb4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:27.842244 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac355b-69c6-4124-9aeb-67f3b75cfb4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:27.844112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac355b-69c6-4124-9aeb-67f3b75cfb4b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:27.859752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-25ac355b-69c6-4124-9aeb-67f3b75cfb4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:27.859752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:27.859752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:27.859752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:27.859752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:27.859752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:27.859752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:27.859752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:27.859752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:27.859752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:27.859752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:27.859752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:27.859752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:26:27.859752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:26:27.859752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:26:27.859752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:26:27.862368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:27.862368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:27.862368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:27.862368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:27.862368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:27.862368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:27.862368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:27.862368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:27.862368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:27.862368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:27.862368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:27.862368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:27.862368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:27.862368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:27.862368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:27.862368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:27.862368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:26:27.863594 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:26:27.863594 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:27.863594 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:27.863594 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 610/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:27.867535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f0fcc-83da-4fcd-865b-3e123ff44aba None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:27.964975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:27.972296 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f0fcc-83da-4fcd-865b-3e123ff44aba None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:28.012196 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608a518-2f80-4792-afa0-aa6941602f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:28.012896 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608a518-2f80-4792-afa0-aa6941602f7e None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:28.013193 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608a518-2f80-4792-afa0-aa6941602f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:28.013542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608a518-2f80-4792-afa0-aa6941602f7e None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:28.014163 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608a518-2f80-4792-afa0-aa6941602f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:28.014486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608a518-2f80-4792-afa0-aa6941602f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:28.015865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608a518-2f80-4792-afa0-aa6941602f7e None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:28.027753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 633/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:28.034145 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac355b-69c6-4124-9aeb-67f3b75cfb4b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:28.123102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:28.150010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac355b-69c6-4124-9aeb-67f3b75cfb4b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:28.188172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e9dd6-fb21-4d30-acb1-7fedf2af3a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:28.188998 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e9dd6-fb21-4d30-acb1-7fedf2af3a24 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:28.189278 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e9dd6-fb21-4d30-acb1-7fedf2af3a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:28.189551 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e9dd6-fb21-4d30-acb1-7fedf2af3a24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:28.196532 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e9dd6-fb21-4d30-acb1-7fedf2af3a24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:28.198265 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e9dd6-fb21-4d30-acb1-7fedf2af3a24 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:28.212850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-c58e9dd6-fb21-4d30-acb1-7fedf2af3a24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:26:28.212850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:28.212850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:28.212850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:28.212850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:28.212850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:28.212850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:28.212850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:28.212850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:28.212850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:28.212850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:28.212850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:28.212850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:26:28.212850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:26:28.212850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:26:28.214031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:26:28.214031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:28.214031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:28.214031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:28.214031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:28.214031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:28.214031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:28.214031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:28.214031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:28.214031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:28.214031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:28.214031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:28.214031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:28.214031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:28.214031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:28.214031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:28.214031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:28.215985 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:26:28.215985 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:26:28.215985 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:26:28.215985 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:26:28.215985 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:26:28.215985 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:26:28.215985 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:26:28.215985 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:28.215985 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 611/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:26:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:28.220183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608a518-2f80-4792-afa0-aa6941602f7e None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:28.334789 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608a518-2f80-4792-afa0-aa6941602f7e None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:28.372351 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa0dcf-9166-43e3-80ad-3042567fdd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:28.372946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa0dcf-9166-43e3-80ad-3042567fdd41 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:28.373233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa0dcf-9166-43e3-80ad-3042567fdd41 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:28.373509 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa0dcf-9166-43e3-80ad-3042567fdd41 None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:28.374189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa0dcf-9166-43e3-80ad-3042567fdd41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:28.374491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa0dcf-9166-43e3-80ad-3042567fdd41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:28.376827 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa0dcf-9166-43e3-80ad-3042567fdd41 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:28.391858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 634/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:26:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:28.397913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e9dd6-fb21-4d30-acb1-7fedf2af3a24 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:28.513197 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e9dd6-fb21-4d30-acb1-7fedf2af3a24 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:28.551460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b571df4-e8f2-4408-8f8f-cd9dde1512b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:28.552334 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b571df4-e8f2-4408-8f8f-cd9dde1512b5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:28.552743 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b571df4-e8f2-4408-8f8f-cd9dde1512b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:28.553018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b571df4-e8f2-4408-8f8f-cd9dde1512b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:28.553807 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b571df4-e8f2-4408-8f8f-cd9dde1512b5 None admin] RBAC: Adding query filter params (role.id=8801886a5f4e4695a29b60c6eb347932, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=df7a1b839a6f4bdb9870217fa4d2527c) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:28.554117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b571df4-e8f2-4408-8f8f-cd9dde1512b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:28.555773 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b571df4-e8f2-4408-8f8f-cd9dde1512b5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:28.562034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 612/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:26:28 2022] GET /identity/v3/role_assignments?user.id=df7a1b839a6f4bdb9870217fa4d2527c&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=8801886a5f4e4695a29b60c6eb347932 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:26:31.071814 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a924fa3-1668-4d36-b61b-5f271eb75a39 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:31.072378 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a924fa3-1668-4d36-b61b-5f271eb75a39 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:31.072378 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a924fa3-1668-4d36-b61b-5f271eb75a39 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:31.074220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 635/1247] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:26:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:26:31.080975 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b25929-7c70-42a8-8151-eac3c33c578e None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:31.081448 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b25929-7c70-42a8-8151-eac3c33c578e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:31.081542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b25929-7c70-42a8-8151-eac3c33c578e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:31.087870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:31.100627 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-c3b25929-7c70-42a8-8151-eac3c33c578e None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:26:31.102089 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c3b25929-7c70-42a8-8151-eac3c33c578e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:26:31.190188 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 613/1248] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:26:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 01:26:31.478329 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a924fa3-1668-4d36-b61b-5f271eb75a39 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:31.498184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:31.591193 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a924fa3-1668-4d36-b61b-5f271eb75a39 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:31.630470 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94d86c-fb14-40bb-85f6-b6184990a6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:31.631125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94d86c-fb14-40bb-85f6-b6184990a6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:31.631407 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94d86c-fb14-40bb-85f6-b6184990a6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:31.631683 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94d86c-fb14-40bb-85f6-b6184990a6f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:31.642569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94d86c-fb14-40bb-85f6-b6184990a6f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:26:31.647903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-9c94d86c-fb14-40bb-85f6-b6184990a6f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:26:31.647903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:31.647903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:31.647903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:31.647903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:31.647903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:31.647903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:31.647903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:31.647903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:31.647903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:31.647903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:31.647903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:31.647903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:26:31.647903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:26:31.647903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:26:31.647903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:26:31.649079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:26:31.649079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:26:31.649079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:26:31.649079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:26:31.649079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:31.649079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:31.649079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:31.649079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:31.649079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:31.649079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:31.649079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:31.649079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:31.649079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:31.649079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:31.649079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:31.649079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:31.650141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:31.650141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:31.650141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:31.650141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:31.650141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:26:31.650141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:26:31.650141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:26:31.650141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:26:31.650141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:26:31.650141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:26:31.650141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:26:31.650141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:26:31.650141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 636/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:26:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:26:31.655365 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b25929-7c70-42a8-8151-eac3c33c578e None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:31.767726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b25929-7c70-42a8-8151-eac3c33c578e None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:31.800723 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:31.806344 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2c3a0-1a56-4076-9b10-5fe9e5e04c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:31.807015 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2c3a0-1a56-4076-9b10-5fe9e5e04c8c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:31.807300 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2c3a0-1a56-4076-9b10-5fe9e5e04c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:31.807574 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2c3a0-1a56-4076-9b10-5fe9e5e04c8c None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:31.808257 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2c3a0-1a56-4076-9b10-5fe9e5e04c8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:31.808562 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2c3a0-1a56-4076-9b10-5fe9e5e04c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:31.809972 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2c3a0-1a56-4076-9b10-5fe9e5e04c8c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:31.820403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 614/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:26:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:31.826691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94d86c-fb14-40bb-85f6-b6184990a6f3 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:31.911284 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:31.936390 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94d86c-fb14-40bb-85f6-b6184990a6f3 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:31.973197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5be16-88db-4bb6-a9da-5ce0a1db53ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:31.973837 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5be16-88db-4bb6-a9da-5ce0a1db53ef None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:31.974117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5be16-88db-4bb6-a9da-5ce0a1db53ef None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:31.974390 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5be16-88db-4bb6-a9da-5ce0a1db53ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:31.985860 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5be16-88db-4bb6-a9da-5ce0a1db53ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:31.987377 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5be16-88db-4bb6-a9da-5ce0a1db53ef None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:32.003574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-4fa5be16-88db-4bb6-a9da-5ce0a1db53ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:32.003574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:32.003574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:32.003574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:32.003574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:32.003574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:32.003574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:32.003574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:32.003574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:32.003574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:32.003574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:32.003574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:32.003574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:26:32.003574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:26:32.003574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:26:32.003574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:26:32.004790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:32.004790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:32.004790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:32.004790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:32.004790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:32.004790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:32.004790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:32.004790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:32.004790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:32.004790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:32.004790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:32.004790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:32.004790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:32.004790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:32.004790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:32.004790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:32.004790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:26:32.005893 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:26:32.005893 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:32.005893 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:26:32.005893 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 637/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:32.010579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2c3a0-1a56-4076-9b10-5fe9e5e04c8c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:32.122465 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2c3a0-1a56-4076-9b10-5fe9e5e04c8c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:32.164816 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb3b87-3e4f-4d33-9cb4-a11c52133c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:32.165431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb3b87-3e4f-4d33-9cb4-a11c52133c0a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:32.165712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb3b87-3e4f-4d33-9cb4-a11c52133c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:32.165986 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb3b87-3e4f-4d33-9cb4-a11c52133c0a None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:32.166645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb3b87-3e4f-4d33-9cb4-a11c52133c0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:32.166981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb3b87-3e4f-4d33-9cb4-a11c52133c0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:32.168360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb3b87-3e4f-4d33-9cb4-a11c52133c0a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:32.180926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 615/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:32.186679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5be16-88db-4bb6-a9da-5ce0a1db53ef None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:32.288635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5be16-88db-4bb6-a9da-5ce0a1db53ef None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:32.315596 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:32.324901 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afc77e-dcd5-431c-9484-1e5a495d2454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:32.325528 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afc77e-dcd5-431c-9484-1e5a495d2454 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:32.325813 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afc77e-dcd5-431c-9484-1e5a495d2454 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:32.326085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afc77e-dcd5-431c-9484-1e5a495d2454 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:32.333864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afc77e-dcd5-431c-9484-1e5a495d2454 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:32.335325 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afc77e-dcd5-431c-9484-1e5a495d2454 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:32.347456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-22afc77e-dcd5-431c-9484-1e5a495d2454 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 01:26:32.347456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:32.347456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:32.347456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:32.347456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:32.347456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:32.347456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:32.347456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:32.347456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:32.347456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:32.347456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:32.347456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:32.347456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:26:32.347456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:26:32.347456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:26:32.347456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:26:32.348589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:32.348589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:32.348589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:26:32.348589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:26:32.348589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:26:32.348589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:26:32.348589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:32.348589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:32.348589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:32.348589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:32.348589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:32.348589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:32.348589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:32.348589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:32.348589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:32.348589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:32.348589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:32.348589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:32.349551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:32.349551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:32.349551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:26:32.349551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:26:32.349551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:26:32.349551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:26:32.349551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:26:32.349551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:26:32.349551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 01:26:32.349551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:26:32.349551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 638/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:26:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:32.354360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb3b87-3e4f-4d33-9cb4-a11c52133c0a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:32.415880 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:32.463039 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb3b87-3e4f-4d33-9cb4-a11c52133c0a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:32.496480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acee029-d7f9-451d-8624-00058ae58506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:32.497070 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acee029-d7f9-451d-8624-00058ae58506 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:32.497346 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acee029-d7f9-451d-8624-00058ae58506 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:32.497610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acee029-d7f9-451d-8624-00058ae58506 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:32.498317 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acee029-d7f9-451d-8624-00058ae58506 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:32.498617 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acee029-d7f9-451d-8624-00058ae58506 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:32.500055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acee029-d7f9-451d-8624-00058ae58506 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:32.517180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 616/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Sep 26 01:26:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:32.523042 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afc77e-dcd5-431c-9484-1e5a495d2454 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:32.620734 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afc77e-dcd5-431c-9484-1e5a495d2454 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:32.653149 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95322971-39b0-407a-9056-f4dda6f70939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:32.653733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95322971-39b0-407a-9056-f4dda6f70939 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:32.654014 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95322971-39b0-407a-9056-f4dda6f70939 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:32.654287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95322971-39b0-407a-9056-f4dda6f70939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:32.707701 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:32.719739 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95322971-39b0-407a-9056-f4dda6f70939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:32.721301 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95322971-39b0-407a-9056-f4dda6f70939 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:32.814687 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 639/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:26:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 01:26:32.820510 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acee029-d7f9-451d-8624-00058ae58506 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:32.916644 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acee029-d7f9-451d-8624-00058ae58506 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:32.929844 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:32.950979 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79907e79-6bc1-43ce-89f4-96d190a33325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:32.951586 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79907e79-6bc1-43ce-89f4-96d190a33325 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:32.951860 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79907e79-6bc1-43ce-89f4-96d190a33325 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:32.952130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79907e79-6bc1-43ce-89f4-96d190a33325 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:32.961940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79907e79-6bc1-43ce-89f4-96d190a33325 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:32.963354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79907e79-6bc1-43ce-89f4-96d190a33325 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:32.977945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-79907e79-6bc1-43ce-89f4-96d190a33325 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:32.977945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:32.977945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:32.977945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:32.977945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:32.977945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:32.977945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:32.977945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:32.977945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:32.977945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:32.977945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:32.977945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:32.977945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:26:32.977945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:26:32.977945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:26:32.977945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:26:32.983508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:32.983508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:32.983508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:32.983508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:32.983508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:32.983508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:32.983508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:32.983508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:32.983508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:32.983508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:32.983508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:32.983508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:32.983508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:32.983508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:32.983508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:32.983508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:32.983508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:26:32.984676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:26:32.984676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:32.984676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:32.984676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 617/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:32.984965 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95322971-39b0-407a-9056-f4dda6f70939 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:33.067673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:33.080019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95322971-39b0-407a-9056-f4dda6f70939 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:33.117674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626378a-cbd6-48d6-b4f0-5e63d8384d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:33.118342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626378a-cbd6-48d6-b4f0-5e63d8384d9d None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:33.118749 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626378a-cbd6-48d6-b4f0-5e63d8384d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:33.119134 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626378a-cbd6-48d6-b4f0-5e63d8384d9d None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:33.120066 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626378a-cbd6-48d6-b4f0-5e63d8384d9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:33.120374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626378a-cbd6-48d6-b4f0-5e63d8384d9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:33.122073 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626378a-cbd6-48d6-b4f0-5e63d8384d9d None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:33.135425 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 640/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:33.141495 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79907e79-6bc1-43ce-89f4-96d190a33325 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:33.244015 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79907e79-6bc1-43ce-89f4-96d190a33325 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:33.275892 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1b241-6f96-4b12-b15d-7e86b558ad5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:33.276501 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1b241-6f96-4b12-b15d-7e86b558ad5f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:33.276776 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1b241-6f96-4b12-b15d-7e86b558ad5f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:33.277043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1b241-6f96-4b12-b15d-7e86b558ad5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:33.283959 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1b241-6f96-4b12-b15d-7e86b558ad5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:33.285378 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1b241-6f96-4b12-b15d-7e86b558ad5f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:33.296172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-fbe1b241-6f96-4b12-b15d-7e86b558ad5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:26:33.296172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:33.296172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:33.296172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:33.296172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:33.296172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:33.296172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:33.296172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:33.296172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:33.296172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:33.296172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:33.296172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:33.296172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:26:33.296172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:26:33.296172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:26:33.297290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:26:33.297290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:33.297290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:33.297290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:33.297290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:33.297290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:33.297290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:33.297290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:33.297290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:33.297290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:33.297290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:33.297290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:33.297290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:33.297290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:33.297290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:33.297290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:33.297290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:33.299037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:26:33.299037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:26:33.299037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:26:33.299037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:26:33.299037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:26:33.299037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:26:33.299037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:26:33.299037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:33.299037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 618/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:26:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:26:33.303766 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626378a-cbd6-48d6-b4f0-5e63d8384d9d None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:33.401126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626378a-cbd6-48d6-b4f0-5e63d8384d9d None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:33.434308 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e1e62-3131-4ab0-97bd-3c981e01c1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:33.434937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e1e62-3131-4ab0-97bd-3c981e01c1ad None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:33.435215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e1e62-3131-4ab0-97bd-3c981e01c1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:33.435484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e1e62-3131-4ab0-97bd-3c981e01c1ad None admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:33.436163 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e1e62-3131-4ab0-97bd-3c981e01c1ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:33.436463 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e1e62-3131-4ab0-97bd-3c981e01c1ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:33.437866 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e1e62-3131-4ab0-97bd-3c981e01c1ad None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:33.449919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 641/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:26:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:33.456697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1b241-6f96-4b12-b15d-7e86b558ad5f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:33.482619 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:33.555022 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1b241-6f96-4b12-b15d-7e86b558ad5f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:33.587379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ded057-467f-4eba-92f5-897bfeefd95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:33.587969 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ded057-467f-4eba-92f5-897bfeefd95c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:33.588246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ded057-467f-4eba-92f5-897bfeefd95c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:33.588518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ded057-467f-4eba-92f5-897bfeefd95c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:33.589227 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ded057-467f-4eba-92f5-897bfeefd95c None admin] RBAC: Adding query filter params (role.id=50adf18edc1a47b2bae0876828a88dbf, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=df7a1b839a6f4bdb9870217fa4d2527c) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:33.589536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ded057-467f-4eba-92f5-897bfeefd95c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:33.590990 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ded057-467f-4eba-92f5-897bfeefd95c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:33.596856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 619/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:26:33 2022] GET /identity/v3/role_assignments?user.id=df7a1b839a6f4bdb9870217fa4d2527c&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:35.691425 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0897aa-9ab7-4d56-b255-14edc439f5d8 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:35.691946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0897aa-9ab7-4d56-b255-14edc439f5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:35.691946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0897aa-9ab7-4d56-b255-14edc439f5d8 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:35.693211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 642/1261] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:26:35.698347 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a95a7-4bfc-4643-9209-2dfaf1826ea5 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:35.698745 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a95a7-4bfc-4643-9209-2dfaf1826ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:35.698921 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a95a7-4bfc-4643-9209-2dfaf1826ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:35.716935 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-251a95a7-4bfc-4643-9209-2dfaf1826ea5 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:26:35.718112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-251a95a7-4bfc-4643-9209-2dfaf1826ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:26:35.782988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 620/1262] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:26:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:26:36.049429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0897aa-9ab7-4d56-b255-14edc439f5d8 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:36.060209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:36.157358 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0897aa-9ab7-4d56-b255-14edc439f5d8 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:36.197460 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cb0e0-9d53-4dfa-b363-05d61bbd7896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:36.198330 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cb0e0-9d53-4dfa-b363-05d61bbd7896 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:36.198607 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cb0e0-9d53-4dfa-b363-05d61bbd7896 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:36.198908 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cb0e0-9d53-4dfa-b363-05d61bbd7896 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:36.208719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0cb0e0-9d53-4dfa-b363-05d61bbd7896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:26:36.213447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-6d0cb0e0-9d53-4dfa-b363-05d61bbd7896 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:26:36.213447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:36.213447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:36.213447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:36.213447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:36.213447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:36.213447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:36.213447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:36.213447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:36.213447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:36.213447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:36.213447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:36.213447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:26:36.213447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:26:36.213447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:26:36.213447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:26:36.214505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:26:36.214505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:26:36.214505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:26:36.214505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:26:36.214505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:36.214505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:36.214505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:36.214505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:36.214505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:36.214505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:36.214505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:36.214505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:36.214505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:36.214505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:36.214505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:36.214505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:36.215402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:36.215402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:36.215402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:36.215402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:36.215402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:26:36.215402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:26:36.215402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:26:36.215402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:26:36.215402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:26:36.215402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:26:36.215402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:26:36.215402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:26:36.215402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 643/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:26:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:36.221227 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a95a7-4bfc-4643-9209-2dfaf1826ea5 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:36.239483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:36.317749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a95a7-4bfc-4643-9209-2dfaf1826ea5 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:36.351578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36e4ac-0988-49c6-8a86-5f7fbec9e7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:36.352172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36e4ac-0988-49c6-8a86-5f7fbec9e7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:36.352449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36e4ac-0988-49c6-8a86-5f7fbec9e7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:36.352716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36e4ac-0988-49c6-8a86-5f7fbec9e7c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:36.353359 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36e4ac-0988-49c6-8a86-5f7fbec9e7c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:36.353656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36e4ac-0988-49c6-8a86-5f7fbec9e7c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:36.355030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36e4ac-0988-49c6-8a86-5f7fbec9e7c4 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:36.362878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 621/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:26:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:36.368716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cb0e0-9d53-4dfa-b363-05d61bbd7896 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:36.435732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:36.468116 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cb0e0-9d53-4dfa-b363-05d61bbd7896 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:36.501638 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e7574-d592-48bd-9873-425d30898657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:36.502247 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e7574-d592-48bd-9873-425d30898657 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:36.502526 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e7574-d592-48bd-9873-425d30898657 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:36.502797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e7574-d592-48bd-9873-425d30898657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:36.512444 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e7574-d592-48bd-9873-425d30898657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:36.513870 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e7574-d592-48bd-9873-425d30898657 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:36.528340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-f97e7574-d592-48bd-9873-425d30898657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:36.528340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:36.528340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:36.528340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:36.528340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:36.528340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:36.528340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:36.528340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:36.528340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:36.528340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:36.528340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:36.528340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:36.528340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:26:36.528340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:26:36.528340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:26:36.528340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:26:36.529478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:36.529478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:36.529478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:36.529478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:36.529478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:36.529478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:36.529478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:36.529478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:36.529478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:36.529478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:36.529478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:36.529478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:36.529478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:36.529478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:36.529478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:36.529478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:36.529478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:26:36.530586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:26:36.530586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:36.530586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:26:36.530586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 644/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 01:26:36.535851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36e4ac-0988-49c6-8a86-5f7fbec9e7c4 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:36.614249 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:36.633073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36e4ac-0988-49c6-8a86-5f7fbec9e7c4 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:36.666327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb8a7b-f0f6-42a1-b118-e422714270fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:36.666953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb8a7b-f0f6-42a1-b118-e422714270fc None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:36.667237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb8a7b-f0f6-42a1-b118-e422714270fc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:36.667513 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb8a7b-f0f6-42a1-b118-e422714270fc None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:36.668145 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb8a7b-f0f6-42a1-b118-e422714270fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:36.668448 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb8a7b-f0f6-42a1-b118-e422714270fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:36.669800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb8a7b-f0f6-42a1-b118-e422714270fc None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:36.681252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 622/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:36.687072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e7574-d592-48bd-9873-425d30898657 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:36.783736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e7574-d592-48bd-9873-425d30898657 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:36.802108 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:36.816126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dc8e1-dc5d-4cb7-9f32-88208ce4b781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:36.816725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dc8e1-dc5d-4cb7-9f32-88208ce4b781 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:36.817002 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dc8e1-dc5d-4cb7-9f32-88208ce4b781 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:36.817272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dc8e1-dc5d-4cb7-9f32-88208ce4b781 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:36.824601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dc8e1-dc5d-4cb7-9f32-88208ce4b781 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:36.826004 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dc8e1-dc5d-4cb7-9f32-88208ce4b781 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:36.836937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-696dc8e1-dc5d-4cb7-9f32-88208ce4b781 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 01:26:36.836937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:36.836937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:36.836937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:36.836937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:36.836937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:36.836937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:36.836937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:36.836937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:36.836937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:36.836937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:36.836937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:36.836937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:26:36.836937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:26:36.836937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:26:36.836937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:26:36.842578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:36.842578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:36.842578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:26:36.842578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:26:36.842578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:26:36.842578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:26:36.842578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:36.842578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:36.842578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:36.842578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:36.842578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:36.842578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:36.842578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:36.842578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:36.842578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:36.842578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:36.842578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:36.842578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:36.843776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:36.843776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:36.843776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:26:36.843776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:26:36.843776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:26:36.843776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:26:36.843776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:26:36.843776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:26:36.843776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 01:26:36.843776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:26:36.843776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 645/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:26:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:36.845094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb8a7b-f0f6-42a1-b118-e422714270fc None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:36.939787 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb8a7b-f0f6-42a1-b118-e422714270fc None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:36.972703 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddbaf9-b8d9-492c-a221-c57c7528c3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:36.973288 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddbaf9-b8d9-492c-a221-c57c7528c3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:36.973561 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddbaf9-b8d9-492c-a221-c57c7528c3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:36.973832 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddbaf9-b8d9-492c-a221-c57c7528c3b8 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:36.974534 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddbaf9-b8d9-492c-a221-c57c7528c3b8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:36.974861 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddbaf9-b8d9-492c-a221-c57c7528c3b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:36.976268 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddbaf9-b8d9-492c-a221-c57c7528c3b8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:36.984606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:36.993496 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 623/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Sep 26 01:26:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:36.999212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dc8e1-dc5d-4cb7-9f32-88208ce4b781 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:37.096459 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dc8e1-dc5d-4cb7-9f32-88208ce4b781 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:37.136736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32a14c-1c86-4dbf-b9a4-68fefef2b3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:37.137353 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32a14c-1c86-4dbf-b9a4-68fefef2b3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:37.137631 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32a14c-1c86-4dbf-b9a4-68fefef2b3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:37.137902 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32a14c-1c86-4dbf-b9a4-68fefef2b3b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:37.148203 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32a14c-1c86-4dbf-b9a4-68fefef2b3b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:37.149623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32a14c-1c86-4dbf-b9a4-68fefef2b3b1 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:37.163189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-5a32a14c-1c86-4dbf-b9a4-68fefef2b3b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:37.163189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:37.163189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:37.163189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:37.163189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:37.163189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:37.163189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:37.163189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:37.163189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:37.163189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:37.163189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:37.163189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:37.163189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:26:37.163189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:26:37.163189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:26:37.163189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:26:37.164298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:37.164298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:37.164298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:37.164298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:37.164298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:37.164298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:37.164298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:37.164298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:37.164298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:37.164298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:37.164298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:37.164298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:37.164298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:37.164298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:37.164298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:37.164298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:37.164298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:26:37.165596 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:26:37.165596 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:37.165596 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:26:37.165596 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 646/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:37.170015 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddbaf9-b8d9-492c-a221-c57c7528c3b8 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:37.268683 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddbaf9-b8d9-492c-a221-c57c7528c3b8 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:37.301759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b0734-1459-4377-80a0-bae2c09b8cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:37.302354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b0734-1459-4377-80a0-bae2c09b8cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:37.302636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b0734-1459-4377-80a0-bae2c09b8cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:37.302940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b0734-1459-4377-80a0-bae2c09b8cb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:37.303573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b0734-1459-4377-80a0-bae2c09b8cb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:37.303875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b0734-1459-4377-80a0-bae2c09b8cb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:37.305232 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b0734-1459-4377-80a0-bae2c09b8cb9 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:37.316823 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 624/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:37.322439 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32a14c-1c86-4dbf-b9a4-68fefef2b3b1 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:37.353033 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:37.420894 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32a14c-1c86-4dbf-b9a4-68fefef2b3b1 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:37.454650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fc031-7bca-49dd-bdc3-2a914dcfd092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:37.455292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fc031-7bca-49dd-bdc3-2a914dcfd092 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:37.455571 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fc031-7bca-49dd-bdc3-2a914dcfd092 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:37.455843 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fc031-7bca-49dd-bdc3-2a914dcfd092 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:37.462318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fc031-7bca-49dd-bdc3-2a914dcfd092 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:37.463778 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fc031-7bca-49dd-bdc3-2a914dcfd092 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:37.475374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-096fc031-7bca-49dd-bdc3-2a914dcfd092 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:26:37.475374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:37.475374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:37.475374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:37.475374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:37.475374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:37.475374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:37.475374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:37.475374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:37.475374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:37.475374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:37.475374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:37.475374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:26:37.475374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:26:37.475374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:26:37.476455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:26:37.476455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:37.476455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:37.476455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:37.476455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:37.476455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:37.476455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:37.476455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:37.476455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:37.476455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:37.476455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:37.476455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:37.476455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:37.476455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:37.476455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:37.476455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:37.476455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:37.477738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:26:37.477738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:26:37.477738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:26:37.477738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:26:37.477738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:26:37.477738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:26:37.477738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:26:37.477738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:26:37.477738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 647/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:26:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:37.482282 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b0734-1459-4377-80a0-bae2c09b8cb9 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:37.538658 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:37.580400 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b0734-1459-4377-80a0-bae2c09b8cb9 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:37.613447 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9e1dd-73ad-40d2-97d0-f54972e7d83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:37.614041 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9e1dd-73ad-40d2-97d0-f54972e7d83f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:37.614322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9e1dd-73ad-40d2-97d0-f54972e7d83f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:37.614594 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9e1dd-73ad-40d2-97d0-f54972e7d83f None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:37.615310 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9e1dd-73ad-40d2-97d0-f54972e7d83f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:37.615618 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9e1dd-73ad-40d2-97d0-f54972e7d83f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:37.617073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9e1dd-73ad-40d2-97d0-f54972e7d83f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:37.628795 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 625/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:26:37.634704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fc031-7bca-49dd-bdc3-2a914dcfd092 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:37.723512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:37.732370 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fc031-7bca-49dd-bdc3-2a914dcfd092 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:37.767640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d106f-3070-4a0e-bb71-8da389389010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:37.768292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d106f-3070-4a0e-bb71-8da389389010 None admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:37.768569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d106f-3070-4a0e-bb71-8da389389010 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:37.768840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d106f-3070-4a0e-bb71-8da389389010 None admin] PATH_INFO: `/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/df7a1b839a6f4bdb9870217fa4d2527c/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:37.770700 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d106f-3070-4a0e-bb71-8da389389010 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fda1727cc3d47b9a1fae73c74f32c27, user_id=df7a1b839a6f4bdb9870217fa4d2527c, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:37.772134 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d106f-3070-4a0e-bb71-8da389389010 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:37.784368 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 648/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 26 01:26:37 2022] PUT /identity/v3/projects/0fda1727cc3d47b9a1fae73c74f32c27/users/df7a1b839a6f4bdb9870217fa4d2527c/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:26:39.897799 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056af75-4d9a-4b20-9668-0819c56df7b1 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:39.898355 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056af75-4d9a-4b20-9668-0819c56df7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:39.898355 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056af75-4d9a-4b20-9668-0819c56df7b1 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:39.899685 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 626/1274] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:26:39.904753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ec5d1-86ed-4cc6-9410-18dacac3303d None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:39.905167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ec5d1-86ed-4cc6-9410-18dacac3303d None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:39.905303 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ec5d1-86ed-4cc6-9410-18dacac3303d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:39.923251 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-224ec5d1-86ed-4cc6-9410-18dacac3303d None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:26:39.924423 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-224ec5d1-86ed-4cc6-9410-18dacac3303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:26:39.989216 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 649/1275] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:26:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:26:40.262495 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056af75-4d9a-4b20-9668-0819c56df7b1 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:40.361327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056af75-4d9a-4b20-9668-0819c56df7b1 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:40.378407 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:40.395027 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38aa69-af7c-429e-9190-52d309930a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:40.395651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38aa69-af7c-429e-9190-52d309930a8e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:40.395927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38aa69-af7c-429e-9190-52d309930a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:40.396196 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38aa69-af7c-429e-9190-52d309930a8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:40.406241 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38aa69-af7c-429e-9190-52d309930a8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 01:26:40.411091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-eb38aa69-af7c-429e-9190-52d309930a8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:26:40.411091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:40.411091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:40.411091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:40.411091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:40.411091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:40.411091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:40.411091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:40.411091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:40.411091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:40.411091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:40.411091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:40.411091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 01:26:40.411091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 01:26:40.411091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 01:26:40.411091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 01:26:40.412168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 01:26:40.412168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 01:26:40.412168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 01:26:40.412168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 01:26:40.412168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:40.412168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:40.412168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:40.412168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:40.412168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:40.412168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:40.412168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:40.412168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:40.412168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:40.412168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:40.412168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:40.412168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:40.413316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:40.413316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:40.413316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:40.413316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:40.413316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 01:26:40.413316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 01:26:40.413316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 01:26:40.413316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 01:26:40.413316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 01:26:40.413316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 01:26:40.413316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 01:26:40.413316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:40.413316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 627/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 26 01:26:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:40.418028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ec5d1-86ed-4cc6-9410-18dacac3303d None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:40.497379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:40.515600 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ec5d1-86ed-4cc6-9410-18dacac3303d None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:40.548643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be725517-e5be-4fea-ae3d-a692f1602edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:40.549241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be725517-e5be-4fea-ae3d-a692f1602edd None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:40.549518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be725517-e5be-4fea-ae3d-a692f1602edd None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:40.549789 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be725517-e5be-4fea-ae3d-a692f1602edd None admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:40.550437 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be725517-e5be-4fea-ae3d-a692f1602edd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:40.550737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be725517-e5be-4fea-ae3d-a692f1602edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:40.552108 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be725517-e5be-4fea-ae3d-a692f1602edd None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:40.559817 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 650/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 26 01:26:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:40.565714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38aa69-af7c-429e-9190-52d309930a8e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:40.663713 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38aa69-af7c-429e-9190-52d309930a8e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:40.696999 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a5471-e8cd-4a00-b1c1-034eb4d24fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:40.697607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a5471-e8cd-4a00-b1c1-034eb4d24fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:40.697888 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a5471-e8cd-4a00-b1c1-034eb4d24fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:40.698425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a5471-e8cd-4a00-b1c1-034eb4d24fa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:40.708154 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a5471-e8cd-4a00-b1c1-034eb4d24fa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:40.709582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a5471-e8cd-4a00-b1c1-034eb4d24fa5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:40.724503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-d65a5471-e8cd-4a00-b1c1-034eb4d24fa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:40.724503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:40.724503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:40.724503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:40.724503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:40.724503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:40.724503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:40.724503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:40.724503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:40.724503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:40.724503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:40.724503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:40.724503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:26:40.724503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:26:40.724503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:26:40.724503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:26:40.725679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:40.725679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:40.725679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:40.725679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:40.725679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:40.725679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:40.725679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:40.725679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:40.725679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:40.725679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:40.725679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:40.725679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:40.725679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:40.725679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:40.725679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:40.725679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:40.725679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:26:40.726587 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:26:40.726587 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:40.726587 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:40.726587 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 628/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:40.731316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be725517-e5be-4fea-ae3d-a692f1602edd None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:40.828004 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be725517-e5be-4fea-ae3d-a692f1602edd None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:40.859820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f2541-83fc-45e2-9227-f65715d8f2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:40.861088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f2541-83fc-45e2-9227-f65715d8f2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:40.861378 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f2541-83fc-45e2-9227-f65715d8f2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:40.861651 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f2541-83fc-45e2-9227-f65715d8f2f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:40.862289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f2541-83fc-45e2-9227-f65715d8f2f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:40.862591 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f2541-83fc-45e2-9227-f65715d8f2f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:40.863966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f2541-83fc-45e2-9227-f65715d8f2f2 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:40.875146 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 651/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:40.880762 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a5471-e8cd-4a00-b1c1-034eb4d24fa5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:40.911635 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:40.979509 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a5471-e8cd-4a00-b1c1-034eb4d24fa5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:41.010927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a599c-1a14-4113-85d9-8773ff272092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:41.011531 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a599c-1a14-4113-85d9-8773ff272092 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:41.011806 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a599c-1a14-4113-85d9-8773ff272092 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:41.012075 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a599c-1a14-4113-85d9-8773ff272092 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:41.019644 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a599c-1a14-4113-85d9-8773ff272092 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:41.021057 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a599c-1a14-4113-85d9-8773ff272092 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:41.032583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-8b1a599c-1a14-4113-85d9-8773ff272092 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 01:26:41.032583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:41.032583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:41.032583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:41.032583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:41.032583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:41.032583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:41.032583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:41.032583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:41.032583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:41.032583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:41.032583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:41.032583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 01:26:41.032583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 01:26:41.032583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 01:26:41.032583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 01:26:41.033722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:41.033722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:41.033722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 01:26:41.033722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:26:41.033722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 01:26:41.033722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 01:26:41.033722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:41.033722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:41.033722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:41.033722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:41.033722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:41.033722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:41.033722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:41.033722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:41.033722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:41.033722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:41.033722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:41.033722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:41.034705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:41.034705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:41.034705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 01:26:41.034705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 01:26:41.034705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 01:26:41.034705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 01:26:41.034705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 01:26:41.034705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 01:26:41.034705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 01:26:41.034705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:41.034705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 629/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:26:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:41.039446 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f2541-83fc-45e2-9227-f65715d8f2f2 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:41.043220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:41.135945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f2541-83fc-45e2-9227-f65715d8f2f2 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:41.168930 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db6792-9be2-4908-87a7-f54e01863e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:41.169513 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db6792-9be2-4908-87a7-f54e01863e94 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:41.169788 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db6792-9be2-4908-87a7-f54e01863e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:41.170056 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db6792-9be2-4908-87a7-f54e01863e94 None admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:41.170769 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db6792-9be2-4908-87a7-f54e01863e94 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:41.171099 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db6792-9be2-4908-87a7-f54e01863e94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:41.172594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db6792-9be2-4908-87a7-f54e01863e94 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:41.189335 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 652/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Sep 26 01:26:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:26:41.195134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a599c-1a14-4113-85d9-8773ff272092 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:41.287125 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:41.296822 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a599c-1a14-4113-85d9-8773ff272092 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:41.329779 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a0ec4-699b-41e4-97be-03d4d601620b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:41.330367 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a0ec4-699b-41e4-97be-03d4d601620b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:41.330642 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a0ec4-699b-41e4-97be-03d4d601620b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:41.330935 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a0ec4-699b-41e4-97be-03d4d601620b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:41.394573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a0ec4-699b-41e4-97be-03d4d601620b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:41.395965 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a0ec4-699b-41e4-97be-03d4d601620b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:41.481566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:41.491620 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 630/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 26 01:26:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 01:26:41.497417 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db6792-9be2-4908-87a7-f54e01863e94 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:41.558048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:41.596380 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db6792-9be2-4908-87a7-f54e01863e94 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:41.628979 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700eade-4cb9-45a6-a431-45f29b386793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:41.629579 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700eade-4cb9-45a6-a431-45f29b386793 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:41.629857 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700eade-4cb9-45a6-a431-45f29b386793 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:41.630126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700eade-4cb9-45a6-a431-45f29b386793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:41.639696 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700eade-4cb9-45a6-a431-45f29b386793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:41.641108 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700eade-4cb9-45a6-a431-45f29b386793 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:41.655732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-a700eade-4cb9-45a6-a431-45f29b386793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:41.655732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:41.655732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:41.655732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:41.655732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:41.655732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:41.655732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:41.655732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:41.655732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:41.655732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:41.655732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:41.655732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:41.655732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 01:26:41.655732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 01:26:41.655732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 01:26:41.655732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 01:26:41.656881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:41.656881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:41.656881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:41.656881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:41.656881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:41.656881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:41.656881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:41.656881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:41.656881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:41.656881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:41.656881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:41.656881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:41.656881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:41.656881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:41.656881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:41.656881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:41.656881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 01:26:41.658755 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 01:26:41.658755 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 01:26:41.658755 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:26:41.658755 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 653/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:41.662991 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a0ec4-699b-41e4-97be-03d4d601620b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:41.757894 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a0ec4-699b-41e4-97be-03d4d601620b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:41.791135 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2223a52-d498-4867-b6f1-79b37ac0fd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:41.791717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2223a52-d498-4867-b6f1-79b37ac0fd82 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:41.791991 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2223a52-d498-4867-b6f1-79b37ac0fd82 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:41.792258 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2223a52-d498-4867-b6f1-79b37ac0fd82 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:41.792879 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2223a52-d498-4867-b6f1-79b37ac0fd82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:41.793173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2223a52-d498-4867-b6f1-79b37ac0fd82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:41.794510 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2223a52-d498-4867-b6f1-79b37ac0fd82 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:41.805371 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 631/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 26 01:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:41.810972 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700eade-4cb9-45a6-a431-45f29b386793 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:41.907550 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700eade-4cb9-45a6-a431-45f29b386793 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:41.920406 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:41.940088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37376b4c-fe7b-4f2f-b7a5-45e58fc68591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:41.940694 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37376b4c-fe7b-4f2f-b7a5-45e58fc68591 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:41.940974 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37376b4c-fe7b-4f2f-b7a5-45e58fc68591 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:41.941245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37376b4c-fe7b-4f2f-b7a5-45e58fc68591 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:41.947587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37376b4c-fe7b-4f2f-b7a5-45e58fc68591 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:41.949273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37376b4c-fe7b-4f2f-b7a5-45e58fc68591 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:41.960679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application [None req-37376b4c-fe7b-4f2f-b7a5-45e58fc68591 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:26:41.960679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:41.960679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:41.960679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:41.960679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:41.960679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:41.960679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:41.960679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:41.960679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:41.960679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:41.960679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:41.960679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:41.960679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 01:26:41.960679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 01:26:41.960679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 01:26:41.961761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 01:26:41.961761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:41.961761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:41.961761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:41.961761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:41.961761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:41.961761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:41.961761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:41.961761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:41.961761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:41.961761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:41.961761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:41.961761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:41.961761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:41.961761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:41.961761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:41.961761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:41.963067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 01:26:41.963067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 01:26:41.963067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 01:26:41.963067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 01:26:41.963067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 01:26:41.963067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 01:26:41.963067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 01:26:41.963067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: ERROR keystone.server.flask.application Sep 26 01:26:41.963067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 654/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 26 01:26:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:41.967423 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2223a52-d498-4867-b6f1-79b37ac0fd82 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:42.016217 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:42.065795 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2223a52-d498-4867-b6f1-79b37ac0fd82 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:42.098769 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205cd7c-f713-4e0c-b840-dbe2f5f54fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:42.099394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205cd7c-f713-4e0c-b840-dbe2f5f54fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:42.099670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205cd7c-f713-4e0c-b840-dbe2f5f54fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:42.099942 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205cd7c-f713-4e0c-b840-dbe2f5f54fb5 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:42.100619 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205cd7c-f713-4e0c-b840-dbe2f5f54fb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:42.100925 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205cd7c-f713-4e0c-b840-dbe2f5f54fb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:42.102412 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205cd7c-f713-4e0c-b840-dbe2f5f54fb5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:42.114230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 632/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 26 01:26:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:42.120301 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37376b4c-fe7b-4f2f-b7a5-45e58fc68591 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:42.217280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37376b4c-fe7b-4f2f-b7a5-45e58fc68591 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:42.249412 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0562c-ba5d-4b27-982a-8c1da43b8dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:42.249990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0562c-ba5d-4b27-982a-8c1da43b8dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:42.250270 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0562c-ba5d-4b27-982a-8c1da43b8dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:42.250539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0562c-ba5d-4b27-982a-8c1da43b8dc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:42.251776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0562c-ba5d-4b27-982a-8c1da43b8dc4 None admin] RBAC: Adding query filter params (role.id=50adf18edc1a47b2bae0876828a88dbf, scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27, user.id=df7a1b839a6f4bdb9870217fa4d2527c) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:42.252073 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0562c-ba5d-4b27-982a-8c1da43b8dc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:42.253464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0562c-ba5d-4b27-982a-8c1da43b8dc4 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:42.259000 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 655/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 26 01:26:42 2022] GET /identity/v3/role_assignments?user.id=df7a1b839a6f4bdb9870217fa4d2527c&scope.project.id=0fda1727cc3d47b9a1fae73c74f32c27&role.id=50adf18edc1a47b2bae0876828a88dbf => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:44.401651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6cbdf-d195-409a-88ce-3d0127e47c61 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:44.402204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6cbdf-d195-409a-88ce-3d0127e47c61 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:44.402204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6cbdf-d195-409a-88ce-3d0127e47c61 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:44.403534 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 633/1288] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:26:44.408691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88945f28-f5ec-4b9c-bee6-b15219a37f72 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:44.409072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88945f28-f5ec-4b9c-bee6-b15219a37f72 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:44.409238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88945f28-f5ec-4b9c-bee6-b15219a37f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:44.427226 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-88945f28-f5ec-4b9c-bee6-b15219a37f72 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:26:44.428405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-88945f28-f5ec-4b9c-bee6-b15219a37f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:26:44.458147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:44.493665 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 656/1289] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:26:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:26:44.760113 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6cbdf-d195-409a-88ce-3d0127e47c61 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:44.857350 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6cbdf-d195-409a-88ce-3d0127e47c61 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:44.868392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:44.891640 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79321f40-ec86-4112-af24-420e188978fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:44.892320 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79321f40-ec86-4112-af24-420e188978fd None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:44.892596 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79321f40-ec86-4112-af24-420e188978fd None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:44.892865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79321f40-ec86-4112-af24-420e188978fd None admin] PATH_INFO: `/v3/services/placement` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:44.893433 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79321f40-ec86-4112-af24-420e188978fd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:44.894771 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79321f40-ec86-4112-af24-420e188978fd None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:44.903325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-79321f40-ec86-4112-af24-420e188978fd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 01:26:44.903325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:44.903325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:26:44.903325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:26:44.903325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:26:44.903325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:26:44.903325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:26:44.903325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:26:44.903325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 01:26:44.903325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:44.903325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:26:44.903325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:44.903325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:44.903325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:44.903325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:44.903325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:44.903325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:44.904611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:44.904611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:44.904611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:44.904611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:44.904611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:44.904611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:44.904611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:26:44.904611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:26:44.904611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:26:44.904611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:26:44.904611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:44.904611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:44.904611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:44.904611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:44.904611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:44.904611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:44.905548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:44.905548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:44.905548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:44.905548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:44.905548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:44.905548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:44.905548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:44.905548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:44.905548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:44.905548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:44.905548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:26:44.905548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:26:44.905548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 01:26:44.905548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:44.905548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 634/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 26 01:26:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:44.910283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88945f28-f5ec-4b9c-bee6-b15219a37f72 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:45.005128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88945f28-f5ec-4b9c-bee6-b15219a37f72 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:45.038224 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b4855-d74b-4203-a0dd-7be663fd2f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:45.038745 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b4855-d74b-4203-a0dd-7be663fd2f00 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:45.039057 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b4855-d74b-4203-a0dd-7be663fd2f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:45.039333 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b4855-d74b-4203-a0dd-7be663fd2f00 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:45.039955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b4855-d74b-4203-a0dd-7be663fd2f00 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:45.040255 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b4855-d74b-4203-a0dd-7be663fd2f00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:45.041599 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b4855-d74b-4203-a0dd-7be663fd2f00 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:45.046254 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 657/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Sep 26 01:26:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:45.052807 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79321f40-ec86-4112-af24-420e188978fd None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:45.163341 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79321f40-ec86-4112-af24-420e188978fd None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:45.202078 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8742f9d-36fc-42ac-8e31-23996e065022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:45.202668 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8742f9d-36fc-42ac-8e31-23996e065022 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:45.202976 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8742f9d-36fc-42ac-8e31-23996e065022 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:45.203245 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8742f9d-36fc-42ac-8e31-23996e065022 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:45.203963 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8742f9d-36fc-42ac-8e31-23996e065022 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:45.204313 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8742f9d-36fc-42ac-8e31-23996e065022 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:45.205693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8742f9d-36fc-42ac-8e31-23996e065022 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:45.209922 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 635/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Sep 26 01:26:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:47.343647 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68596688-a3d5-4ee0-adcc-49b12aa1983a None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:47.344184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68596688-a3d5-4ee0-adcc-49b12aa1983a None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:47.344184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68596688-a3d5-4ee0-adcc-49b12aa1983a None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:47.345630 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 658/1293] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:26:47.350705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86750e-bff0-4411-917d-f0c110b4954b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:47.351160 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86750e-bff0-4411-917d-f0c110b4954b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:47.351280 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86750e-bff0-4411-917d-f0c110b4954b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:47.369084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-ca86750e-bff0-4411-917d-f0c110b4954b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:26:47.370258 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ca86750e-bff0-4411-917d-f0c110b4954b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:26:47.404014 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:47.441681 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 636/1294] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:26:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:26:47.708776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68596688-a3d5-4ee0-adcc-49b12aa1983a None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:47.739290 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:47.808386 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68596688-a3d5-4ee0-adcc-49b12aa1983a None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:47.841764 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd5b3f-f351-4ab5-975c-59e53f294d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:47.842355 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd5b3f-f351-4ab5-975c-59e53f294d42 None admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:47.842638 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd5b3f-f351-4ab5-975c-59e53f294d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:47.842939 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd5b3f-f351-4ab5-975c-59e53f294d42 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:47.843596 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd5b3f-f351-4ab5-975c-59e53f294d42 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:47.845564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd5b3f-f351-4ab5-975c-59e53f294d42 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:47.859855 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 659/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 26 01:26:47 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:26:49.990785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51abde-656d-4324-8268-8889aad81604 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:49.991356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51abde-656d-4324-8268-8889aad81604 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:49.991356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51abde-656d-4324-8268-8889aad81604 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:49.992694 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 637/1296] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:26:49.998066 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eea0ce-ada4-4646-85eb-740f945cb835 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:49.998438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eea0ce-ada4-4646-85eb-740f945cb835 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:49.998618 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eea0ce-ada4-4646-85eb-740f945cb835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:50.017219 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-e1eea0ce-ada4-4646-85eb-740f945cb835 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:26:50.018416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e1eea0ce-ada4-4646-85eb-740f945cb835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:26:50.088422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 660/1297] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:26:49 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:26:50.362769 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51abde-656d-4324-8268-8889aad81604 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:50.461478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51abde-656d-4324-8268-8889aad81604 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:50.495041 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af788107-1bef-4297-9364-69f954c31fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:50.495652 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af788107-1bef-4297-9364-69f954c31fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:50.495929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af788107-1bef-4297-9364-69f954c31fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:50.496197 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af788107-1bef-4297-9364-69f954c31fb9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:50.496762 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af788107-1bef-4297-9364-69f954c31fb9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:50.498118 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af788107-1bef-4297-9364-69f954c31fb9 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:50.506781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-af788107-1bef-4297-9364-69f954c31fb9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 01:26:50.506781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:50.506781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:26:50.506781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:26:50.506781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:26:50.506781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:26:50.506781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:26:50.506781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:26:50.506781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 01:26:50.506781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:50.506781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:26:50.506781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:50.506781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:50.506781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:50.506781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:50.506781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:50.506781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:50.511110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:50.511110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:50.511110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:50.511110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:50.511110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:50.511110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:50.511110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:26:50.511110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:26:50.511110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:26:50.511110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:26:50.511110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:50.511110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:50.511110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:50.511110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:50.511110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:50.511110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:50.512252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:50.512252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:50.512252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:50.512252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:50.512252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:50.512252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:50.512252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:50.512252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:50.512252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:50.512252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:50.512252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:26:50.512252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:26:50.512252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 01:26:50.512252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:50.512252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 638/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 26 01:26:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:50.513782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eea0ce-ada4-4646-85eb-740f945cb835 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:50.531478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:50.612487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eea0ce-ada4-4646-85eb-740f945cb835 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:50.645012 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cefd2e-03c2-4096-9b6c-3bba1e2a9560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:50.645572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cefd2e-03c2-4096-9b6c-3bba1e2a9560 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:50.645848 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cefd2e-03c2-4096-9b6c-3bba1e2a9560 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:50.646118 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cefd2e-03c2-4096-9b6c-3bba1e2a9560 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:50.646736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cefd2e-03c2-4096-9b6c-3bba1e2a9560 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:50.647067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cefd2e-03c2-4096-9b6c-3bba1e2a9560 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:50.648406 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cefd2e-03c2-4096-9b6c-3bba1e2a9560 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:50.653372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 661/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Sep 26 01:26:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:26:50.659915 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af788107-1bef-4297-9364-69f954c31fb9 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:50.690648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:50.757835 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af788107-1bef-4297-9364-69f954c31fb9 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:50.790625 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a839ce-caf0-47cc-90b8-82aa8bb409f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:50.791235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a839ce-caf0-47cc-90b8-82aa8bb409f8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:50.791513 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a839ce-caf0-47cc-90b8-82aa8bb409f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:50.791781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a839ce-caf0-47cc-90b8-82aa8bb409f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:50.792459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a839ce-caf0-47cc-90b8-82aa8bb409f8 None admin] RBAC: Adding query filter params (interface=public, service_id=3617bddab2f94217b74f73f376e5384f, region_id=RegionOne) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:50.792760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a839ce-caf0-47cc-90b8-82aa8bb409f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:50.794098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a839ce-caf0-47cc-90b8-82aa8bb409f8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:50.798954 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 639/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 26 01:26:50 2022] GET /identity/v3/endpoints?service_id=3617bddab2f94217b74f73f376e5384f&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:50.804499 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cefd2e-03c2-4096-9b6c-3bba1e2a9560 None admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:50.883207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:50.901421 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cefd2e-03c2-4096-9b6c-3bba1e2a9560 None admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:50.934697 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25e210-718e-4e95-939b-81e157cc4a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:50.935312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25e210-718e-4e95-939b-81e157cc4a27 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:50.935591 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25e210-718e-4e95-939b-81e157cc4a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:50.935862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25e210-718e-4e95-939b-81e157cc4a27 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:50.936466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25e210-718e-4e95-939b-81e157cc4a27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:50.937799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25e210-718e-4e95-939b-81e157cc4a27 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:50.944529 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 662/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 26 01:26:50 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:26:53.073140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f33eb5-3052-481d-a5ac-2b98c2f660ea None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:53.073940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f33eb5-3052-481d-a5ac-2b98c2f660ea None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:53.073940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f33eb5-3052-481d-a5ac-2b98c2f660ea None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:53.075281 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 640/1302] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:26:53.080356 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f01a6-40d7-4896-a0b9-9efe62973d9b None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:53.080793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f01a6-40d7-4896-a0b9-9efe62973d9b None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:53.080898 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f01a6-40d7-4896-a0b9-9efe62973d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:53.098577 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-699f01a6-40d7-4896-a0b9-9efe62973d9b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:26:53.099787 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-699f01a6-40d7-4896-a0b9-9efe62973d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:26:53.164103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 663/1303] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:26:53 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 01:26:53.435973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f33eb5-3052-481d-a5ac-2b98c2f660ea None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:53.529934 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:53.536930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f33eb5-3052-481d-a5ac-2b98c2f660ea None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:53.569759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89c63a-b82e-443d-a780-984373d027f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:53.570373 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89c63a-b82e-443d-a780-984373d027f6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:53.570651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89c63a-b82e-443d-a780-984373d027f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:53.570952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89c63a-b82e-443d-a780-984373d027f6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:53.571520 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89c63a-b82e-443d-a780-984373d027f6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:53.572873 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89c63a-b82e-443d-a780-984373d027f6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:53.582007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-7b89c63a-b82e-443d-a780-984373d027f6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 01:26:53.582007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:53.582007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 01:26:53.582007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 01:26:53.582007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 01:26:53.582007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 01:26:53.582007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 01:26:53.582007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:26:53.582007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 01:26:53.582007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:53.582007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 01:26:53.582007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:53.582007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 01:26:53.582007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 01:26:53.582007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 01:26:53.582007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 01:26:53.582007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 01:26:53.583076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 01:26:53.583076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 01:26:53.583076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 01:26:53.583076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 01:26:53.583076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 01:26:53.583076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 01:26:53.583076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 01:26:53.583076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 01:26:53.583076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 01:26:53.583076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 01:26:53.583076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 01:26:53.583076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 01:26:53.583076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 01:26:53.583076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 01:26:53.583076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 01:26:53.583076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 01:26:53.584040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 01:26:53.584040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 26 01:26:53.584040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 01:26:53.584040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 26 01:26:53.584040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 01:26:53.584040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 01:26:53.584040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 01:26:53.584040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 26 01:26:53.584040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 01:26:53.584040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 26 01:26:53.584040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 01:26:53.584040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 01:26:53.584040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 01:26:53.584040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 26 01:26:53.584040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 641/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 26 01:26:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 01:26:53.589069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f01a6-40d7-4896-a0b9-9efe62973d9b None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:53.663890 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:26:53.685782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f01a6-40d7-4896-a0b9-9efe62973d9b None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:53.718295 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2ba92-ca1a-4f31-ac6b-93244c46f338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:53.718906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2ba92-ca1a-4f31-ac6b-93244c46f338 None admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:53.719208 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2ba92-ca1a-4f31-ac6b-93244c46f338 None admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:53.720117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2ba92-ca1a-4f31-ac6b-93244c46f338 None admin] PATH_INFO: `/v3/services` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:53.720738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2ba92-ca1a-4f31-ac6b-93244c46f338 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:26:53.721038 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2ba92-ca1a-4f31-ac6b-93244c46f338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:53.722383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2ba92-ca1a-4f31-ac6b-93244c46f338 None admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:53.727330 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 664/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Sep 26 01:26:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:26:53.733218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89c63a-b82e-443d-a780-984373d027f6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:26:53.829130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89c63a-b82e-443d-a780-984373d027f6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:26:53.862085 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22d514-440a-4cf9-a293-51bf4d23403a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:26:53.862664 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22d514-440a-4cf9-a293-51bf4d23403a None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:26:53.862964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22d514-440a-4cf9-a293-51bf4d23403a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:26:53.863237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22d514-440a-4cf9-a293-51bf4d23403a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:26:53.863893 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22d514-440a-4cf9-a293-51bf4d23403a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:26:53.865234 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22d514-440a-4cf9-a293-51bf4d23403a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:26:53.883957 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 642/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:26:53 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:27:03.724377 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=30 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:27:03.880220 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:27:57.732767 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeddea5-1dbe-4a61-ae59-f853adbda436 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:27:57.733224 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeddea5-1dbe-4a61-ae59-f853adbda436 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:27:57.733412 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeddea5-1dbe-4a61-ae59-f853adbda436 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:27:57.735762 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 665/1307] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:27:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:27:57.741195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cffeeb-b093-488f-a7ba-7b8eb4eee333 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:27:57.741619 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cffeeb-b093-488f-a7ba-7b8eb4eee333 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:27:57.741780 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cffeeb-b093-488f-a7ba-7b8eb4eee333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:27:57.841065 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-26cffeeb-b093-488f-a7ba-7b8eb4eee333 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:27:57.843645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-26cffeeb-b093-488f-a7ba-7b8eb4eee333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:27:57.969339 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 643/1308] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:27:58.266495 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbeb8f-43e6-49ef-8a6a-5585fdec9da2 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:27:58.266776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbeb8f-43e6-49ef-8a6a-5585fdec9da2 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:27:58.267313 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbeb8f-43e6-49ef-8a6a-5585fdec9da2 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:27:58.268679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 666/1309] 10.222.0.26 () {54 vars in 964 bytes} [Mon Sep 26 01:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:27:58.275231 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5155ca5-cd1d-449d-bdcd-0898ccd81089 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:27:58.275588 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5155ca5-cd1d-449d-bdcd-0898ccd81089 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:27:58.275953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5155ca5-cd1d-449d-bdcd-0898ccd81089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:27:58.361830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-a5155ca5-cd1d-449d-bdcd-0898ccd81089 None None] MFA Rules not processed for user `80c1005979d04c55b8746c25b0994086`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:27:58.363212 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a5155ca5-cd1d-449d-bdcd-0898ccd81089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:27:58.388341 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:27:58.458740 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 644/1310] 10.222.0.26 () {58 vars in 1061 bytes} [Mon Sep 26 01:27:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:27:58.468186 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbeb8f-43e6-49ef-8a6a-5585fdec9da2 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:27:58.470919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-bacbeb8f-43e6-49ef-8a6a-5585fdec9da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:27:58.597901 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbeb8f-43e6-49ef-8a6a-5585fdec9da2 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:27:58.679136 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51397cbf-6cd7-45fb-990a-c8c934b8e959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:27:58.679906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51397cbf-6cd7-45fb-990a-c8c934b8e959 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:27:58.680286 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51397cbf-6cd7-45fb-990a-c8c934b8e959 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:27:58.680661 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51397cbf-6cd7-45fb-990a-c8c934b8e959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:27:58.682749 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-51397cbf-6cd7-45fb-990a-c8c934b8e959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:27:58.742110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:27:58.803839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51397cbf-6cd7-45fb-990a-c8c934b8e959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:27:58.805319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51397cbf-6cd7-45fb-990a-c8c934b8e959 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:27:58.824630 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 667/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:27:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:28:01.292967 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7477bd0-364d-46ca-9c9a-116d85d9f6f2 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:01.293492 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7477bd0-364d-46ca-9c9a-116d85d9f6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:01.293492 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7477bd0-364d-46ca-9c9a-116d85d9f6f2 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:01.294849 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 645/1312] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:28:01.300779 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6882b3-75ee-49bc-a8e7-27802ead8d5a None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:01.301202 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6882b3-75ee-49bc-a8e7-27802ead8d5a None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:01.301331 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6882b3-75ee-49bc-a8e7-27802ead8d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:01.383740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-df6882b3-75ee-49bc-a8e7-27802ead8d5a None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:28:01.384944 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-df6882b3-75ee-49bc-a8e7-27802ead8d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:01.485955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 668/1313] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:28:01.786149 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7477bd0-364d-46ca-9c9a-116d85d9f6f2 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:28:01.787739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c7477bd0-364d-46ca-9c9a-116d85d9f6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:01.892403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7477bd0-364d-46ca-9c9a-116d85d9f6f2 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:28:01.965227 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:01.967676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb71327-792a-4e1c-b998-ca62a78bd4e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:28:01.968390 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb71327-792a-4e1c-b998-ca62a78bd4e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:01.969516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb71327-792a-4e1c-b998-ca62a78bd4e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:01.969956 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb71327-792a-4e1c-b998-ca62a78bd4e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:01.971764 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2fb71327-792a-4e1c-b998-ca62a78bd4e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:02.088979 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb71327-792a-4e1c-b998-ca62a78bd4e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:28:02.090338 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb71327-792a-4e1c-b998-ca62a78bd4e3 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:28:02.108511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 646/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:28:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:28:04.645227 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c9a0b-a422-4064-8a16-4f75d8ccee48 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:04.645758 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c9a0b-a422-4064-8a16-4f75d8ccee48 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:04.645848 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c9a0b-a422-4064-8a16-4f75d8ccee48 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:04.647194 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 669/1315] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:28:04.652232 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334b24-194d-4e8c-b630-5bc59596855b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:04.652677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334b24-194d-4e8c-b630-5bc59596855b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:04.652856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334b24-194d-4e8c-b630-5bc59596855b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:04.718456 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-f6334b24-194d-4e8c-b630-5bc59596855b None None] MFA Rules not processed for user `b2f67764a6de42e7a7e7f61340796c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:28:04.720884 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f6334b24-194d-4e8c-b630-5bc59596855b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:04.772343 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:04.817793 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 647/1316] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:28:04 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:28:05.118931 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565677b-1c18-410c-8d1a-7209f48d292d None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:05.119218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565677b-1c18-410c-8d1a-7209f48d292d None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:05.119495 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565677b-1c18-410c-8d1a-7209f48d292d None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:05.120843 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 670/1317] 10.222.0.26 () {54 vars in 964 bytes} [Mon Sep 26 01:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:28:05.127407 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720f588-5464-4d17-a053-f124a7b1ead7 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:05.127697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720f588-5464-4d17-a053-f124a7b1ead7 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:05.127974 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720f588-5464-4d17-a053-f124a7b1ead7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:05.204596 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-5720f588-5464-4d17-a053-f124a7b1ead7 None None] MFA Rules not processed for user `80c1005979d04c55b8746c25b0994086`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:28:05.205795 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5720f588-5464-4d17-a053-f124a7b1ead7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:05.281592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 648/1318] 10.222.0.26 () {58 vars in 1061 bytes} [Mon Sep 26 01:28:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:28:05.290875 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565677b-1c18-410c-8d1a-7209f48d292d None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:28:05.292437 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f565677b-1c18-410c-8d1a-7209f48d292d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:05.302616 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:05.395153 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565677b-1c18-410c-8d1a-7209f48d292d None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:28:05.467773 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb55b6-4cd1-4683-8a65-0684ca78b0db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:28:05.468372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb55b6-4cd1-4683-8a65-0684ca78b0db service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:05.469219 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb55b6-4cd1-4683-8a65-0684ca78b0db service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:05.469620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb55b6-4cd1-4683-8a65-0684ca78b0db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:05.471381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-7beb55b6-4cd1-4683-8a65-0684ca78b0db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:05.534601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:05.582767 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb55b6-4cd1-4683-8a65-0684ca78b0db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:28:05.584229 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb55b6-4cd1-4683-8a65-0684ca78b0db service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:28:05.602408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 671/1319] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:28:05 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:28:08.640082 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e4a84-ab39-41c3-9315-fa87184af140 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:08.640677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e4a84-ab39-41c3-9315-fa87184af140 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:08.640677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e4a84-ab39-41c3-9315-fa87184af140 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:08.641971 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 649/1320] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:28:08.647534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655863b-5fb5-4d44-9e98-c649f14ccea0 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:08.647961 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655863b-5fb5-4d44-9e98-c649f14ccea0 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:08.648077 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655863b-5fb5-4d44-9e98-c649f14ccea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:08.712639 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-4655863b-5fb5-4d44-9e98-c649f14ccea0 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:28:08.713749 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4655863b-5fb5-4d44-9e98-c649f14ccea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:08.807905 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 672/1321] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:28:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:28:09.095821 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e4a84-ab39-41c3-9315-fa87184af140 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:28:09.097398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-469e4a84-ab39-41c3-9315-fa87184af140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:09.149610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:09.203029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e4a84-ab39-41c3-9315-fa87184af140 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:28:09.273152 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84addd41-a2b0-456d-b406-444e08036f88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:28:09.273745 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84addd41-a2b0-456d-b406-444e08036f88 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:09.274021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84addd41-a2b0-456d-b406-444e08036f88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:09.274291 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84addd41-a2b0-456d-b406-444e08036f88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:09.275902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-84addd41-a2b0-456d-b406-444e08036f88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:09.370118 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:09.383227 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84addd41-a2b0-456d-b406-444e08036f88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:28:09.384642 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84addd41-a2b0-456d-b406-444e08036f88 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:28:09.403002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 650/1322] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:28:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:28:12.224662 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da1793-89c5-473b-858a-861917696d58 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:12.225197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da1793-89c5-473b-858a-861917696d58 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:12.225197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da1793-89c5-473b-858a-861917696d58 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:12.226604 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 673/1323] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:28:12.232453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644db32-03f1-40a0-b2ed-20364ab4fc36 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:12.232915 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644db32-03f1-40a0-b2ed-20364ab4fc36 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:12.233012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644db32-03f1-40a0-b2ed-20364ab4fc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:12.302344 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-0644db32-03f1-40a0-b2ed-20364ab4fc36 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:28:12.303624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0644db32-03f1-40a0-b2ed-20364ab4fc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:12.414878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 651/1324] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:28:12.695889 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da1793-89c5-473b-858a-861917696d58 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:28:12.697420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-33da1793-89c5-473b-858a-861917696d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:12.717778 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:12.801521 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da1793-89c5-473b-858a-861917696d58 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:28:12.876465 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e85577-f031-443e-b0fb-6b49ab32a7a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:28:12.877069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e85577-f031-443e-b0fb-6b49ab32a7a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:12.877345 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e85577-f031-443e-b0fb-6b49ab32a7a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:12.877621 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e85577-f031-443e-b0fb-6b49ab32a7a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:12.879228 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-90e85577-f031-443e-b0fb-6b49ab32a7a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:12.952316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:12.990562 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e85577-f031-443e-b0fb-6b49ab32a7a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:28:12.992026 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e85577-f031-443e-b0fb-6b49ab32a7a4 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:28:13.010639 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 674/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:28:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:28:15.217923 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2392db-f89a-4db6-8624-72aa296ca961 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:15.218499 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2392db-f89a-4db6-8624-72aa296ca961 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:15.218499 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2392db-f89a-4db6-8624-72aa296ca961 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:15.220310 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 652/1326] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:28:15.225847 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26322f-3e60-427c-b74a-fa5a64fbc993 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:15.226264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26322f-3e60-427c-b74a-fa5a64fbc993 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:15.226521 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26322f-3e60-427c-b74a-fa5a64fbc993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:15.294807 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-fb26322f-3e60-427c-b74a-fa5a64fbc993 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:28:15.296038 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-fb26322f-3e60-427c-b74a-fa5a64fbc993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:15.400330 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 675/1327] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:28:15.693460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2392db-f89a-4db6-8624-72aa296ca961 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:28:15.695022 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1d2392db-f89a-4db6-8624-72aa296ca961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:15.755989 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:15.799450 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2392db-f89a-4db6-8624-72aa296ca961 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:28:15.875758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d97d0-1bb9-4737-8194-0985f3159235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:28:15.876389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d97d0-1bb9-4737-8194-0985f3159235 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:15.876674 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d97d0-1bb9-4737-8194-0985f3159235 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:15.876950 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d97d0-1bb9-4737-8194-0985f3159235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:15.878571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a49d97d0-1bb9-4737-8194-0985f3159235 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:15.991554 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:15.994008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d97d0-1bb9-4737-8194-0985f3159235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:28:15.995883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d97d0-1bb9-4737-8194-0985f3159235 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:28:16.014481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 653/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:28:18.224663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bc441-36af-4f37-84a5-9b0dc9ffeb47 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:18.225162 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bc441-36af-4f37-84a5-9b0dc9ffeb47 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:18.225255 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bc441-36af-4f37-84a5-9b0dc9ffeb47 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:18.226548 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 676/1329] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:28:18.231988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a483ad-21e9-4725-8771-5c2808b8fc07 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:18.232416 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a483ad-21e9-4725-8771-5c2808b8fc07 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:18.232603 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a483ad-21e9-4725-8771-5c2808b8fc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:18.299581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-77a483ad-21e9-4725-8771-5c2808b8fc07 None None] MFA Rules not processed for user `b2f67764a6de42e7a7e7f61340796c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:28:18.300778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-77a483ad-21e9-4725-8771-5c2808b8fc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:18.397880 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 654/1330] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:28:18 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:28:18.677589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bc441-36af-4f37-84a5-9b0dc9ffeb47 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:28:18.679541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-967bc441-36af-4f37-84a5-9b0dc9ffeb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:18.712240 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:18.789347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bc441-36af-4f37-84a5-9b0dc9ffeb47 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:28:18.865800 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6547c6-9a0a-49ad-9484-a860999be8e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:28:18.866327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6547c6-9a0a-49ad-9484-a860999be8e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:18.866604 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6547c6-9a0a-49ad-9484-a860999be8e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:18.866901 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6547c6-9a0a-49ad-9484-a860999be8e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:18.868495 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-1d6547c6-9a0a-49ad-9484-a860999be8e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:18.946402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:18.979277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6547c6-9a0a-49ad-9484-a860999be8e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:28:18.980703 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6547c6-9a0a-49ad-9484-a860999be8e5 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:28:18.999623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 677/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:28:18 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:28:21.373117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e4a7e-202e-4296-925d-835bc10dcefb None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:21.373639 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e4a7e-202e-4296-925d-835bc10dcefb None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:21.373738 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e4a7e-202e-4296-925d-835bc10dcefb None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:21.375607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 655/1332] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:28:21.380667 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd9cfd-f76d-4782-a945-6a6ec4e1d73f None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:21.381047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd9cfd-f76d-4782-a945-6a6ec4e1d73f None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:21.381211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd9cfd-f76d-4782-a945-6a6ec4e1d73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:21.447438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-46dd9cfd-f76d-4782-a945-6a6ec4e1d73f None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:28:21.448643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-46dd9cfd-f76d-4782-a945-6a6ec4e1d73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:21.546225 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 678/1333] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:28:21.830062 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e4a7e-202e-4296-925d-835bc10dcefb None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:28:21.831654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4b8e4a7e-202e-4296-925d-835bc10dcefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:21.900650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:21.934196 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e4a7e-202e-4296-925d-835bc10dcefb None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:28:22.015116 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a733781-2264-4b32-907b-7324737fbef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:28:22.016482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a733781-2264-4b32-907b-7324737fbef7 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:22.016762 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a733781-2264-4b32-907b-7324737fbef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:22.017034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a733781-2264-4b32-907b-7324737fbef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:22.018623 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2a733781-2264-4b32-907b-7324737fbef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:22.126221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a733781-2264-4b32-907b-7324737fbef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:28:22.127606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a733781-2264-4b32-907b-7324737fbef7 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:28:22.137299 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:22.146265 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 656/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:28:24.329632 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285e154-9af4-4bc3-813c-3e0df1ba19b4 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:24.330236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285e154-9af4-4bc3-813c-3e0df1ba19b4 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:24.330236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285e154-9af4-4bc3-813c-3e0df1ba19b4 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:24.331536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 679/1335] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:28:24.336791 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc49bc2-b345-4336-92ca-6b4484e24bfd None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:24.337286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc49bc2-b345-4336-92ca-6b4484e24bfd None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:24.337390 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc49bc2-b345-4336-92ca-6b4484e24bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:24.402679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-dfc49bc2-b345-4336-92ca-6b4484e24bfd None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:28:24.403909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-dfc49bc2-b345-4336-92ca-6b4484e24bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:24.503857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 657/1336] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:28:24.786089 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285e154-9af4-4bc3-813c-3e0df1ba19b4 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:28:24.787656 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c285e154-9af4-4bc3-813c-3e0df1ba19b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:24.827698 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:24.890222 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285e154-9af4-4bc3-813c-3e0df1ba19b4 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:28:24.962363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023d92e-2fed-4edc-b6e8-29f4a1ef83be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:28:24.963042 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023d92e-2fed-4edc-b6e8-29f4a1ef83be service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:24.963320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023d92e-2fed-4edc-b6e8-29f4a1ef83be service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:24.963592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023d92e-2fed-4edc-b6e8-29f4a1ef83be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:24.965168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-5023d92e-2fed-4edc-b6e8-29f4a1ef83be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:25.048982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:25.073761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023d92e-2fed-4edc-b6e8-29f4a1ef83be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:28:25.075195 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023d92e-2fed-4edc-b6e8-29f4a1ef83be service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:28:25.093293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 680/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:28:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:28:27.551808 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb357f2-06eb-4f8a-a1e8-dd707528c469 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:27.552363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb357f2-06eb-4f8a-a1e8-dd707528c469 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:27.552363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb357f2-06eb-4f8a-a1e8-dd707528c469 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:27.553651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 658/1338] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:28:27.558728 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea1f5c-02ac-4bee-8cb1-0e56f2ffeb27 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:27.559181 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea1f5c-02ac-4bee-8cb1-0e56f2ffeb27 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:27.559283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea1f5c-02ac-4bee-8cb1-0e56f2ffeb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:27.626414 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-b1ea1f5c-02ac-4bee-8cb1-0e56f2ffeb27 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:28:27.628363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b1ea1f5c-02ac-4bee-8cb1-0e56f2ffeb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:27.728903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 681/1339] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:28:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:28:28.010126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb357f2-06eb-4f8a-a1e8-dd707528c469 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:28:28.011702 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0eb357f2-06eb-4f8a-a1e8-dd707528c469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:28.087750 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:28.116181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb357f2-06eb-4f8a-a1e8-dd707528c469 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:28:28.188269 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1a889-43cc-43a6-9527-c3d5b91cdac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:28:28.188871 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1a889-43cc-43a6-9527-c3d5b91cdac8 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:28.189153 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1a889-43cc-43a6-9527-c3d5b91cdac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:28.189426 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1a889-43cc-43a6-9527-c3d5b91cdac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:28.191057 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5bf1a889-43cc-43a6-9527-c3d5b91cdac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:28.301795 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1a889-43cc-43a6-9527-c3d5b91cdac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:28:28.303192 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1a889-43cc-43a6-9527-c3d5b91cdac8 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:28:28.320893 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 659/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:28:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:28:32.377782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad837eea-1ef7-4494-99d6-89509d12730f None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:32.378317 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad837eea-1ef7-4494-99d6-89509d12730f None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:32.378317 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad837eea-1ef7-4494-99d6-89509d12730f None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:32.379860 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 682/1341] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:28:32.385016 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ee2de-c84a-4ce6-8314-e231ae999099 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:32.385428 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ee2de-c84a-4ce6-8314-e231ae999099 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:32.385555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ee2de-c84a-4ce6-8314-e231ae999099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:32.391902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:32.462342 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-ee6ee2de-c84a-4ce6-8314-e231ae999099 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:28:32.463607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ee6ee2de-c84a-4ce6-8314-e231ae999099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:32.564354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 660/1342] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:28:32.851981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad837eea-1ef7-4494-99d6-89509d12730f None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:28:32.853522 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-ad837eea-1ef7-4494-99d6-89509d12730f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:32.904809 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:32.975728 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad837eea-1ef7-4494-99d6-89509d12730f None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:28:33.050106 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fdc1c-2e12-4628-bfd2-fbafa9c8d726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:28:33.050915 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fdc1c-2e12-4628-bfd2-fbafa9c8d726 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:33.051195 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fdc1c-2e12-4628-bfd2-fbafa9c8d726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:33.051467 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fdc1c-2e12-4628-bfd2-fbafa9c8d726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:33.053124 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d07fdc1c-2e12-4628-bfd2-fbafa9c8d726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:33.148064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:33.165349 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fdc1c-2e12-4628-bfd2-fbafa9c8d726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:28:33.166809 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fdc1c-2e12-4628-bfd2-fbafa9c8d726 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:28:33.185728 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 683/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:28:36.011823 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed99237-8d3f-40ea-a0f9-64723467f861 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:36.012362 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed99237-8d3f-40ea-a0f9-64723467f861 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:36.012362 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed99237-8d3f-40ea-a0f9-64723467f861 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:36.013696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 661/1344] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:28:36.019237 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ee594-af9a-4d7f-af5c-a3a064b7cd03 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:36.019677 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ee594-af9a-4d7f-af5c-a3a064b7cd03 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:36.019765 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ee594-af9a-4d7f-af5c-a3a064b7cd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:36.085474 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-116ee594-af9a-4d7f-af5c-a3a064b7cd03 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:28:36.086677 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-116ee594-af9a-4d7f-af5c-a3a064b7cd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:36.198849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 684/1345] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:28:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:28:36.490545 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed99237-8d3f-40ea-a0f9-64723467f861 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:28:36.492200 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7ed99237-8d3f-40ea-a0f9-64723467f861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:36.581193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:36.598500 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed99237-8d3f-40ea-a0f9-64723467f861 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:28:36.673130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad286f9-a64f-4348-b5ba-e850e3e3e96f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:28:36.673658 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad286f9-a64f-4348-b5ba-e850e3e3e96f service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:36.673935 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad286f9-a64f-4348-b5ba-e850e3e3e96f service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:36.674202 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad286f9-a64f-4348-b5ba-e850e3e3e96f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:36.675830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-aad286f9-a64f-4348-b5ba-e850e3e3e96f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:36.789097 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad286f9-a64f-4348-b5ba-e850e3e3e96f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:28:36.790536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad286f9-a64f-4348-b5ba-e850e3e3e96f service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:28:36.808445 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 662/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:28:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:28:40.953179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f6b05-d989-41a3-b419-b1d1c3967c51 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:40.953702 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f6b05-d989-41a3-b419-b1d1c3967c51 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:40.953891 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f6b05-d989-41a3-b419-b1d1c3967c51 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:40.955283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 685/1347] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:28:40.960591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a07e4-c45d-4347-854d-8e38821aa58b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:40.960993 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a07e4-c45d-4347-854d-8e38821aa58b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:40.961148 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a07e4-c45d-4347-854d-8e38821aa58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:40.977045 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:41.029897 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-549a07e4-c45d-4347-854d-8e38821aa58b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:28:41.031313 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-549a07e4-c45d-4347-854d-8e38821aa58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:41.128446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 663/1348] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:28:41.425170 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f6b05-d989-41a3-b419-b1d1c3967c51 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:28:41.426888 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-994f6b05-d989-41a3-b419-b1d1c3967c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:41.486218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:41.532362 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f6b05-d989-41a3-b419-b1d1c3967c51 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:28:41.605511 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01ae4d-a525-4ef2-b9a9-09cc700f99cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:28:41.606109 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01ae4d-a525-4ef2-b9a9-09cc700f99cf service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:41.606398 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01ae4d-a525-4ef2-b9a9-09cc700f99cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:41.606668 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01ae4d-a525-4ef2-b9a9-09cc700f99cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:41.608293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-1a01ae4d-a525-4ef2-b9a9-09cc700f99cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:41.713718 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:41.718020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01ae4d-a525-4ef2-b9a9-09cc700f99cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:28:41.720029 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01ae4d-a525-4ef2-b9a9-09cc700f99cf service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:28:41.741225 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 686/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:28:46.627490 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b545c52-d3f9-46b6-85eb-789626554cc7 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:46.627961 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b545c52-d3f9-46b6-85eb-789626554cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:46.628187 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b545c52-d3f9-46b6-85eb-789626554cc7 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:46.629734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 664/1350] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 26 01:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:28:46.634938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436b0e6-671c-4e3f-afd3-ee275b245c09 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:46.635692 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436b0e6-671c-4e3f-afd3-ee275b245c09 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:46.637266 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436b0e6-671c-4e3f-afd3-ee275b245c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:46.790558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-5436b0e6-671c-4e3f-afd3-ee275b245c09 None None] MFA Rules not processed for user `df7a1b839a6f4bdb9870217fa4d2527c`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:28:46.791813 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-5436b0e6-671c-4e3f-afd3-ee275b245c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:46.910690 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 687/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 26 01:28:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:28:50.996826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89be4-41e6-4398-a8b4-7f0d47a36b2a None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:50.998018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89be4-41e6-4398-a8b4-7f0d47a36b2a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:50.998324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89be4-41e6-4398-a8b4-7f0d47a36b2a None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:51.001274 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 665/1352] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 26 01:28:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:28:51.006114 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50f04b-2079-4f9f-851f-3cc409f3391f None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:51.006530 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50f04b-2079-4f9f-851f-3cc409f3391f None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:51.006867 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50f04b-2079-4f9f-851f-3cc409f3391f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:51.064852 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:51.090352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-2c50f04b-2079-4f9f-851f-3cc409f3391f None None] MFA Rules not processed for user `df7a1b839a6f4bdb9870217fa4d2527c`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:28:51.091602 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-2c50f04b-2079-4f9f-851f-3cc409f3391f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:51.126880 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=59 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:51.207505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 688/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 26 01:28:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:28:52.707706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcd0c5-9630-494f-86e0-15aefd4a97f2 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:52.708199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcd0c5-9630-494f-86e0-15aefd4a97f2 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:52.708199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcd0c5-9630-494f-86e0-15aefd4a97f2 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:52.709526 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 666/1354] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 26 01:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:28:52.714511 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490f1ab-cd52-42f6-bb4e-93287accdc43 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:52.714946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490f1ab-cd52-42f6-bb4e-93287accdc43 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:52.715261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490f1ab-cd52-42f6-bb4e-93287accdc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:52.794093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-d490f1ab-cd52-42f6-bb4e-93287accdc43 None None] MFA Rules not processed for user `df7a1b839a6f4bdb9870217fa4d2527c`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:28:52.795336 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d490f1ab-cd52-42f6-bb4e-93287accdc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:52.836901 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:52.901792 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 689/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 26 01:28:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:28:56.477846 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca4fff-9dfc-451c-a7a8-4b1f93d717bf None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:56.478436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca4fff-9dfc-451c-a7a8-4b1f93d717bf None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:56.478436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca4fff-9dfc-451c-a7a8-4b1f93d717bf None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:56.479836 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 667/1356] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:28:56.485705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa73b19-4bb1-42a3-bc6f-b9deba8e3b6e None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:56.486145 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa73b19-4bb1-42a3-bc6f-b9deba8e3b6e None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:56.486248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa73b19-4bb1-42a3-bc6f-b9deba8e3b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:56.562564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-afa73b19-4bb1-42a3-bc6f-b9deba8e3b6e None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:28:56.563794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-afa73b19-4bb1-42a3-bc6f-b9deba8e3b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:56.668230 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 690/1357] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:28:56.972032 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53752e40-f40b-4cdc-a99d-6139ecbfe9f6 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:56.972805 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53752e40-f40b-4cdc-a99d-6139ecbfe9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:56.974294 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53752e40-f40b-4cdc-a99d-6139ecbfe9f6 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:56.976403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 668/1358] 10.222.0.26 () {54 vars in 961 bytes} [Mon Sep 26 01:28:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:28:56.984848 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70c207-f41f-40eb-b979-868020a2d1f1 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:56.985137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70c207-f41f-40eb-b979-868020a2d1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:56.985415 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70c207-f41f-40eb-b979-868020a2d1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:57.006115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:57.074117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-ae70c207-f41f-40eb-b979-868020a2d1f1 None None] MFA Rules not processed for user `3d6eaeb6bced49afabc7bdaa5e7cecfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:28:57.075468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-ae70c207-f41f-40eb-b979-868020a2d1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:57.203759 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 691/1359] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Sep 26 01:28:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:28:57.211458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53752e40-f40b-4cdc-a99d-6139ecbfe9f6 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:28:57.213056 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-53752e40-f40b-4cdc-a99d-6139ecbfe9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:57.367927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53752e40-f40b-4cdc-a99d-6139ecbfe9f6 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:28:57.460323 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:28:57.502987 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb9763-90b1-4231-b082-409930e666cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:28:57.503604 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb9763-90b1-4231-b082-409930e666cf service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:28:57.503838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb9763-90b1-4231-b082-409930e666cf service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:28:57.504106 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb9763-90b1-4231-b082-409930e666cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:28:57.505696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-90fb9763-90b1-4231-b082-409930e666cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:28:57.611330 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb9763-90b1-4231-b082-409930e666cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:28:57.613248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb9763-90b1-4231-b082-409930e666cf service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:28:57.637169 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 669/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:28:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:29:00.056745 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad3822-023e-4ba2-8816-62367563a141 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:00.057248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad3822-023e-4ba2-8816-62367563a141 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:00.057248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad3822-023e-4ba2-8816-62367563a141 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:00.059275 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 692/1361] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:00.064379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23bb4b-8a84-4fa2-b2e5-33731bd49b65 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:00.066342 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23bb4b-8a84-4fa2-b2e5-33731bd49b65 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:00.066342 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23bb4b-8a84-4fa2-b2e5-33731bd49b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:00.133553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-3f23bb4b-8a84-4fa2-b2e5-33731bd49b65 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:00.134749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3f23bb4b-8a84-4fa2-b2e5-33731bd49b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:00.173035 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:00.240444 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 670/1362] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:00.537782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad3822-023e-4ba2-8816-62367563a141 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:29:00.539337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-04ad3822-023e-4ba2-8816-62367563a141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:00.610271 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:00.708319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad3822-023e-4ba2-8816-62367563a141 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:29:00.847383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8422f3a-d912-4791-9efe-a7e442a2fae3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:29:00.848484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8422f3a-d912-4791-9efe-a7e442a2fae3 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:00.848484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8422f3a-d912-4791-9efe-a7e442a2fae3 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:00.849045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8422f3a-d912-4791-9efe-a7e442a2fae3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:00.851921 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f8422f3a-d912-4791-9efe-a7e442a2fae3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:00.876455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:00.948390 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8422f3a-d912-4791-9efe-a7e442a2fae3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:29:00.949906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8422f3a-d912-4791-9efe-a7e442a2fae3 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:29:00.969105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 693/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:29:03.461403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15d26d-5c1f-4688-a34f-4d0297812c29 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:03.461924 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15d26d-5c1f-4688-a34f-4d0297812c29 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:03.461924 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15d26d-5c1f-4688-a34f-4d0297812c29 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:03.463308 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 671/1364] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:03.469205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4572ec-d082-4119-9ac5-461ffb43ba21 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:03.469628 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4572ec-d082-4119-9ac5-461ffb43ba21 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:03.469798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4572ec-d082-4119-9ac5-461ffb43ba21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:03.539150 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-2b4572ec-d082-4119-9ac5-461ffb43ba21 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:03.540369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-2b4572ec-d082-4119-9ac5-461ffb43ba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:03.645975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:03.656948 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 694/1365] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:03.953139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4656ec4-4e0b-42de-bd02-c6eeeea5559c None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:03.953497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4656ec4-4e0b-42de-bd02-c6eeeea5559c None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:03.953775 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4656ec4-4e0b-42de-bd02-c6eeeea5559c None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:03.955183 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 672/1366] 10.222.0.26 () {54 vars in 961 bytes} [Mon Sep 26 01:29:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:03.961106 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c9f85-1ddf-45b3-9aad-002cd1b8fceb None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:03.961489 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c9f85-1ddf-45b3-9aad-002cd1b8fceb None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:03.961998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c9f85-1ddf-45b3-9aad-002cd1b8fceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:04.059952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-910c9f85-1ddf-45b3-9aad-002cd1b8fceb None None] MFA Rules not processed for user `3d6eaeb6bced49afabc7bdaa5e7cecfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:04.061174 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-910c9f85-1ddf-45b3-9aad-002cd1b8fceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:04.220978 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 695/1367] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Sep 26 01:29:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:04.228911 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4656ec4-4e0b-42de-bd02-c6eeeea5559c None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:29:04.232116 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a4656ec4-4e0b-42de-bd02-c6eeeea5559c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:04.438383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4656ec4-4e0b-42de-bd02-c6eeeea5559c None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:29:04.463194 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:04.588129 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48fcdf-60ec-44b2-9cb7-e2d45dc136bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:29:04.588664 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48fcdf-60ec-44b2-9cb7-e2d45dc136bc service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:04.589000 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48fcdf-60ec-44b2-9cb7-e2d45dc136bc service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:04.589289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48fcdf-60ec-44b2-9cb7-e2d45dc136bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:04.590910 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-cc48fcdf-60ec-44b2-9cb7-e2d45dc136bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:04.711927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48fcdf-60ec-44b2-9cb7-e2d45dc136bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:29:04.713533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48fcdf-60ec-44b2-9cb7-e2d45dc136bc service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:29:04.733610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 673/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:29:04.755875 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432be189-e1ff-40f1-b102-a34869013e4c None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:04.756374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432be189-e1ff-40f1-b102-a34869013e4c None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:04.756455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432be189-e1ff-40f1-b102-a34869013e4c None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:04.757926 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 696/1369] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:04.763758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b75614-8312-4a99-890a-dc0d76494615 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:04.763758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b75614-8312-4a99-890a-dc0d76494615 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:04.763992 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b75614-8312-4a99-890a-dc0d76494615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:04.801814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:04.842581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-e6b75614-8312-4a99-890a-dc0d76494615 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:04.844472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e6b75614-8312-4a99-890a-dc0d76494615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:04.967715 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 674/1370] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:05.304678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbe9bc-ea97-4d85-92c1-31208b857c52 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:05.304678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbe9bc-ea97-4d85-92c1-31208b857c52 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:05.304678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbe9bc-ea97-4d85-92c1-31208b857c52 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:05.307227 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 697/1371] 10.222.0.26 () {54 vars in 963 bytes} [Mon Sep 26 01:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:05.310811 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439fe6f-a04a-44eb-aaf1-31b3d8240a0b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:05.311135 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439fe6f-a04a-44eb-aaf1-31b3d8240a0b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:05.311410 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439fe6f-a04a-44eb-aaf1-31b3d8240a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:05.391180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-7439fe6f-a04a-44eb-aaf1-31b3d8240a0b None None] MFA Rules not processed for user `eab8abb1394d41e3a30439699086da28`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:05.395126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7439fe6f-a04a-44eb-aaf1-31b3d8240a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:05.447544 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:05.480441 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 675/1372] 10.222.0.26 () {58 vars in 1060 bytes} [Mon Sep 26 01:29:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:05.488815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbe9bc-ea97-4d85-92c1-31208b857c52 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:29:05.490413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-50fbe9bc-ea97-4d85-92c1-31208b857c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:05.546118 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:05.616349 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbe9bc-ea97-4d85-92c1-31208b857c52 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:29:05.709249 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c520fa-c5c2-4cc4-bb6b-5efc633d6e4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:29:05.710150 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c520fa-c5c2-4cc4-bb6b-5efc633d6e4c service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:05.710550 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c520fa-c5c2-4cc4-bb6b-5efc633d6e4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:05.710893 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c520fa-c5c2-4cc4-bb6b-5efc633d6e4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:05.712827 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a3c520fa-c5c2-4cc4-bb6b-5efc633d6e4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:05.899477 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:05.926939 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c520fa-c5c2-4cc4-bb6b-5efc633d6e4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:29:05.928826 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c520fa-c5c2-4cc4-bb6b-5efc633d6e4c service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:29:05.973990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 698/1373] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:29:06.975963 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49636b31-502b-4f0d-b038-1e17c6aed5ea None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:06.976479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49636b31-502b-4f0d-b038-1e17c6aed5ea None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:06.976571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49636b31-502b-4f0d-b038-1e17c6aed5ea None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:06.977821 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 676/1374] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:06.983336 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424ba40-828d-4c8d-8817-cba6ac529cb8 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:06.983812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424ba40-828d-4c8d-8817-cba6ac529cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:06.984447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424ba40-828d-4c8d-8817-cba6ac529cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:07.049886 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-f424ba40-828d-4c8d-8817-cba6ac529cb8 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:07.051119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f424ba40-828d-4c8d-8817-cba6ac529cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:07.149748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 699/1375] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:07.453886 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49636b31-502b-4f0d-b038-1e17c6aed5ea None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:29:07.455453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-49636b31-502b-4f0d-b038-1e17c6aed5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:07.621296 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49636b31-502b-4f0d-b038-1e17c6aed5ea None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:29:07.677091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:07.741256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80577b-203a-4ecf-9407-6a85a47c9221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:29:07.741857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80577b-203a-4ecf-9407-6a85a47c9221 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:07.742136 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80577b-203a-4ecf-9407-6a85a47c9221 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:07.742403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80577b-203a-4ecf-9407-6a85a47c9221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:07.744025 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6a80577b-203a-4ecf-9407-6a85a47c9221 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:07.839663 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80577b-203a-4ecf-9407-6a85a47c9221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:29:07.841301 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80577b-203a-4ecf-9407-6a85a47c9221 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:29:07.860665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 677/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:29:10.090394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a408ccc-3f29-43d8-968d-d004e0ed45ac None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:10.090953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a408ccc-3f29-43d8-968d-d004e0ed45ac None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:10.090953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a408ccc-3f29-43d8-968d-d004e0ed45ac None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:10.092624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 700/1377] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:10.097822 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ff2cc-75d6-43aa-a101-595c31edb52a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:10.098224 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ff2cc-75d6-43aa-a101-595c31edb52a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:10.098395 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ff2cc-75d6-43aa-a101-595c31edb52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:10.169602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-760ff2cc-75d6-43aa-a101-595c31edb52a None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:10.170790 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-760ff2cc-75d6-43aa-a101-595c31edb52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:10.178509 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:10.277877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 678/1378] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:10.567284 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a408ccc-3f29-43d8-968d-d004e0ed45ac None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:29:10.568893 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0a408ccc-3f29-43d8-968d-d004e0ed45ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:10.635893 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:10.746161 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a408ccc-3f29-43d8-968d-d004e0ed45ac None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:29:10.874430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4d50d-2ceb-41dd-9550-235873cd94bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:29:10.875373 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4d50d-2ceb-41dd-9550-235873cd94bf service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:10.875841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4d50d-2ceb-41dd-9550-235873cd94bf service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:10.876481 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4d50d-2ceb-41dd-9550-235873cd94bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:10.878371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-11a4d50d-2ceb-41dd-9550-235873cd94bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:10.900703 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:10.981960 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4d50d-2ceb-41dd-9550-235873cd94bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:29:10.983640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4d50d-2ceb-41dd-9550-235873cd94bf service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:29:11.004733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 701/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:29:13.252730 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17159736-c7c0-4e0a-85aa-c62166f79992 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:13.253214 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17159736-c7c0-4e0a-85aa-c62166f79992 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:13.253525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17159736-c7c0-4e0a-85aa-c62166f79992 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:13.255107 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 679/1380] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:13.260487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1d81a-2a7b-40ac-b399-2a8f1bd38f65 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:13.260924 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1d81a-2a7b-40ac-b399-2a8f1bd38f65 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:13.261162 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1d81a-2a7b-40ac-b399-2a8f1bd38f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:13.332989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-08d1d81a-2a7b-40ac-b399-2a8f1bd38f65 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:13.334262 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-08d1d81a-2a7b-40ac-b399-2a8f1bd38f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:13.455658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:13.464740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 702/1381] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:29:13.765894 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17159736-c7c0-4e0a-85aa-c62166f79992 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:29:13.767514 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-17159736-c7c0-4e0a-85aa-c62166f79992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:13.912608 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:13.925061 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17159736-c7c0-4e0a-85aa-c62166f79992 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:29:14.041558 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586b98e-9a09-4117-8421-0fcc4666467c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:29:14.042106 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586b98e-9a09-4117-8421-0fcc4666467c service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:14.042396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586b98e-9a09-4117-8421-0fcc4666467c service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:14.042678 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586b98e-9a09-4117-8421-0fcc4666467c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:14.044372 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0586b98e-9a09-4117-8421-0fcc4666467c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:14.143505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586b98e-9a09-4117-8421-0fcc4666467c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:29:14.145209 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586b98e-9a09-4117-8421-0fcc4666467c service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:29:14.155708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:14.164823 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 680/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:29:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:29:16.365739 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c6490-d311-4146-80a9-7d7526eb4b8c None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:16.366412 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c6490-d311-4146-80a9-7d7526eb4b8c None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:16.366412 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c6490-d311-4146-80a9-7d7526eb4b8c None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:16.367588 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 703/1383] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:16.372868 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06d909-0819-4deb-aa96-578dc3b1c419 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:16.373297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06d909-0819-4deb-aa96-578dc3b1c419 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:16.373420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06d909-0819-4deb-aa96-578dc3b1c419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:16.447348 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-fa06d909-0819-4deb-aa96-578dc3b1c419 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:16.448599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-fa06d909-0819-4deb-aa96-578dc3b1c419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:16.559624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 681/1384] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:16.846898 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c6490-d311-4146-80a9-7d7526eb4b8c None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:29:16.848472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a00c6490-d311-4146-80a9-7d7526eb4b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:17.003637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c6490-d311-4146-80a9-7d7526eb4b8c None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:29:17.071479 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:17.121101 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2180c28-f4b2-4c64-a190-920f941c2a08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:29:17.121710 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2180c28-f4b2-4c64-a190-920f941c2a08 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:17.121989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2180c28-f4b2-4c64-a190-920f941c2a08 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:17.122266 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2180c28-f4b2-4c64-a190-920f941c2a08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:17.124119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c2180c28-f4b2-4c64-a190-920f941c2a08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:17.218338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2180c28-f4b2-4c64-a190-920f941c2a08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:29:17.219987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2180c28-f4b2-4c64-a190-920f941c2a08 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:29:17.237920 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 704/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:29:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:29:19.396135 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00a215-70d1-4905-9795-7babd20bc0e5 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:19.396741 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00a215-70d1-4905-9795-7babd20bc0e5 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:19.396741 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00a215-70d1-4905-9795-7babd20bc0e5 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:19.398028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 682/1386] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:19.403277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051efe8-9827-46a4-b74a-1fca5d0554ca None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:19.403771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051efe8-9827-46a4-b74a-1fca5d0554ca None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:19.403873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051efe8-9827-46a4-b74a-1fca5d0554ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:19.474393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-a051efe8-9827-46a4-b74a-1fca5d0554ca None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:19.475653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a051efe8-9827-46a4-b74a-1fca5d0554ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:19.511871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:19.591324 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 705/1387] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:19.892634 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00a215-70d1-4905-9795-7babd20bc0e5 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:29:19.894384 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4b00a215-70d1-4905-9795-7babd20bc0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:19.982882 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:20.052693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00a215-70d1-4905-9795-7babd20bc0e5 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:29:20.178034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f6ed0-1470-4001-9f6a-4d2ba92aa9d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:29:20.178641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f6ed0-1470-4001-9f6a-4d2ba92aa9d4 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:20.178952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f6ed0-1470-4001-9f6a-4d2ba92aa9d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:20.179234 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f6ed0-1470-4001-9f6a-4d2ba92aa9d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:20.180817 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e12f6ed0-1470-4001-9f6a-4d2ba92aa9d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:20.220337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:20.271631 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f6ed0-1470-4001-9f6a-4d2ba92aa9d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:29:20.273221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f6ed0-1470-4001-9f6a-4d2ba92aa9d4 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:29:20.291527 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 683/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:29:22.507768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00ff41-4bdd-49f4-828e-75b9159d97e5 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:22.508368 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00ff41-4bdd-49f4-828e-75b9159d97e5 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:22.508368 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00ff41-4bdd-49f4-828e-75b9159d97e5 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:22.509657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 706/1389] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:22.515234 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b735643-2471-4001-8e42-a9cc2cf4826e None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:22.515695 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b735643-2471-4001-8e42-a9cc2cf4826e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:22.515806 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b735643-2471-4001-8e42-a9cc2cf4826e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:22.581783 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-1b735643-2471-4001-8e42-a9cc2cf4826e None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:22.583037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1b735643-2471-4001-8e42-a9cc2cf4826e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:22.679881 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 684/1390] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:22.899985 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed96c4c-8792-4930-ac91-b0e6e3139c2b None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:22.900273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed96c4c-8792-4930-ac91-b0e6e3139c2b None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:22.900554 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed96c4c-8792-4930-ac91-b0e6e3139c2b None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:22.901965 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 707/1391] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:22.907509 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b50771-e4d6-4a2a-b023-23b4f1583c94 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:22.907796 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b50771-e4d6-4a2a-b023-23b4f1583c94 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:22.908070 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b50771-e4d6-4a2a-b023-23b4f1583c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:22.924332 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:22.968511 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed96c4c-8792-4930-ac91-b0e6e3139c2b None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:29:22.970102 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-7ed96c4c-8792-4930-ac91-b0e6e3139c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:22.978931 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-25b50771-e4d6-4a2a-b023-23b4f1583c94 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:22.980120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-25b50771-e4d6-4a2a-b023-23b4f1583c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:23.086883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 685/1392] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:23.122764 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed96c4c-8792-4930-ac91-b0e6e3139c2b None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:29:23.140376 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:23.240054 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862cc84-201e-4e69-a982-6a3863f09390 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:29:23.240653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862cc84-201e-4e69-a982-6a3863f09390 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:23.240929 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862cc84-201e-4e69-a982-6a3863f09390 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:23.241193 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862cc84-201e-4e69-a982-6a3863f09390 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:23.242776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d862cc84-201e-4e69-a982-6a3863f09390 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:23.335557 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862cc84-201e-4e69-a982-6a3863f09390 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:29:23.337147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862cc84-201e-4e69-a982-6a3863f09390 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:29:23.355996 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 708/1393] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:29:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:29:23.385085 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa7542-f2f6-41ec-ad92-255ed560dedb None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:23.385445 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa7542-f2f6-41ec-ad92-255ed560dedb None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:23.385790 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa7542-f2f6-41ec-ad92-255ed560dedb None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:23.387295 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 686/1394] 10.222.0.26 () {54 vars in 962 bytes} [Mon Sep 26 01:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:23.396546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc8bd4-9cb0-4911-9087-cce0832f4bb8 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:23.396833 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc8bd4-9cb0-4911-9087-cce0832f4bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:23.397115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc8bd4-9cb0-4911-9087-cce0832f4bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:23.427605 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:23.487933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-d6bc8bd4-9cb0-4911-9087-cce0832f4bb8 None None] MFA Rules not processed for user `15538b95acef435798ff7651fc1710cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:23.489191 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d6bc8bd4-9cb0-4911-9087-cce0832f4bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:23.572206 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 709/1395] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Sep 26 01:29:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:23.582211 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa7542-f2f6-41ec-ad92-255ed560dedb None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:29:23.583789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ebfa7542-f2f6-41ec-ad92-255ed560dedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:23.684201 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:23.691594 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa7542-f2f6-41ec-ad92-255ed560dedb None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:29:23.767625 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168a1b7-a981-4522-b8fb-a617ba5a3770 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15538b95acef435798ff7651fc1710cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:29:23.768226 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168a1b7-a981-4522-b8fb-a617ba5a3770 service glance] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:23.768497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168a1b7-a981-4522-b8fb-a617ba5a3770 service glance] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:23.768761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168a1b7-a981-4522-b8fb-a617ba5a3770 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:23.770352 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3168a1b7-a981-4522-b8fb-a617ba5a3770 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:23.881383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168a1b7-a981-4522-b8fb-a617ba5a3770 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:29:23.882760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168a1b7-a981-4522-b8fb-a617ba5a3770 service glance] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:29:23.902326 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 687/1396] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:29:24.652113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2158508-1d61-498a-86f6-039be807a89f None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:24.652651 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2158508-1d61-498a-86f6-039be807a89f None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:24.652761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2158508-1d61-498a-86f6-039be807a89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:24.721590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-f2158508-1d61-498a-86f6-039be807a89f None None] MFA Rules not processed for user `6f4696c410f343709be200dee463bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:24.722806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f2158508-1d61-498a-86f6-039be807a89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:24.782775 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:24.811513 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 710/1397] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 26 01:29:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:24.857482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e261af-2af5-4b42-bf20-cf99e344e7c3 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:24.858574 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e261af-2af5-4b42-bf20-cf99e344e7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:24.859103 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e261af-2af5-4b42-bf20-cf99e344e7c3 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:24.860520 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 688/1398] 10.222.0.26 () {54 vars in 943 bytes} [Mon Sep 26 01:29:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:24.866997 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1d2ea-f3e1-4bae-a64a-85212b94325f None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:24.867294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1d2ea-f3e1-4bae-a64a-85212b94325f None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:24.867571 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1d2ea-f3e1-4bae-a64a-85212b94325f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:24.944590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-64c1d2ea-f3e1-4bae-a64a-85212b94325f None None] MFA Rules not processed for user `c924da83d1a94c49814d2e7b5969c8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:24.945807 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-64c1d2ea-f3e1-4bae-a64a-85212b94325f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:25.054658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 711/1399] 10.222.0.26 () {58 vars in 1040 bytes} [Mon Sep 26 01:29:24 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:25.064029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e261af-2af5-4b42-bf20-cf99e344e7c3 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:29:25.065595 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-46e261af-2af5-4b42-bf20-cf99e344e7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:25.090616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:25.207560 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e261af-2af5-4b42-bf20-cf99e344e7c3 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:29:25.313727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac562be-191d-42aa-b9dd-1e315520994b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c924da83d1a94c49814d2e7b5969c8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:29:25.314333 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac562be-191d-42aa-b9dd-1e315520994b service swift] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:25.314604 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac562be-191d-42aa-b9dd-1e315520994b service swift] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:25.314962 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac562be-191d-42aa-b9dd-1e315520994b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:25.316590 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7ac562be-191d-42aa-b9dd-1e315520994b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:25.323823 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:25.402327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac562be-191d-42aa-b9dd-1e315520994b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:29:25.403865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac562be-191d-42aa-b9dd-1e315520994b service swift] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:29:25.412221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 689/1400] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 26 01:29:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 01:29:25.564466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c136c90-c108-49ed-884e-50bc0e79bb63 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:25.564759 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c136c90-c108-49ed-884e-50bc0e79bb63 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:25.565046 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c136c90-c108-49ed-884e-50bc0e79bb63 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:25.570326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 712/1401] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:25.572063 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9e2c0-7e59-4876-8e24-956aa7091c0a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:25.572347 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9e2c0-7e59-4876-8e24-956aa7091c0a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:25.572622 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9e2c0-7e59-4876-8e24-956aa7091c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:25.648344 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-b2b9e2c0-7e59-4876-8e24-956aa7091c0a None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:25.649555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b2b9e2c0-7e59-4876-8e24-956aa7091c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:25.757967 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:25.762984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 690/1402] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:26.051841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c136c90-c108-49ed-884e-50bc0e79bb63 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:29:26.053356 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-1c136c90-c108-49ed-884e-50bc0e79bb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:26.099020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:26.223004 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c136c90-c108-49ed-884e-50bc0e79bb63 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:29:26.352461 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:26.354897 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f1951-118e-4662-bce8-34480e7a13e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:29:26.355585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f1951-118e-4662-bce8-34480e7a13e3 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:26.356069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f1951-118e-4662-bce8-34480e7a13e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:26.356524 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f1951-118e-4662-bce8-34480e7a13e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:26.359414 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-5e6f1951-118e-4662-bce8-34480e7a13e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:26.463344 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f1951-118e-4662-bce8-34480e7a13e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:29:26.464957 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f1951-118e-4662-bce8-34480e7a13e3 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:29:26.484128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 713/1403] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:29:28.710892 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8529c-0cd2-4299-b845-8713e0a08106 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:28.711399 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8529c-0cd2-4299-b845-8713e0a08106 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:28.711399 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8529c-0cd2-4299-b845-8713e0a08106 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:28.712840 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 691/1404] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:28.720431 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f4a9b-8c7e-4e40-b794-c3402e2096cc None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:28.720926 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f4a9b-8c7e-4e40-b794-c3402e2096cc None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:28.721029 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f4a9b-8c7e-4e40-b794-c3402e2096cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:28.794286 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-a65f4a9b-8c7e-4e40-b794-c3402e2096cc None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:28.796639 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a65f4a9b-8c7e-4e40-b794-c3402e2096cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:28.869421 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:28.914866 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 714/1405] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:29.206252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8529c-0cd2-4299-b845-8713e0a08106 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:29:29.207763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-dcf8529c-0cd2-4299-b845-8713e0a08106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:29.374714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8529c-0cd2-4299-b845-8713e0a08106 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:29:29.458537 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:29.507278 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5089148-3ecb-4e18-9acc-ffabac962c7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:29:29.507889 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5089148-3ecb-4e18-9acc-ffabac962c7d service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:29.508168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5089148-3ecb-4e18-9acc-ffabac962c7d service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:29.508439 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5089148-3ecb-4e18-9acc-ffabac962c7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:29.510117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b5089148-3ecb-4e18-9acc-ffabac962c7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:29.616570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5089148-3ecb-4e18-9acc-ffabac962c7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:29:29.618152 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5089148-3ecb-4e18-9acc-ffabac962c7d service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:29:29.638493 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 692/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:29:31.866674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134905f-8f52-4e42-a215-c01c4e196da3 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:31.867279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134905f-8f52-4e42-a215-c01c4e196da3 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:31.867279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134905f-8f52-4e42-a215-c01c4e196da3 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:31.869016 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 715/1407] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:31.874093 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851eacd9-8d78-439f-852b-a755d679a27f None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:31.874513 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851eacd9-8d78-439f-852b-a755d679a27f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:31.874657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851eacd9-8d78-439f-852b-a755d679a27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:31.948255 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-851eacd9-8d78-439f-852b-a755d679a27f None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:31.949472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-851eacd9-8d78-439f-852b-a755d679a27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:31.993703 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:32.060282 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 693/1408] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:32.351915 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134905f-8f52-4e42-a215-c01c4e196da3 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:29:32.353463 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-8134905f-8f52-4e42-a215-c01c4e196da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:32.532016 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134905f-8f52-4e42-a215-c01c4e196da3 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:29:32.595258 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:32.662945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f7906-4e83-4022-b16f-846afb8ed040 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:29:32.663555 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f7906-4e83-4022-b16f-846afb8ed040 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:32.663835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f7906-4e83-4022-b16f-846afb8ed040 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:32.664114 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f7906-4e83-4022-b16f-846afb8ed040 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:32.665875 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-155f7906-4e83-4022-b16f-846afb8ed040 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:32.780232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f7906-4e83-4022-b16f-846afb8ed040 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:29:32.781824 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f7906-4e83-4022-b16f-846afb8ed040 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:29:32.800830 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 716/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:29:42.058752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=27 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:42.798212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=73 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:48.459130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97a696-9522-4916-a202-e42b6d811649 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:48.459693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97a696-9522-4916-a202-e42b6d811649 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:48.459693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97a696-9522-4916-a202-e42b6d811649 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:48.461086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 694/1410] 10.222.0.26 () {54 vars in 918 bytes} [Mon Sep 26 01:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:48.466008 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70c61a-0f29-44c3-8f46-421ceeffaaa0 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:48.466543 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70c61a-0f29-44c3-8f46-421ceeffaaa0 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:48.466813 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70c61a-0f29-44c3-8f46-421ceeffaaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:48.542060 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-2a70c61a-0f29-44c3-8f46-421ceeffaaa0 None None] MFA Rules not processed for user `df7a1b839a6f4bdb9870217fa4d2527c`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:48.543227 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-2a70c61a-0f29-44c3-8f46-421ceeffaaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:48.649635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 717/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Sep 26 01:29:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:48.664106 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b19d45-e48c-4d57-b46d-62cb0c698c74 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:48.664398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b19d45-e48c-4d57-b46d-62cb0c698c74 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:48.664678 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b19d45-e48c-4d57-b46d-62cb0c698c74 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:48.666035 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 695/1412] 10.222.0.26 () {54 vars in 918 bytes} [Mon Sep 26 01:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:48.671116 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b806c4-91ec-47ee-ac60-78cddc44d466 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:48.671402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b806c4-91ec-47ee-ac60-78cddc44d466 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:48.671675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b806c4-91ec-47ee-ac60-78cddc44d466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:48.744758 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:48.747401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-e9b806c4-91ec-47ee-ac60-78cddc44d466 None None] MFA Rules not processed for user `3d6eaeb6bced49afabc7bdaa5e7cecfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:48.749325 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e9b806c4-91ec-47ee-ac60-78cddc44d466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:48.863289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 718/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Sep 26 01:29:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:51.432542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189afe7-7a10-4831-b880-279cf2da4d95 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:51.433034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189afe7-7a10-4831-b880-279cf2da4d95 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:51.433143 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189afe7-7a10-4831-b880-279cf2da4d95 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:51.434400 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 696/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 01:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:51.439913 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e3c77-5fba-438b-b500-87e13a89f6b9 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:51.440335 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e3c77-5fba-438b-b500-87e13a89f6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:51.440440 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e3c77-5fba-438b-b500-87e13a89f6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:51.506972 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-c81e3c77-5fba-438b-b500-87e13a89f6b9 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:51.508166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c81e3c77-5fba-438b-b500-87e13a89f6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:51.562651 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:51.605622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 719/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 01:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:51.896309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189afe7-7a10-4831-b880-279cf2da4d95 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:29:51.897922 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d189afe7-7a10-4831-b880-279cf2da4d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:52.044671 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189afe7-7a10-4831-b880-279cf2da4d95 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:29:52.118510 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:52.160069 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e28d8-133f-4ea5-9d4e-24446ead656b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:29:52.160601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e28d8-133f-4ea5-9d4e-24446ead656b service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:52.160883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e28d8-133f-4ea5-9d4e-24446ead656b service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:52.161164 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e28d8-133f-4ea5-9d4e-24446ead656b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:52.162753 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e93e28d8-133f-4ea5-9d4e-24446ead656b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:52.252292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e28d8-133f-4ea5-9d4e-24446ead656b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:29:52.253989 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e28d8-133f-4ea5-9d4e-24446ead656b service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:29:52.271499 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 697/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:29:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:29:53.413200 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7f050-4778-47df-b3bb-27837b7cd481 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:53.413650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7f050-4778-47df-b3bb-27837b7cd481 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:53.413774 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7f050-4778-47df-b3bb-27837b7cd481 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:53.415187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 720/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 01:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:53.421583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3e4c2-2cd1-4004-8bd6-e5a4ddc870d8 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:53.421997 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3e4c2-2cd1-4004-8bd6-e5a4ddc870d8 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:53.422108 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3e4c2-2cd1-4004-8bd6-e5a4ddc870d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:53.498168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-21a3e4c2-2cd1-4004-8bd6-e5a4ddc870d8 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:53.499386 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-21a3e4c2-2cd1-4004-8bd6-e5a4ddc870d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:53.525920 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:53.594871 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 698/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:53.746395 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7f050-4778-47df-b3bb-27837b7cd481 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:29:53.748039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-aad7f050-4778-47df-b3bb-27837b7cd481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:53.892181 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7f050-4778-47df-b3bb-27837b7cd481 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:29:53.932829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:54.008065 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4ccb9-8bc8-4f10-92ef-afb46270368c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:29:54.008660 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4ccb9-8bc8-4f10-92ef-afb46270368c service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:54.008935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4ccb9-8bc8-4f10-92ef-afb46270368c service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:54.009205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4ccb9-8bc8-4f10-92ef-afb46270368c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:54.010809 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-eeb4ccb9-8bc8-4f10-92ef-afb46270368c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:54.100853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4ccb9-8bc8-4f10-92ef-afb46270368c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:29:54.102409 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4ccb9-8bc8-4f10-92ef-afb46270368c service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:29:54.120606 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 721/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:29:55.249017 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82685b08-3f65-49e2-8716-1545a582c4f2 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:55.249490 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82685b08-3f65-49e2-8716-1545a582c4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:55.249592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82685b08-3f65-49e2-8716-1545a582c4f2 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:55.250944 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 699/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 01:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:55.257429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24009ff-439e-47a1-812f-1c063df04197 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:55.257925 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24009ff-439e-47a1-812f-1c063df04197 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:55.258022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24009ff-439e-47a1-812f-1c063df04197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:55.315763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:55.338402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-d24009ff-439e-47a1-812f-1c063df04197 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:55.339640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d24009ff-439e-47a1-812f-1c063df04197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:55.435503 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 722/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:55.588274 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82685b08-3f65-49e2-8716-1545a582c4f2 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:29:55.589799 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-82685b08-3f65-49e2-8716-1545a582c4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:55.736063 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82685b08-3f65-49e2-8716-1545a582c4f2 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:29:55.749213 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:55.851223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc095f-8e3c-4d5a-b8f1-4a3c7c813642 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:29:55.851740 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc095f-8e3c-4d5a-b8f1-4a3c7c813642 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:55.852018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc095f-8e3c-4d5a-b8f1-4a3c7c813642 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:55.852289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc095f-8e3c-4d5a-b8f1-4a3c7c813642 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:55.853905 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-13cc095f-8e3c-4d5a-b8f1-4a3c7c813642 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:55.944915 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc095f-8e3c-4d5a-b8f1-4a3c7c813642 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:29:55.946523 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc095f-8e3c-4d5a-b8f1-4a3c7c813642 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:29:55.968229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 700/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:29:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:29:57.076132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e3e71-8965-4ed3-8414-c46c776bd15d None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:57.076678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e3e71-8965-4ed3-8414-c46c776bd15d None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:57.076678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e3e71-8965-4ed3-8414-c46c776bd15d None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:57.078005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 723/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 01:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:57.084127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45142247-152b-42d5-88f2-bd5f1149e746 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:57.084561 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45142247-152b-42d5-88f2-bd5f1149e746 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:57.084694 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45142247-152b-42d5-88f2-bd5f1149e746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:57.104704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:57.160792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-45142247-152b-42d5-88f2-bd5f1149e746 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:57.161978 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-45142247-152b-42d5-88f2-bd5f1149e746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:57.256601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 701/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:57.405655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e3e71-8965-4ed3-8414-c46c776bd15d None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:29:57.407358 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c76e3e71-8965-4ed3-8414-c46c776bd15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:57.516139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:57.552706 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e3e71-8965-4ed3-8414-c46c776bd15d None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:29:57.666071 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41109c88-70d2-4fd6-acbe-0823891b9528 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:29:57.666582 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41109c88-70d2-4fd6-acbe-0823891b9528 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:57.666882 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41109c88-70d2-4fd6-acbe-0823891b9528 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:57.667154 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41109c88-70d2-4fd6-acbe-0823891b9528 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:57.668756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-41109c88-70d2-4fd6-acbe-0823891b9528 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:57.743889 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:57.757957 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41109c88-70d2-4fd6-acbe-0823891b9528 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:29:57.759601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41109c88-70d2-4fd6-acbe-0823891b9528 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:29:57.777916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 724/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:29:58.887754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfb6e1-7b8e-44c1-bf79-1de630c56e07 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:58.888328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfb6e1-7b8e-44c1-bf79-1de630c56e07 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:58.888328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfb6e1-7b8e-44c1-bf79-1de630c56e07 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:58.889623 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 702/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 01:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:29:58.896147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126095d5-266f-47fc-9893-f1845c6b2231 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:58.896585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126095d5-266f-47fc-9893-f1845c6b2231 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:58.896697 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126095d5-266f-47fc-9893-f1845c6b2231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:58.973045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-126095d5-266f-47fc-9893-f1845c6b2231 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:29:58.974254 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-126095d5-266f-47fc-9893-f1845c6b2231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:59.069358 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 725/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 01:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:29:59.218347 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfb6e1-7b8e-44c1-bf79-1de630c56e07 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:29:59.219885 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b2cfb6e1-7b8e-44c1-bf79-1de630c56e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:59.303608 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:59.365248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfb6e1-7b8e-44c1-bf79-1de630c56e07 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:29:59.482473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebae38-8bc8-4e0f-984f-f95a19b60bd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:29:59.483108 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebae38-8bc8-4e0f-984f-f95a19b60bd4 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:29:59.483381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebae38-8bc8-4e0f-984f-f95a19b60bd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:29:59.483648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebae38-8bc8-4e0f-984f-f95a19b60bd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:29:59.485244 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-92ebae38-8bc8-4e0f-984f-f95a19b60bd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:29:59.532950 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:59.577286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebae38-8bc8-4e0f-984f-f95a19b60bd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:29:59.578989 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebae38-8bc8-4e0f-984f-f95a19b60bd4 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:29:59.597142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 703/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:29:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:30:00.662092 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a142d-b4ce-4201-873c-41e17c73e43e None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:00.662663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a142d-b4ce-4201-873c-41e17c73e43e None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:00.662663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a142d-b4ce-4201-873c-41e17c73e43e None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:00.664013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 726/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 01:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:30:00.670214 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fbfc5-4c22-4f11-b0ef-303548263c66 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:00.670684 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fbfc5-4c22-4f11-b0ef-303548263c66 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:00.670788 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fbfc5-4c22-4f11-b0ef-303548263c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:00.745672 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-506fbfc5-4c22-4f11-b0ef-303548263c66 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:30:00.747453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-506fbfc5-4c22-4f11-b0ef-303548263c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:00.842980 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 704/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 01:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:30:00.993812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a142d-b4ce-4201-873c-41e17c73e43e None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:30:00.995385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-804a142d-b4ce-4201-873c-41e17c73e43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:01.044340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:01.142840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a142d-b4ce-4201-873c-41e17c73e43e None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:30:01.254995 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a161a3-5ba9-4c00-ac01-76c35912e2e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:30:01.255529 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a161a3-5ba9-4c00-ac01-76c35912e2e1 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:01.255805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a161a3-5ba9-4c00-ac01-76c35912e2e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:01.256077 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a161a3-5ba9-4c00-ac01-76c35912e2e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:01.257662 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-86a161a3-5ba9-4c00-ac01-76c35912e2e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:01.265054 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:01.348205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a161a3-5ba9-4c00-ac01-76c35912e2e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:30:01.349781 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a161a3-5ba9-4c00-ac01-76c35912e2e1 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:30:01.367699 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 727/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:30:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:30:02.427979 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047afb1-abd8-44e4-8e05-6e833d842369 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:02.428485 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047afb1-abd8-44e4-8e05-6e833d842369 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:02.428592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047afb1-abd8-44e4-8e05-6e833d842369 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:02.429839 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 705/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 01:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:30:02.436140 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60226ead-b188-4a99-bdc4-fb13a4601142 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:02.436565 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60226ead-b188-4a99-bdc4-fb13a4601142 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:02.436713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60226ead-b188-4a99-bdc4-fb13a4601142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:02.627298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-60226ead-b188-4a99-bdc4-fb13a4601142 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:30:02.628433 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-60226ead-b188-4a99-bdc4-fb13a4601142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:02.695442 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:02.725069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 728/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 01:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:30:02.874661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047afb1-abd8-44e4-8e05-6e833d842369 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:30:02.876219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7047afb1-abd8-44e4-8e05-6e833d842369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:02.894153 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:03.022390 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047afb1-abd8-44e4-8e05-6e833d842369 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:30:03.109429 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:03.136292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123c8fa-65be-4fb7-8ef2-08406d784acb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:30:03.136887 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123c8fa-65be-4fb7-8ef2-08406d784acb service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:03.137164 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123c8fa-65be-4fb7-8ef2-08406d784acb service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:03.138004 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123c8fa-65be-4fb7-8ef2-08406d784acb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:03.139745 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a123c8fa-65be-4fb7-8ef2-08406d784acb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:03.227258 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123c8fa-65be-4fb7-8ef2-08406d784acb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:30:03.228890 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123c8fa-65be-4fb7-8ef2-08406d784acb service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:30:03.246535 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 706/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:30:04.296760 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077f504-bbce-4a44-9dd2-ac8b7a40f16a None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:04.297309 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077f504-bbce-4a44-9dd2-ac8b7a40f16a None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:04.297309 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077f504-bbce-4a44-9dd2-ac8b7a40f16a None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:04.298626 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 729/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 01:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:30:04.304709 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546829ee-d2bc-46fb-8074-47455f5c8fdf None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:04.305166 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546829ee-d2bc-46fb-8074-47455f5c8fdf None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:04.305296 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546829ee-d2bc-46fb-8074-47455f5c8fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:04.381565 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-546829ee-d2bc-46fb-8074-47455f5c8fdf None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:30:04.382781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-546829ee-d2bc-46fb-8074-47455f5c8fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:04.424666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:04.479394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 707/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 01:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:30:04.630734 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077f504-bbce-4a44-9dd2-ac8b7a40f16a None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:30:04.632189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b077f504-bbce-4a44-9dd2-ac8b7a40f16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:04.776473 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077f504-bbce-4a44-9dd2-ac8b7a40f16a None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:30:04.831464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:04.890425 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e233c-5809-4a18-8c22-d1e48aa61e03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:30:04.890978 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e233c-5809-4a18-8c22-d1e48aa61e03 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:04.891261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e233c-5809-4a18-8c22-d1e48aa61e03 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:04.891534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e233c-5809-4a18-8c22-d1e48aa61e03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:04.893142 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b75e233c-5809-4a18-8c22-d1e48aa61e03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:04.984545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e233c-5809-4a18-8c22-d1e48aa61e03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:30:04.986117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e233c-5809-4a18-8c22-d1e48aa61e03 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:30:05.004473 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 730/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:30:06.098263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e3eae-4d28-4a8f-a17d-7d84abaf332f None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:06.099003 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e3eae-4d28-4a8f-a17d-7d84abaf332f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:06.099003 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e3eae-4d28-4a8f-a17d-7d84abaf332f None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:06.100174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 708/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 01:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:30:06.108002 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa7103-a413-41f2-abf0-cb20f653fac7 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:06.108516 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa7103-a413-41f2-abf0-cb20f653fac7 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:06.108629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa7103-a413-41f2-abf0-cb20f653fac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:06.196971 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-dcfa7103-a413-41f2-abf0-cb20f653fac7 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:30:06.198198 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-dcfa7103-a413-41f2-abf0-cb20f653fac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:06.201905 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:06.311016 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 731/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 01:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:30:06.475540 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e3eae-4d28-4a8f-a17d-7d84abaf332f None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:30:06.477189 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ca9e3eae-4d28-4a8f-a17d-7d84abaf332f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:06.635562 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e3eae-4d28-4a8f-a17d-7d84abaf332f None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:30:06.663603 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:06.750760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f363ef-2f26-4f26-97d4-a97beb814e5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:30:06.751392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f363ef-2f26-4f26-97d4-a97beb814e5e service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:06.751672 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f363ef-2f26-4f26-97d4-a97beb814e5e service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:06.751942 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f363ef-2f26-4f26-97d4-a97beb814e5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:06.753571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-07f363ef-2f26-4f26-97d4-a97beb814e5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:06.845351 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f363ef-2f26-4f26-97d4-a97beb814e5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:30:06.846967 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f363ef-2f26-4f26-97d4-a97beb814e5e service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:30:06.864932 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 709/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:30:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:30:08.944435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57d836-8c3d-4940-9d7c-aeb6a2d4bb74 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:08.944977 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57d836-8c3d-4940-9d7c-aeb6a2d4bb74 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:08.944977 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57d836-8c3d-4940-9d7c-aeb6a2d4bb74 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:08.946326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 732/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 01:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:30:08.952550 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1eaec-ac4b-4b10-9757-1850b1b42c21 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:08.952965 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1eaec-ac4b-4b10-9757-1850b1b42c21 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:08.953102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1eaec-ac4b-4b10-9757-1850b1b42c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:08.994180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:09.020255 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-05c1eaec-ac4b-4b10-9757-1850b1b42c21 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:30:09.021457 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-05c1eaec-ac4b-4b10-9757-1850b1b42c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:09.117319 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 710/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 01:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:30:09.404881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57d836-8c3d-4940-9d7c-aeb6a2d4bb74 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:30:09.406465 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-df57d836-8c3d-4940-9d7c-aeb6a2d4bb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:09.508225 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57d836-8c3d-4940-9d7c-aeb6a2d4bb74 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:30:09.540351 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:09.583541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb526737-9a82-4ad5-9ced-4719517de177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:30:09.584140 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb526737-9a82-4ad5-9ced-4719517de177 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:09.584439 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb526737-9a82-4ad5-9ced-4719517de177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:09.584707 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb526737-9a82-4ad5-9ced-4719517de177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:09.586307 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-bb526737-9a82-4ad5-9ced-4719517de177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:09.693584 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb526737-9a82-4ad5-9ced-4719517de177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:30:09.695021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb526737-9a82-4ad5-9ced-4719517de177 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:30:09.713512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 733/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:30:12.026853 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67a586-1a59-4456-a075-6df5771a4e05 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:12.027431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67a586-1a59-4456-a075-6df5771a4e05 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:12.027431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67a586-1a59-4456-a075-6df5771a4e05 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:12.028850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 711/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 01:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:30:12.033925 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86aa35-b245-4c2b-b71d-8b2dd0cbb762 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:12.034334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86aa35-b245-4c2b-b71d-8b2dd0cbb762 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:12.034445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86aa35-b245-4c2b-b71d-8b2dd0cbb762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:12.101159 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-9a86aa35-b245-4c2b-b71d-8b2dd0cbb762 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:30:12.102363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-9a86aa35-b245-4c2b-b71d-8b2dd0cbb762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:12.115430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:12.198679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 734/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 01:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:30:12.482187 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67a586-1a59-4456-a075-6df5771a4e05 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:30:12.483801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-bb67a586-1a59-4456-a075-6df5771a4e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:12.587368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67a586-1a59-4456-a075-6df5771a4e05 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:30:12.600248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:12.661964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c45a63-49c0-46e4-994d-03062f3d20a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:30:12.662491 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c45a63-49c0-46e4-994d-03062f3d20a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:12.662767 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c45a63-49c0-46e4-994d-03062f3d20a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:12.663066 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c45a63-49c0-46e4-994d-03062f3d20a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:12.664652 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-44c45a63-49c0-46e4-994d-03062f3d20a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:12.773834 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c45a63-49c0-46e4-994d-03062f3d20a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:30:12.775305 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c45a63-49c0-46e4-994d-03062f3d20a1 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:30:12.792641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 712/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:30:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:30:15.225822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91468087-b2df-4e9f-b70b-b47ecf04c3f9 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:15.226227 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91468087-b2df-4e9f-b70b-b47ecf04c3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:15.226368 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91468087-b2df-4e9f-b70b-b47ecf04c3f9 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:15.227740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 735/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 01:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:30:15.233652 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd402fb3-3f2f-45e8-8c5d-8906ed7a497c None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:15.234100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd402fb3-3f2f-45e8-8c5d-8906ed7a497c None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:15.234223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd402fb3-3f2f-45e8-8c5d-8906ed7a497c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:15.281642 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:15.300577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-bd402fb3-3f2f-45e8-8c5d-8906ed7a497c None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:30:15.301808 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-bd402fb3-3f2f-45e8-8c5d-8906ed7a497c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:15.399419 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 713/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 01:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:30:15.682049 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91468087-b2df-4e9f-b70b-b47ecf04c3f9 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:30:15.684193 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-91468087-b2df-4e9f-b70b-b47ecf04c3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:15.786727 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91468087-b2df-4e9f-b70b-b47ecf04c3f9 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:30:15.827396 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:15.861203 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dbe98-717e-48f3-af72-953ab03a46d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:30:15.861802 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dbe98-717e-48f3-af72-953ab03a46d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:15.862084 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dbe98-717e-48f3-af72-953ab03a46d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:15.862360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dbe98-717e-48f3-af72-953ab03a46d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:15.864010 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-388dbe98-717e-48f3-af72-953ab03a46d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:15.972315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dbe98-717e-48f3-af72-953ab03a46d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:30:15.973735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dbe98-717e-48f3-af72-953ab03a46d3 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:30:15.992327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 736/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:30:18.267590 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94287ff1-b893-4c49-a752-1148df457bc9 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:18.268151 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94287ff1-b893-4c49-a752-1148df457bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:18.268151 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94287ff1-b893-4c49-a752-1148df457bc9 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:18.269581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 714/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 01:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:30:18.275099 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9424b2a-9a53-493e-9f5b-6d3c9b8c835c None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:18.275633 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9424b2a-9a53-493e-9f5b-6d3c9b8c835c None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:18.275633 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9424b2a-9a53-493e-9f5b-6d3c9b8c835c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:18.340644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-a9424b2a-9a53-493e-9f5b-6d3c9b8c835c None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:30:18.341841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a9424b2a-9a53-493e-9f5b-6d3c9b8c835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:18.362635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:18.439186 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 737/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 01:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:30:18.721895 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94287ff1-b893-4c49-a752-1148df457bc9 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:30:18.723468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-94287ff1-b893-4c49-a752-1148df457bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:18.826532 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94287ff1-b893-4c49-a752-1148df457bc9 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:30:18.847376 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:18.900396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d1ee2-337e-446a-88de-8e2a575d1aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:30:18.900997 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d1ee2-337e-446a-88de-8e2a575d1aef service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:18.901274 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d1ee2-337e-446a-88de-8e2a575d1aef service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:18.901544 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d1ee2-337e-446a-88de-8e2a575d1aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:18.903946 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f98d1ee2-337e-446a-88de-8e2a575d1aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:19.012592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d1ee2-337e-446a-88de-8e2a575d1aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:30:19.013969 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d1ee2-337e-446a-88de-8e2a575d1aef service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:30:19.031866 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 715/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:30:21.228150 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30920f-05ef-4028-82cf-05ced2f56439 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:21.228558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30920f-05ef-4028-82cf-05ced2f56439 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:21.228693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30920f-05ef-4028-82cf-05ced2f56439 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:21.230077 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 738/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 01:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:30:21.235717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ba3ed-b1ab-42c4-8232-40c5cefef67d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:21.236147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ba3ed-b1ab-42c4-8232-40c5cefef67d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:21.236387 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ba3ed-b1ab-42c4-8232-40c5cefef67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:21.300645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:21.303683 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-167ba3ed-b1ab-42c4-8232-40c5cefef67d None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:30:21.305382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-167ba3ed-b1ab-42c4-8232-40c5cefef67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:21.401308 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 716/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 01:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:30:21.684285 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30920f-05ef-4028-82cf-05ced2f56439 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:30:21.685856 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-9b30920f-05ef-4028-82cf-05ced2f56439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:21.790934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30920f-05ef-4028-82cf-05ced2f56439 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:30:21.842649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:21.868166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8c3cf-dd74-4e82-9b66-efba8361cc03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:30:21.868769 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8c3cf-dd74-4e82-9b66-efba8361cc03 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:21.869044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8c3cf-dd74-4e82-9b66-efba8361cc03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:21.869314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8c3cf-dd74-4e82-9b66-efba8361cc03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:21.871672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-62b8c3cf-dd74-4e82-9b66-efba8361cc03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:21.985757 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8c3cf-dd74-4e82-9b66-efba8361cc03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:30:21.987228 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8c3cf-dd74-4e82-9b66-efba8361cc03 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:30:22.005215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 739/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:30:24.272477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762595c-686e-4e10-93c6-319d95185283 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:24.273047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762595c-686e-4e10-93c6-319d95185283 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:24.273047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762595c-686e-4e10-93c6-319d95185283 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:24.274379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 717/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 01:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:30:24.280572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12ca07-8252-47e2-9297-9b1b7cb34413 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:24.281017 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12ca07-8252-47e2-9297-9b1b7cb34413 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:24.281113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12ca07-8252-47e2-9297-9b1b7cb34413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:24.348074 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-9f12ca07-8252-47e2-9297-9b1b7cb34413 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:30:24.349293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-9f12ca07-8252-47e2-9297-9b1b7cb34413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:24.378422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:24.446291 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 740/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:30:24.733511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762595c-686e-4e10-93c6-319d95185283 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:30:24.735100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a762595c-686e-4e10-93c6-319d95185283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:24.838385 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762595c-686e-4e10-93c6-319d95185283 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:30:24.866621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:24.912157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376bf46-de06-47f4-ad06-8b6ca3e6c813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:30:24.912752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376bf46-de06-47f4-ad06-8b6ca3e6c813 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:24.913037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376bf46-de06-47f4-ad06-8b6ca3e6c813 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:24.913304 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376bf46-de06-47f4-ad06-8b6ca3e6c813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:24.914926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e376bf46-de06-47f4-ad06-8b6ca3e6c813 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:25.024348 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376bf46-de06-47f4-ad06-8b6ca3e6c813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:30:25.025695 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376bf46-de06-47f4-ad06-8b6ca3e6c813 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:30:25.044641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 718/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:30:27.346263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629dda2e-4fb8-44cf-91df-1b6ea5768e17 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:27.346797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629dda2e-4fb8-44cf-91df-1b6ea5768e17 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:27.346797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629dda2e-4fb8-44cf-91df-1b6ea5768e17 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:27.348165 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 741/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 01:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:30:27.353628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfe382-5cf9-4595-a3ec-d4e8fadd55bf None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:27.354059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfe382-5cf9-4595-a3ec-d4e8fadd55bf None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:27.354163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfe382-5cf9-4595-a3ec-d4e8fadd55bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:27.420296 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-5fbfe382-5cf9-4595-a3ec-d4e8fadd55bf None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:30:27.421505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5fbfe382-5cf9-4595-a3ec-d4e8fadd55bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:27.429752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:27.518324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 719/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 01:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:30:27.800720 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629dda2e-4fb8-44cf-91df-1b6ea5768e17 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:30:27.802299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-629dda2e-4fb8-44cf-91df-1b6ea5768e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:27.910704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629dda2e-4fb8-44cf-91df-1b6ea5768e17 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:30:27.967510 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:27.985474 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97625f2-9924-43f2-86ef-b0db9b2066eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:30:27.986069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97625f2-9924-43f2-86ef-b0db9b2066eb service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:27.986342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97625f2-9924-43f2-86ef-b0db9b2066eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:27.986609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97625f2-9924-43f2-86ef-b0db9b2066eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:27.988219 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d97625f2-9924-43f2-86ef-b0db9b2066eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:28.097679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97625f2-9924-43f2-86ef-b0db9b2066eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:30:28.099051 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97625f2-9924-43f2-86ef-b0db9b2066eb service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:30:28.117629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 742/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:30:30.347402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b24b6d-b23f-4b75-b336-9cdcc3a7eeca None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:30.347986 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b24b6d-b23f-4b75-b336-9cdcc3a7eeca None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:30.347986 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b24b6d-b23f-4b75-b336-9cdcc3a7eeca None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:30.349272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 720/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 01:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:30:30.354505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5e5ec-cf4a-4265-86d7-3e9b7f3a4c62 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:30.355678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5e5ec-cf4a-4265-86d7-3e9b7f3a4c62 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:30.355678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5e5ec-cf4a-4265-86d7-3e9b7f3a4c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:30.425976 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-7ba5e5ec-cf4a-4265-86d7-3e9b7f3a4c62 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:30:30.427206 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-7ba5e5ec-cf4a-4265-86d7-3e9b7f3a4c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:30.465795 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:30.523338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 743/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 01:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:30:30.809767 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b24b6d-b23f-4b75-b336-9cdcc3a7eeca None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:30:30.811367 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-91b24b6d-b23f-4b75-b336-9cdcc3a7eeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:30.914583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b24b6d-b23f-4b75-b336-9cdcc3a7eeca None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:30:30.952619 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:30.988258 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ddc15-d4b5-49e6-9f49-5eeab5f08e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:30:30.988851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ddc15-d4b5-49e6-9f49-5eeab5f08e18 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:30.989130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ddc15-d4b5-49e6-9f49-5eeab5f08e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:30.989397 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ddc15-d4b5-49e6-9f49-5eeab5f08e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:30.991023 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-497ddc15-d4b5-49e6-9f49-5eeab5f08e18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:31.100611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ddc15-d4b5-49e6-9f49-5eeab5f08e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:30:31.102337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ddc15-d4b5-49e6-9f49-5eeab5f08e18 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:30:31.121443 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 721/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:30:33.293433 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653b9b-00e7-4266-9f03-800209c93e2b None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:33.293995 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653b9b-00e7-4266-9f03-800209c93e2b None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:33.293995 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653b9b-00e7-4266-9f03-800209c93e2b None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:33.295384 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 744/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 01:30:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:30:33.300560 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acd2fd-cd10-4bae-a06e-911ba475b400 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:33.300983 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acd2fd-cd10-4bae-a06e-911ba475b400 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:33.301095 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acd2fd-cd10-4bae-a06e-911ba475b400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:33.368528 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-89acd2fd-cd10-4bae-a06e-911ba475b400 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:30:33.369715 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-89acd2fd-cd10-4bae-a06e-911ba475b400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:33.387659 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:33.469497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 722/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 01:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:30:33.753311 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3653b9b-00e7-4266-9f03-800209c93e2b None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:30:33.754870 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b3653b9b-00e7-4266-9f03-800209c93e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:33.857510 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3653b9b-00e7-4266-9f03-800209c93e2b None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:30:33.923646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:33.930443 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c5516-111d-4cad-9711-b5c4ccb2877e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:30:33.931071 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c5516-111d-4cad-9711-b5c4ccb2877e service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:33.931349 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c5516-111d-4cad-9711-b5c4ccb2877e service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:33.931620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c5516-111d-4cad-9711-b5c4ccb2877e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:33.933241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-735c5516-111d-4cad-9711-b5c4ccb2877e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:34.040619 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c5516-111d-4cad-9711-b5c4ccb2877e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:30:34.041993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c5516-111d-4cad-9711-b5c4ccb2877e service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:30:34.059470 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 745/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:30:36.240368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015eec5-af2f-449a-89cc-13aa190b452e None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:36.240942 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015eec5-af2f-449a-89cc-13aa190b452e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:36.240942 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015eec5-af2f-449a-89cc-13aa190b452e None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:36.242329 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 723/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 01:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:30:36.248882 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c952e9-e6e8-4fdf-8e73-acd89502cd9f None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:36.249321 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c952e9-e6e8-4fdf-8e73-acd89502cd9f None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:36.249423 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c952e9-e6e8-4fdf-8e73-acd89502cd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:36.316401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-97c952e9-e6e8-4fdf-8e73-acd89502cd9f None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:30:36.317611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-97c952e9-e6e8-4fdf-8e73-acd89502cd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:36.367851 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:36.417631 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 746/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 01:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:30:36.703505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015eec5-af2f-449a-89cc-13aa190b452e None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:30:36.705036 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a015eec5-af2f-449a-89cc-13aa190b452e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:36.812107 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015eec5-af2f-449a-89cc-13aa190b452e None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:30:36.861004 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:36.887982 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460c5a8-23a1-4b35-9404-c750d5ef90a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:30:36.888567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460c5a8-23a1-4b35-9404-c750d5ef90a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:36.888845 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460c5a8-23a1-4b35-9404-c750d5ef90a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:36.889116 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460c5a8-23a1-4b35-9404-c750d5ef90a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:36.890718 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8460c5a8-23a1-4b35-9404-c750d5ef90a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:36.999333 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460c5a8-23a1-4b35-9404-c750d5ef90a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:30:37.000752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460c5a8-23a1-4b35-9404-c750d5ef90a4 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:30:37.018284 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 724/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:30:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:30:46.418153 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=22 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:47.016078 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=66 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:57.150015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a7f6b-f5a0-49f5-a80c-1d31b94865d6 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:57.150601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a7f6b-f5a0-49f5-a80c-1d31b94865d6 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:57.150601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a7f6b-f5a0-49f5-a80c-1d31b94865d6 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:57.151990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 747/1471] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:30:57.157378 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453306e-b000-486a-a53c-388488bc25a9 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:57.157779 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453306e-b000-486a-a53c-388488bc25a9 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:57.157918 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453306e-b000-486a-a53c-388488bc25a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:57.225599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2453306e-b000-486a-a53c-388488bc25a9 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:30:57.226810 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2453306e-b000-486a-a53c-388488bc25a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:57.324599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 725/1472] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:30:57.624477 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24dba9-f445-4809-9171-579117335e25 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:57.624766 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24dba9-f445-4809-9171-579117335e25 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:57.625041 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24dba9-f445-4809-9171-579117335e25 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:57.626389 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 748/1473] 10.222.0.26 () {54 vars in 962 bytes} [Mon Sep 26 01:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:30:57.631355 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e94753-e796-43f6-9891-e4d01283830a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:57.631636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e94753-e796-43f6-9891-e4d01283830a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:57.631904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e94753-e796-43f6-9891-e4d01283830a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:57.707245 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-11e94753-e796-43f6-9891-e4d01283830a None None] MFA Rules not processed for user `15538b95acef435798ff7651fc1710cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:30:57.708369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-11e94753-e796-43f6-9891-e4d01283830a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:57.729165 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:57.785546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 726/1474] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Sep 26 01:30:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:30:57.793637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24dba9-f445-4809-9171-579117335e25 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:30:57.795200 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-ec24dba9-f445-4809-9171-579117335e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:57.899006 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24dba9-f445-4809-9171-579117335e25 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:30:57.972223 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18146d-f194-4d86-a8f0-0bd515102697 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15538b95acef435798ff7651fc1710cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:30:57.972815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18146d-f194-4d86-a8f0-0bd515102697 service glance] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:30:57.973088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18146d-f194-4d86-a8f0-0bd515102697 service glance] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:30:57.973355 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18146d-f194-4d86-a8f0-0bd515102697 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:30:57.974974 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4d18146d-f194-4d86-a8f0-0bd515102697 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:30:58.027397 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:30:58.081405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18146d-f194-4d86-a8f0-0bd515102697 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:30:58.082888 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18146d-f194-4d86-a8f0-0bd515102697 service glance] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:30:58.100685 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 749/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:30:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:31:00.364534 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c55a8-87ff-4c41-b2b1-ea83e82bd34d None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:31:00.365109 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c55a8-87ff-4c41-b2b1-ea83e82bd34d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:31:00.365109 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c55a8-87ff-4c41-b2b1-ea83e82bd34d None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:31:00.366446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 727/1476] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:31:00.371674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bdb3f-9196-4024-bbe9-eaff795f3860 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:31:00.372117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bdb3f-9196-4024-bbe9-eaff795f3860 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:31:00.372228 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bdb3f-9196-4024-bbe9-eaff795f3860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:31:00.438878 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-a77bdb3f-9196-4024-bbe9-eaff795f3860 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:31:00.440089 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a77bdb3f-9196-4024-bbe9-eaff795f3860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:31:00.535366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 750/1477] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:31:00.808499 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c55a8-87ff-4c41-b2b1-ea83e82bd34d None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:31:00.810042 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-160c55a8-87ff-4c41-b2b1-ea83e82bd34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:31:00.934208 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c55a8-87ff-4c41-b2b1-ea83e82bd34d None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:31:00.984752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:31:01.030187 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34dff9f-d504-4f0b-aafc-ad7ef78fd7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:31:01.030786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dff9f-d504-4f0b-aafc-ad7ef78fd7aa admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:31:01.031095 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dff9f-d504-4f0b-aafc-ad7ef78fd7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:31:01.031367 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dff9f-d504-4f0b-aafc-ad7ef78fd7aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:31:01.031997 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34dff9f-d504-4f0b-aafc-ad7ef78fd7aa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:31:01.033766 dv-cinder-859203-2-smb devstack@keystone.service[81421]: WARNING py.warnings [None req-a34dff9f-d504-4f0b-aafc-ad7ef78fd7aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 01:31:01.033766 dv-cinder-859203-2-smb devstack@keystone.service[81421]: warnings.warn(msg) Sep 26 01:31:01.033766 dv-cinder-859203-2-smb devstack@keystone.service[81421]: Sep 26 01:31:01.034931 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34dff9f-d504-4f0b-aafc-ad7ef78fd7aa admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:31:01.053746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 728/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 26 01:31:00 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:31:03.224754 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b82ea-f061-4b27-baeb-093f2b5c72f9 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:31:03.225374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b82ea-f061-4b27-baeb-093f2b5c72f9 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:31:03.225374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b82ea-f061-4b27-baeb-093f2b5c72f9 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:31:03.226630 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 751/1479] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:31:03.231990 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca2511-5ed9-451c-859e-0a62abf133b1 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:31:03.232404 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca2511-5ed9-451c-859e-0a62abf133b1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:31:03.232543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca2511-5ed9-451c-859e-0a62abf133b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:31:03.298404 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-57ca2511-5ed9-451c-859e-0a62abf133b1 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:31:03.299645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-57ca2511-5ed9-451c-859e-0a62abf133b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:31:03.395915 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 729/1480] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:31:03.688284 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b82ea-f061-4b27-baeb-093f2b5c72f9 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:31:03.689998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-168b82ea-f061-4b27-baeb-093f2b5c72f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:31:03.700708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:31:03.835942 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b82ea-f061-4b27-baeb-093f2b5c72f9 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:31:03.916141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:31:03.948831 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729b1ed-df34-49e7-88dc-1f54760d83b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:31:03.949360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729b1ed-df34-49e7-88dc-1f54760d83b9 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:31:03.949638 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729b1ed-df34-49e7-88dc-1f54760d83b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:31:03.949910 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729b1ed-df34-49e7-88dc-1f54760d83b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:31:03.951535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a729b1ed-df34-49e7-88dc-1f54760d83b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:31:04.038658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729b1ed-df34-49e7-88dc-1f54760d83b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:31:04.040832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729b1ed-df34-49e7-88dc-1f54760d83b9 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:31:04.058588 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 752/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:31:06.396331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfe3a8-a449-4503-943b-0d893d705eb5 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:31:06.396890 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfe3a8-a449-4503-943b-0d893d705eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:31:06.396890 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfe3a8-a449-4503-943b-0d893d705eb5 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:31:06.398195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 730/1482] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:31:06.405952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9891b-6c48-4e8d-9921-99024d617c6b None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:31:06.406408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9891b-6c48-4e8d-9921-99024d617c6b None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:31:06.406641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9891b-6c48-4e8d-9921-99024d617c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:31:06.479217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-0ea9891b-6c48-4e8d-9921-99024d617c6b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:31:06.480427 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0ea9891b-6c48-4e8d-9921-99024d617c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:31:06.526512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:31:06.576766 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 753/1483] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:31:06.865521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfe3a8-a449-4503-943b-0d893d705eb5 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:31:06.867170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b2dfe3a8-a449-4503-943b-0d893d705eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:31:06.892179 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:31:06.971714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfe3a8-a449-4503-943b-0d893d705eb5 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:31:07.044822 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485fbc3-1ef5-4901-9abb-d8b4e9e47718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:31:07.045419 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485fbc3-1ef5-4901-9abb-d8b4e9e47718 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:31:07.045692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485fbc3-1ef5-4901-9abb-d8b4e9e47718 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:31:07.045987 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485fbc3-1ef5-4901-9abb-d8b4e9e47718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:31:07.047694 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7485fbc3-1ef5-4901-9abb-d8b4e9e47718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:31:07.124129 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:31:07.159203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485fbc3-1ef5-4901-9abb-d8b4e9e47718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:31:07.160662 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485fbc3-1ef5-4901-9abb-d8b4e9e47718 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:31:07.295716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 731/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:31:09.547631 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd5a79-4d88-430c-9f47-1e773a21dc35 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:31:09.548179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd5a79-4d88-430c-9f47-1e773a21dc35 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:31:09.548179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd5a79-4d88-430c-9f47-1e773a21dc35 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:31:09.549455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 754/1485] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:31:09.554640 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63fedd-05b9-4d7d-9f1f-951d05ea5f11 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:31:09.555097 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63fedd-05b9-4d7d-9f1f-951d05ea5f11 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:31:09.555671 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63fedd-05b9-4d7d-9f1f-951d05ea5f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:31:09.621862 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-1d63fedd-05b9-4d7d-9f1f-951d05ea5f11 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:31:09.623146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1d63fedd-05b9-4d7d-9f1f-951d05ea5f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:31:09.717555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 732/1486] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:31:10.008005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd5a79-4d88-430c-9f47-1e773a21dc35 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:31:10.009692 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-47fd5a79-4d88-430c-9f47-1e773a21dc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:31:10.112662 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd5a79-4d88-430c-9f47-1e773a21dc35 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:31:10.183737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:31:10.185197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57505931-5d75-4a7d-84d0-22d4455b818f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:31:10.185912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57505931-5d75-4a7d-84d0-22d4455b818f service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:31:10.186239 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57505931-5d75-4a7d-84d0-22d4455b818f service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:31:10.186535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57505931-5d75-4a7d-84d0-22d4455b818f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:31:10.188788 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-57505931-5d75-4a7d-84d0-22d4455b818f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:31:10.296191 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57505931-5d75-4a7d-84d0-22d4455b818f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:31:10.297533 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57505931-5d75-4a7d-84d0-22d4455b818f service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:31:10.316625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 755/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:31:12.640399 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86237919-f2d0-46fd-a883-76bd625d57bc None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:31:12.640969 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86237919-f2d0-46fd-a883-76bd625d57bc None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:31:12.640969 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86237919-f2d0-46fd-a883-76bd625d57bc None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:31:12.642279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 733/1488] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:31:12.647600 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21252a6b-fb7f-4128-afba-de27e12e4016 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:31:12.648085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21252a6b-fb7f-4128-afba-de27e12e4016 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:31:12.648195 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21252a6b-fb7f-4128-afba-de27e12e4016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:31:12.714044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-21252a6b-fb7f-4128-afba-de27e12e4016 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:31:12.715199 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-21252a6b-fb7f-4128-afba-de27e12e4016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:31:12.767462 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:31:12.812335 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 756/1489] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:31:13.104483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86237919-f2d0-46fd-a883-76bd625d57bc None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:31:13.106007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-86237919-f2d0-46fd-a883-76bd625d57bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:31:13.142321 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:31:13.208689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86237919-f2d0-46fd-a883-76bd625d57bc None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:31:13.281557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdfaf9-b5f1-4d2b-8ea7-c31f7faef9e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:31:13.282158 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdfaf9-b5f1-4d2b-8ea7-c31f7faef9e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:31:13.282431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdfaf9-b5f1-4d2b-8ea7-c31f7faef9e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:31:13.282699 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdfaf9-b5f1-4d2b-8ea7-c31f7faef9e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:31:13.284320 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d3fdfaf9-b5f1-4d2b-8ea7-c31f7faef9e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:31:13.363984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:31:13.392934 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fdfaf9-b5f1-4d2b-8ea7-c31f7faef9e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:31:13.394404 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fdfaf9-b5f1-4d2b-8ea7-c31f7faef9e3 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:31:13.413364 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 734/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:31:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:31:15.780220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51137d-67d6-4635-a248-c62a56f0f61a None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:31:15.780789 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51137d-67d6-4635-a248-c62a56f0f61a None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:31:15.780789 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51137d-67d6-4635-a248-c62a56f0f61a None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:31:15.782137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 757/1491] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 26 01:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:31:15.787563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e379160-457b-4830-843a-3e985d3b1472 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:31:15.787951 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e379160-457b-4830-843a-3e985d3b1472 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:31:15.788098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e379160-457b-4830-843a-3e985d3b1472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:31:15.854074 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-5e379160-457b-4830-843a-3e985d3b1472 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:31:15.855296 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5e379160-457b-4830-843a-3e985d3b1472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:31:15.949891 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 735/1492] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 26 01:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:31:16.246294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51137d-67d6-4635-a248-c62a56f0f61a None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:31:16.247907 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-3e51137d-67d6-4635-a248-c62a56f0f61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:31:16.354821 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51137d-67d6-4635-a248-c62a56f0f61a None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:31:16.428894 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb53ee-2e6a-4515-8067-57c4691be8ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:31:16.429767 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb53ee-2e6a-4515-8067-57c4691be8ed service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:31:16.430051 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb53ee-2e6a-4515-8067-57c4691be8ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:31:16.430519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb53ee-2e6a-4515-8067-57c4691be8ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:31:16.432222 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-96fb53ee-2e6a-4515-8067-57c4691be8ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:31:16.440532 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:31:16.540527 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb53ee-2e6a-4515-8067-57c4691be8ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:31:16.541862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb53ee-2e6a-4515-8067-57c4691be8ed service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:31:16.560254 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 758/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:31:25.948355 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=82 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:31:26.557970 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=50 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:32:34.789484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d88f3-849e-45a3-a569-c89236563c41 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:32:34.790063 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d88f3-849e-45a3-a569-c89236563c41 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:32:34.790063 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d88f3-849e-45a3-a569-c89236563c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:32:34.865795 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-637d88f3-849e-45a3-a569-c89236563c41 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:32:34.867033 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-637d88f3-849e-45a3-a569-c89236563c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:32:34.962936 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 736/1494] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:32:34.970987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0a0c8-cf1f-4ccf-9337-2958998dabda None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:32:34.971512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0a0c8-cf1f-4ccf-9337-2958998dabda None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:32:34.971620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0a0c8-cf1f-4ccf-9337-2958998dabda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:32:35.046596 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-52e0a0c8-cf1f-4ccf-9337-2958998dabda None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:32:35.047826 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-52e0a0c8-cf1f-4ccf-9337-2958998dabda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:32:35.144850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 759/1495] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:32:35.150222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d88f3-849e-45a3-a569-c89236563c41 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:32:35.151472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-637d88f3-849e-45a3-a569-c89236563c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:32:35.162789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d88f3-849e-45a3-a569-c89236563c41 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:32:35.223337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:32:35.258988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89cd8f-45df-481b-a817-0b53d8dafae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:32:35.259596 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89cd8f-45df-481b-a817-0b53d8dafae5 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:32:35.259874 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89cd8f-45df-481b-a817-0b53d8dafae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:32:35.260145 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89cd8f-45df-481b-a817-0b53d8dafae5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:32:35.260784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89cd8f-45df-481b-a817-0b53d8dafae5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:32:35.261084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89cd8f-45df-481b-a817-0b53d8dafae5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:32:35.262092 dv-cinder-859203-2-smb devstack@keystone.service[81421]: WARNING py.warnings [None req-1e89cd8f-45df-481b-a817-0b53d8dafae5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 01:32:35.262092 dv-cinder-859203-2-smb devstack@keystone.service[81421]: warnings.warn(msg) Sep 26 01:32:35.262092 dv-cinder-859203-2-smb devstack@keystone.service[81421]: Sep 26 01:32:35.262997 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89cd8f-45df-481b-a817-0b53d8dafae5 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:32:35.274630 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 737/1496] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:32:35.282850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0a0c8-cf1f-4ccf-9337-2958998dabda None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:32:35.292451 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0a0c8-cf1f-4ccf-9337-2958998dabda None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:32:35.352784 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:32:35.385849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cef855-d18d-4ec5-8f59-0d722e0cd46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:32:35.386444 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cef855-d18d-4ec5-8f59-0d722e0cd46a admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:32:35.386723 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cef855-d18d-4ec5-8f59-0d722e0cd46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:32:35.387023 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cef855-d18d-4ec5-8f59-0d722e0cd46a admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:32:35.387646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cef855-d18d-4ec5-8f59-0d722e0cd46a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:32:35.389364 dv-cinder-859203-2-smb devstack@keystone.service[81422]: WARNING py.warnings [None req-86cef855-d18d-4ec5-8f59-0d722e0cd46a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 01:32:35.389364 dv-cinder-859203-2-smb devstack@keystone.service[81422]: warnings.warn(msg) Sep 26 01:32:35.389364 dv-cinder-859203-2-smb devstack@keystone.service[81422]: Sep 26 01:32:35.390570 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cef855-d18d-4ec5-8f59-0d722e0cd46a admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:32:35.447784 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 760/1497] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:32:35 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:32:35.451966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89cd8f-45df-481b-a817-0b53d8dafae5 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:32:35.453493 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1e89cd8f-45df-481b-a817-0b53d8dafae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:32:35.486876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89cd8f-45df-481b-a817-0b53d8dafae5 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:32:35.578182 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7675f-8fe6-429e-b5d6-5fdcfebae010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:32:35.578699 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7675f-8fe6-429e-b5d6-5fdcfebae010 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:32:35.579006 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7675f-8fe6-429e-b5d6-5fdcfebae010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:32:35.579271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7675f-8fe6-429e-b5d6-5fdcfebae010 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:32:35.579893 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7675f-8fe6-429e-b5d6-5fdcfebae010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:32:35.580888 dv-cinder-859203-2-smb devstack@keystone.service[81421]: WARNING py.warnings [None req-ccc7675f-8fe6-429e-b5d6-5fdcfebae010 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 01:32:35.580888 dv-cinder-859203-2-smb devstack@keystone.service[81421]: warnings.warn(msg) Sep 26 01:32:35.580888 dv-cinder-859203-2-smb devstack@keystone.service[81421]: Sep 26 01:32:35.582069 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7675f-8fe6-429e-b5d6-5fdcfebae010 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:32:35.624704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 738/1498] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:32:35 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:32:35.628798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cef855-d18d-4ec5-8f59-0d722e0cd46a admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:32:35.630303 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-86cef855-d18d-4ec5-8f59-0d722e0cd46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:32:35.691386 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cef855-d18d-4ec5-8f59-0d722e0cd46a admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:32:35.774524 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:32:35.785321 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07506367-6314-4d18-91bd-622fcc1c364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:32:35.785927 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07506367-6314-4d18-91bd-622fcc1c364b admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:32:35.786205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07506367-6314-4d18-91bd-622fcc1c364b admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:32:35.786477 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07506367-6314-4d18-91bd-622fcc1c364b admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:32:35.787144 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07506367-6314-4d18-91bd-622fcc1c364b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:32:35.788676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: WARNING py.warnings [None req-07506367-6314-4d18-91bd-622fcc1c364b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 01:32:35.788676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: warnings.warn(msg) Sep 26 01:32:35.788676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: Sep 26 01:32:35.789562 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07506367-6314-4d18-91bd-622fcc1c364b admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:32:35.801713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 761/1499] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:32:35.806399 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7675f-8fe6-429e-b5d6-5fdcfebae010 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:32:35.807939 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ccc7675f-8fe6-429e-b5d6-5fdcfebae010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:32:35.819381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7675f-8fe6-429e-b5d6-5fdcfebae010 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:32:35.844240 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:32:35.914815 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a407a9-ea5f-4057-8973-91fed57279a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:32:35.915445 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a407a9-ea5f-4057-8973-91fed57279a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:32:35.915718 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a407a9-ea5f-4057-8973-91fed57279a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:32:35.915984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a407a9-ea5f-4057-8973-91fed57279a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:32:35.916642 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a407a9-ea5f-4057-8973-91fed57279a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:32:35.917641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: WARNING py.warnings [None req-07a407a9-ea5f-4057-8973-91fed57279a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 01:32:35.917641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: warnings.warn(msg) Sep 26 01:32:35.917641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: Sep 26 01:32:35.918508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a407a9-ea5f-4057-8973-91fed57279a8 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:32:35.930849 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 739/1500] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:32:35.935036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07506367-6314-4d18-91bd-622fcc1c364b admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:32:35.936563 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-07506367-6314-4d18-91bd-622fcc1c364b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:32:35.971414 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07506367-6314-4d18-91bd-622fcc1c364b admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:32:36.062896 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71364dc5-7fc4-4697-85d6-c8e91322defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:32:36.063536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71364dc5-7fc4-4697-85d6-c8e91322defe admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:32:36.063815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71364dc5-7fc4-4697-85d6-c8e91322defe admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:32:36.064092 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71364dc5-7fc4-4697-85d6-c8e91322defe admin admin] PATH_INFO: `/v3/projects/7768e4d8ae1d46f89c9e15458a1a4d31/users/5ede0ca5fa414700871504f3e45ed718/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:32:36.088051 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71364dc5-7fc4-4697-85d6-c8e91322defe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7768e4d8ae1d46f89c9e15458a1a4d31, user_id=5ede0ca5fa414700871504f3e45ed718, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:32:36.089072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: WARNING py.warnings [None req-71364dc5-7fc4-4697-85d6-c8e91322defe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 01:32:36.089072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: warnings.warn(msg) Sep 26 01:32:36.089072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: Sep 26 01:32:36.091042 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71364dc5-7fc4-4697-85d6-c8e91322defe admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:32:36.114680 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 762/1501] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:32:35 2022] PUT /identity/v3/projects/7768e4d8ae1d46f89c9e15458a1a4d31/users/5ede0ca5fa414700871504f3e45ed718/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:32:36.127542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369829e8-bf15-4805-ad46-bb2823df94fb None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:32:36.127877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369829e8-bf15-4805-ad46-bb2823df94fb None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:32:36.128156 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369829e8-bf15-4805-ad46-bb2823df94fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:32:36.184874 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-369829e8-bf15-4805-ad46-bb2823df94fb None None] MFA Rules not processed for user `5ede0ca5fa414700871504f3e45ed718`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:32:36.186071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-369829e8-bf15-4805-ad46-bb2823df94fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:32:36.264849 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 740/1502] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:32:36.278381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e736a2-50fe-45b1-b1f0-1c311c498e61 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:32:36.278669 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e736a2-50fe-45b1-b1f0-1c311c498e61 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:32:36.279013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e736a2-50fe-45b1-b1f0-1c311c498e61 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:32:36.280334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 763/1503] 10.222.0.26 () {54 vars in 963 bytes} [Mon Sep 26 01:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:32:36.284925 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081229ba-22a6-4b30-b7d1-96404b522262 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:32:36.285212 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081229ba-22a6-4b30-b7d1-96404b522262 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:32:36.285492 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081229ba-22a6-4b30-b7d1-96404b522262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:32:36.317696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:32:36.364507 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-081229ba-22a6-4b30-b7d1-96404b522262 None None] MFA Rules not processed for user `eab8abb1394d41e3a30439699086da28`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:32:36.366407 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-081229ba-22a6-4b30-b7d1-96404b522262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:32:36.441117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 741/1504] 10.222.0.26 () {58 vars in 1060 bytes} [Mon Sep 26 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:32:36.449202 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e736a2-50fe-45b1-b1f0-1c311c498e61 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:32:36.450719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e4e736a2-50fe-45b1-b1f0-1c311c498e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:32:36.500931 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:32:36.555161 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e736a2-50fe-45b1-b1f0-1c311c498e61 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:32:36.627985 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e26a56-6b54-4b29-92f3-07e97a636659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:32:36.628877 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e26a56-6b54-4b29-92f3-07e97a636659 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:32:36.629357 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e26a56-6b54-4b29-92f3-07e97a636659 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:32:36.629830 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e26a56-6b54-4b29-92f3-07e97a636659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:32:36.632847 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-43e26a56-6b54-4b29-92f3-07e97a636659 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:32:36.737922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e26a56-6b54-4b29-92f3-07e97a636659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:32:36.739450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e26a56-6b54-4b29-92f3-07e97a636659 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:32:36.743798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:32:36.758194 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 764/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:32:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:32:36.805295 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52741fe-3b80-4d0e-a622-11771f1588fd None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:32:36.805576 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52741fe-3b80-4d0e-a622-11771f1588fd None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:32:36.805844 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52741fe-3b80-4d0e-a622-11771f1588fd None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:32:36.807130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 742/1506] 10.222.0.26 () {52 vars in 830 bytes} [Mon Sep 26 01:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:32:36.810769 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e26a56-6b54-4b29-92f3-07e97a636659 service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:32:36.812047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-43e26a56-6b54-4b29-92f3-07e97a636659 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:32:36.911906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e26a56-6b54-4b29-92f3-07e97a636659 service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:32:37.004600 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1faf9b5-09c9-4c49-b150-867bcac59967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:32:37.005266 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faf9b5-09c9-4c49-b150-867bcac59967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:32:37.005532 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faf9b5-09c9-4c49-b150-867bcac59967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:32:37.005799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faf9b5-09c9-4c49-b150-867bcac59967 admin admin] PATH_INFO: `/v3/users/5ede0ca5fa414700871504f3e45ed718` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:32:37.018517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1faf9b5-09c9-4c49-b150-867bcac59967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ede0ca5fa414700871504f3e45ed718)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:32:37.019547 dv-cinder-859203-2-smb devstack@keystone.service[81422]: WARNING py.warnings [None req-f1faf9b5-09c9-4c49-b150-867bcac59967 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 01:32:37.019547 dv-cinder-859203-2-smb devstack@keystone.service[81422]: warnings.warn(msg) Sep 26 01:32:37.019547 dv-cinder-859203-2-smb devstack@keystone.service[81422]: Sep 26 01:32:37.020743 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1faf9b5-09c9-4c49-b150-867bcac59967 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:32:37.031062 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:32:37.090169 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f1faf9b5-09c9-4c49-b150-867bcac59967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ede0ca5fa414700871504f3e45ed718'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:32:37.090609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f1faf9b5-09c9-4c49-b150-867bcac59967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ede0ca5fa414700871504f3e45ed718'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:32:37.091219 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f1faf9b5-09c9-4c49-b150-867bcac59967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ede0ca5fa414700871504f3e45ed718'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:32:37.114182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f1faf9b5-09c9-4c49-b150-867bcac59967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ede0ca5fa414700871504f3e45ed718'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:32:37.128356 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f1faf9b5-09c9-4c49-b150-867bcac59967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ede0ca5fa414700871504f3e45ed718'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:32:37.144165 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 765/1507] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:32:36 2022] DELETE /identity/v3/users/5ede0ca5fa414700871504f3e45ed718 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:32:37.149502 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9b7ed-ac4a-4ebe-a595-ad9255852def None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:32:37.149792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9b7ed-ac4a-4ebe-a595-ad9255852def None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:32:37.150070 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9b7ed-ac4a-4ebe-a595-ad9255852def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:32:37.206543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-aec9b7ed-ac4a-4ebe-a595-ad9255852def None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:32:37.207699 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-aec9b7ed-ac4a-4ebe-a595-ad9255852def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:32:37.283742 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:32:37.296149 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 743/1508] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:32:37.305711 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1faf9b5-09c9-4c49-b150-867bcac59967 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:32:37.306999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f1faf9b5-09c9-4c49-b150-867bcac59967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:32:37.407363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1faf9b5-09c9-4c49-b150-867bcac59967 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:32:37.462104 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:32:37.482988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e26a84-9ad6-4155-9ed0-4d981d6f8624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:32:37.483591 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e26a84-9ad6-4155-9ed0-4d981d6f8624 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:32:37.483864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e26a84-9ad6-4155-9ed0-4d981d6f8624 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:32:37.484129 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e26a84-9ad6-4155-9ed0-4d981d6f8624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:32:37.485733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-03e26a84-9ad6-4155-9ed0-4d981d6f8624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:32:37.594989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e26a84-9ad6-4155-9ed0-4d981d6f8624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:32:37.596410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e26a84-9ad6-4155-9ed0-4d981d6f8624 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:32:37.614894 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 766/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:32:37.967828 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9b7ed-ac4a-4ebe-a595-ad9255852def None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:32:37.969295 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-aec9b7ed-ac4a-4ebe-a595-ad9255852def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:32:37.981414 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9b7ed-ac4a-4ebe-a595-ad9255852def None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:32:38.098714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a76d9-1feb-46e4-a30d-336d614f6da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:32:38.099367 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a76d9-1feb-46e4-a30d-336d614f6da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:32:38.099646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a76d9-1feb-46e4-a30d-336d614f6da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:32:38.099947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a76d9-1feb-46e4-a30d-336d614f6da6 admin admin] PATH_INFO: `/v3/projects/7768e4d8ae1d46f89c9e15458a1a4d31` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:32:38.110106 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a76d9-1feb-46e4-a30d-336d614f6da6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7768e4d8ae1d46f89c9e15458a1a4d31)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:32:38.111159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: WARNING py.warnings [None req-298a76d9-1feb-46e4-a30d-336d614f6da6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 01:32:38.111159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: warnings.warn(msg) Sep 26 01:32:38.111159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: Sep 26 01:32:38.112364 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a76d9-1feb-46e4-a30d-336d614f6da6 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:32:38.170478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-298a76d9-1feb-46e4-a30d-336d614f6da6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7768e4d8ae1d46f89c9e15458a1a4d31', 'request_id': 'req-298a76d9-1feb-46e4-a30d-336d614f6da6'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:32:38.176356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-298a76d9-1feb-46e4-a30d-336d614f6da6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7768e4d8ae1d46f89c9e15458a1a4d31', 'request_id': 'req-298a76d9-1feb-46e4-a30d-336d614f6da6'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:32:38.190215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-298a76d9-1feb-46e4-a30d-336d614f6da6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7768e4d8ae1d46f89c9e15458a1a4d31', 'request_id': 'req-298a76d9-1feb-46e4-a30d-336d614f6da6'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:32:38.215573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-298a76d9-1feb-46e4-a30d-336d614f6da6 admin admin] The token cache is being invalidate because project 7768e4d8ae1d46f89c9e15458a1a4d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:32:38.215854 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-298a76d9-1feb-46e4-a30d-336d614f6da6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:32:38.216273 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-298a76d9-1feb-46e4-a30d-336d614f6da6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:32:38.217619 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 744/1510] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:32:37 2022] DELETE /identity/v3/projects/7768e4d8ae1d46f89c9e15458a1a4d31 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:32:47.612750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=62 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:32:48.213579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:34:09.377745 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b686800-5f26-415b-8431-c9bd9180209a None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:09.378244 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b686800-5f26-415b-8431-c9bd9180209a None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:09.378351 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b686800-5f26-415b-8431-c9bd9180209a None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:09.379659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 767/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 01:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:34:09.384677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd6884-1b33-4ae4-8d88-9bf7ade456a3 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:09.385126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd6884-1b33-4ae4-8d88-9bf7ade456a3 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:09.385262 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd6884-1b33-4ae4-8d88-9bf7ade456a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:09.467310 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-06dd6884-1b33-4ae4-8d88-9bf7ade456a3 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:34:09.468516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-06dd6884-1b33-4ae4-8d88-9bf7ade456a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:34:09.572157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 745/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 01:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:34:09.726659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b686800-5f26-415b-8431-c9bd9180209a None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:34:09.728751 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-8b686800-5f26-415b-8431-c9bd9180209a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:34:09.857879 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b686800-5f26-415b-8431-c9bd9180209a None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:34:09.868483 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0de68-1c8e-4128-9e1a-00bb8f55d21c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:34:09.869097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0de68-1c8e-4128-9e1a-00bb8f55d21c service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:09.869374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0de68-1c8e-4128-9e1a-00bb8f55d21c service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:09.869647 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0de68-1c8e-4128-9e1a-00bb8f55d21c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:09.879635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0de68-1c8e-4128-9e1a-00bb8f55d21c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:34:09.883316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0de68-1c8e-4128-9e1a-00bb8f55d21c service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:34:09.893843 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 768/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:34:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:34:11.041144 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca3c3a-3249-444f-865e-12dd00661e35 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:11.041724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca3c3a-3249-444f-865e-12dd00661e35 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:11.041724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca3c3a-3249-444f-865e-12dd00661e35 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:11.043047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 746/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 01:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:34:11.049232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb6648-c0e6-4078-bb59-a9d63cd00f64 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:11.049713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb6648-c0e6-4078-bb59-a9d63cd00f64 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:11.049830 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb6648-c0e6-4078-bb59-a9d63cd00f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:11.070020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-efbb6648-c0e6-4078-bb59-a9d63cd00f64 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:34:11.071248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-efbb6648-c0e6-4078-bb59-a9d63cd00f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:34:11.079310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 769/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:34:11.230696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca3c3a-3249-444f-865e-12dd00661e35 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:34:11.245785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca3c3a-3249-444f-865e-12dd00661e35 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:34:11.251179 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c593bea-b1d9-4e11-afa5-30305d9ac77d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:34:11.251766 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c593bea-b1d9-4e11-afa5-30305d9ac77d service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:11.252043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c593bea-b1d9-4e11-afa5-30305d9ac77d service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:11.252311 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c593bea-b1d9-4e11-afa5-30305d9ac77d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:11.260778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c593bea-b1d9-4e11-afa5-30305d9ac77d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:34:11.262331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c593bea-b1d9-4e11-afa5-30305d9ac77d service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:34:11.271468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 747/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:34:11.913667 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b104045-54e2-4c9c-a48c-67dde22bbfec None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:11.913944 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b104045-54e2-4c9c-a48c-67dde22bbfec None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:11.914218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b104045-54e2-4c9c-a48c-67dde22bbfec None None] PATH_INFO: `/v3` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:11.915543 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 770/1517] 10.222.0.60 () {54 vars in 925 bytes} [Mon Sep 26 01:34:11 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:34:11.922000 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b63a73-8738-4ec4-a905-5c5c9a49f359 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:11.922286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b63a73-8738-4ec4-a905-5c5c9a49f359 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:11.922560 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b63a73-8738-4ec4-a905-5c5c9a49f359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:11.982052 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-e7b63a73-8738-4ec4-a905-5c5c9a49f359 None None] MFA Rules not processed for user `df7a1b839a6f4bdb9870217fa4d2527c`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:34:11.983303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e7b63a73-8738-4ec4-a905-5c5c9a49f359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:34:12.000159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:34:12.055523 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 748/1518] 10.222.0.60 () {58 vars in 1015 bytes} [Mon Sep 26 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:34:15.730103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310673-1f96-49cc-83c9-d95c50987864 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:15.730598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310673-1f96-49cc-83c9-d95c50987864 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:15.730695 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310673-1f96-49cc-83c9-d95c50987864 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:15.731982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 771/1519] 10.222.0.26 () {54 vars in 961 bytes} [Mon Sep 26 01:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:34:15.737003 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb588a-1484-4880-af63-095ae0b5389b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:15.737465 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb588a-1484-4880-af63-095ae0b5389b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:15.737577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb588a-1484-4880-af63-095ae0b5389b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:15.758168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-30fb588a-1484-4880-af63-095ae0b5389b None None] MFA Rules not processed for user `df7a1b839a6f4bdb9870217fa4d2527c`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:34:15.759428 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-30fb588a-1484-4880-af63-095ae0b5389b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:34:15.768483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 749/1520] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Sep 26 01:34:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:34:15.776268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50310673-1f96-49cc-83c9-d95c50987864 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:34:15.789498 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50310673-1f96-49cc-83c9-d95c50987864 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:34:15.794301 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b45f95-9185-4077-8d5d-3ce50c539a8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7a1b839a6f4bdb9870217fa4d2527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:34:15.794913 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b45f95-9185-4077-8d5d-3ce50c539a8e service placement] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:15.795189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b45f95-9185-4077-8d5d-3ce50c539a8e service placement] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:15.795458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b45f95-9185-4077-8d5d-3ce50c539a8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:15.804130 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b45f95-9185-4077-8d5d-3ce50c539a8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:34:15.805663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b45f95-9185-4077-8d5d-3ce50c539a8e service placement] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:34:15.815319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 772/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:34:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:34:22.745834 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f51184-1da3-4830-964b-3db1b8d237fc None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:22.746389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f51184-1da3-4830-964b-3db1b8d237fc None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:22.746493 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f51184-1da3-4830-964b-3db1b8d237fc None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:22.747806 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 750/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 01:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:34:22.753809 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48954ee-4b45-4bdf-8b81-41aa6ee3ac20 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:22.754215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48954ee-4b45-4bdf-8b81-41aa6ee3ac20 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:22.754341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48954ee-4b45-4bdf-8b81-41aa6ee3ac20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:22.773815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-f48954ee-4b45-4bdf-8b81-41aa6ee3ac20 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:34:22.775030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f48954ee-4b45-4bdf-8b81-41aa6ee3ac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:34:22.782668 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 773/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 01:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:34:22.937839 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f51184-1da3-4830-964b-3db1b8d237fc None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:34:22.952752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f51184-1da3-4830-964b-3db1b8d237fc None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:34:22.958165 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf8b2a-a708-4e1a-b3ba-50bb78201215 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:34:22.958756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf8b2a-a708-4e1a-b3ba-50bb78201215 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:22.959178 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf8b2a-a708-4e1a-b3ba-50bb78201215 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:22.959454 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf8b2a-a708-4e1a-b3ba-50bb78201215 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:22.967435 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf8b2a-a708-4e1a-b3ba-50bb78201215 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:34:22.969021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf8b2a-a708-4e1a-b3ba-50bb78201215 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:34:22.978742 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 751/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:34:24.046396 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb49bfd-0e37-4ff6-b7e4-fc58ebe6c1f1 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:24.046961 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb49bfd-0e37-4ff6-b7e4-fc58ebe6c1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:24.046961 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb49bfd-0e37-4ff6-b7e4-fc58ebe6c1f1 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:24.048309 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 774/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 01:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:34:24.054811 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d5e10-39fe-4dc7-aa88-53d0425a71b2 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:24.055266 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d5e10-39fe-4dc7-aa88-53d0425a71b2 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:24.055386 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d5e10-39fe-4dc7-aa88-53d0425a71b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:24.075248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-b95d5e10-39fe-4dc7-aa88-53d0425a71b2 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:34:24.076427 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b95d5e10-39fe-4dc7-aa88-53d0425a71b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:34:24.084805 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 752/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 01:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:34:24.235476 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb49bfd-0e37-4ff6-b7e4-fc58ebe6c1f1 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:34:24.250114 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb49bfd-0e37-4ff6-b7e4-fc58ebe6c1f1 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:34:24.255582 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc3f40-38d7-4bc6-9518-2aecb7423600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:34:24.256709 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc3f40-38d7-4bc6-9518-2aecb7423600 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:24.256977 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc3f40-38d7-4bc6-9518-2aecb7423600 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:24.257251 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc3f40-38d7-4bc6-9518-2aecb7423600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:24.265210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc3f40-38d7-4bc6-9518-2aecb7423600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:34:24.266765 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc3f40-38d7-4bc6-9518-2aecb7423600 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:34:24.276247 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 775/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:34:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:34:28.358578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a5dbd-601c-457c-a330-40999a54897d None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:28.359348 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a5dbd-601c-457c-a330-40999a54897d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:28.359348 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a5dbd-601c-457c-a330-40999a54897d None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:28.360571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 753/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 01:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:34:28.366471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285f6ff-96a1-454d-8063-6647c3350206 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:28.366959 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285f6ff-96a1-454d-8063-6647c3350206 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:28.367072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285f6ff-96a1-454d-8063-6647c3350206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:28.386336 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-b285f6ff-96a1-454d-8063-6647c3350206 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:34:28.387557 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b285f6ff-96a1-454d-8063-6647c3350206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:34:28.395452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 776/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 01:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:34:28.682744 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a5dbd-601c-457c-a330-40999a54897d None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:34:28.684506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-238a5dbd-601c-457c-a330-40999a54897d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:34:28.763690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a5dbd-601c-457c-a330-40999a54897d None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:34:28.767231 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b53c72-840f-4f32-8f74-fa6b19e9f72f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:34:28.767827 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b53c72-840f-4f32-8f74-fa6b19e9f72f service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:28.768104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b53c72-840f-4f32-8f74-fa6b19e9f72f service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:28.768397 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b53c72-840f-4f32-8f74-fa6b19e9f72f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:28.777152 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b53c72-840f-4f32-8f74-fa6b19e9f72f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:34:28.778573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b53c72-840f-4f32-8f74-fa6b19e9f72f service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:34:28.788283 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 754/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:34:30.914708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938aeaa4-c32e-4b32-bc29-995fa6b7eb32 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:30.915299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938aeaa4-c32e-4b32-bc29-995fa6b7eb32 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:30.915299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938aeaa4-c32e-4b32-bc29-995fa6b7eb32 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:30.916629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 777/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 01:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:34:30.921740 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f1ccb-3cb0-42ae-8672-cff33d0292ad None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:30.922121 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f1ccb-3cb0-42ae-8672-cff33d0292ad None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:30.922283 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f1ccb-3cb0-42ae-8672-cff33d0292ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:30.941341 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-628f1ccb-3cb0-42ae-8672-cff33d0292ad None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:34:30.942527 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-628f1ccb-3cb0-42ae-8672-cff33d0292ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:34:30.950567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 755/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 01:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:34:31.244456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938aeaa4-c32e-4b32-bc29-995fa6b7eb32 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:34:31.246207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-938aeaa4-c32e-4b32-bc29-995fa6b7eb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:34:31.259858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938aeaa4-c32e-4b32-bc29-995fa6b7eb32 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:34:31.263715 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e294bc-3275-480c-8d5f-0e80d20c86b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:34:31.264317 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e294bc-3275-480c-8d5f-0e80d20c86b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:31.264598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e294bc-3275-480c-8d5f-0e80d20c86b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:31.264873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e294bc-3275-480c-8d5f-0e80d20c86b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:31.274632 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e294bc-3275-480c-8d5f-0e80d20c86b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:34:31.276073 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e294bc-3275-480c-8d5f-0e80d20c86b0 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:34:31.285469 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 778/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:34:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:34:34.960812 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef44e09-1c42-45aa-bf21-c4de0f9e8228 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:34.961379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef44e09-1c42-45aa-bf21-c4de0f9e8228 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:34.961379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef44e09-1c42-45aa-bf21-c4de0f9e8228 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:34.962702 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 756/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 01:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:34:34.967975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b85dfa-1c79-41f8-90e5-719776ba31fa None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:34.968362 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b85dfa-1c79-41f8-90e5-719776ba31fa None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:34.968514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b85dfa-1c79-41f8-90e5-719776ba31fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:34.987791 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-c3b85dfa-1c79-41f8-90e5-719776ba31fa None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:34:34.988966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c3b85dfa-1c79-41f8-90e5-719776ba31fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:34:34.996744 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 779/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 01:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:34:35.298912 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef44e09-1c42-45aa-bf21-c4de0f9e8228 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:34:35.300599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2ef44e09-1c42-45aa-bf21-c4de0f9e8228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:34:35.366531 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:34:35.379922 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef44e09-1c42-45aa-bf21-c4de0f9e8228 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:34:35.384273 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbc194-dc18-408b-b1bc-3a3344ffacf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:34:35.384864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbc194-dc18-408b-b1bc-3a3344ffacf3 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:35.385140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbc194-dc18-408b-b1bc-3a3344ffacf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:35.385409 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbc194-dc18-408b-b1bc-3a3344ffacf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:35.394200 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbc194-dc18-408b-b1bc-3a3344ffacf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:34:35.395643 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbc194-dc18-408b-b1bc-3a3344ffacf3 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:34:35.405000 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 757/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:34:37.527590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de746da5-813c-4f3c-aeb8-ea026cd76643 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:37.528181 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de746da5-813c-4f3c-aeb8-ea026cd76643 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:37.528181 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de746da5-813c-4f3c-aeb8-ea026cd76643 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:37.529538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 780/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 01:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:34:37.534846 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29f658-2d1c-4f77-844e-78f8282f605b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:37.535296 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29f658-2d1c-4f77-844e-78f8282f605b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:37.535403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29f658-2d1c-4f77-844e-78f8282f605b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:37.555643 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-3a29f658-2d1c-4f77-844e-78f8282f605b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:34:37.556856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3a29f658-2d1c-4f77-844e-78f8282f605b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:34:37.564659 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 758/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 01:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:34:37.873367 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de746da5-813c-4f3c-aeb8-ea026cd76643 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:34:37.875090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-de746da5-813c-4f3c-aeb8-ea026cd76643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:34:37.882898 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=84 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:34:37.889262 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de746da5-813c-4f3c-aeb8-ea026cd76643 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:34:37.892907 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d2d15-7fa5-404a-8f00-0755fc255c83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:34:37.893499 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d2d15-7fa5-404a-8f00-0755fc255c83 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:34:37.893825 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d2d15-7fa5-404a-8f00-0755fc255c83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:34:37.894099 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d2d15-7fa5-404a-8f00-0755fc255c83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:34:37.903218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d2d15-7fa5-404a-8f00-0755fc255c83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:34:37.904620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d2d15-7fa5-404a-8f00-0755fc255c83 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:34:37.914571 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 781/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:34:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:34:47.550473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=11 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:34:47.909724 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=5 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:12.007626 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10cb94-4fd6-4cdb-bbc7-318500fa543c None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.008597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10cb94-4fd6-4cdb-bbc7-318500fa543c None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.008597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10cb94-4fd6-4cdb-bbc7-318500fa543c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.035127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-0d10cb94-4fd6-4cdb-bbc7-318500fa543c None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:12.036344 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0d10cb94-4fd6-4cdb-bbc7-318500fa543c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:12.047231 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 759/1540] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:36:12.057130 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d50f0-ee13-4848-8886-e4c79aee9c3f None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.057735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d50f0-ee13-4848-8886-e4c79aee9c3f None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.057735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d50f0-ee13-4848-8886-e4c79aee9c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.086748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-6c4d50f0-ee13-4848-8886-e4c79aee9c3f None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:12.088016 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6c4d50f0-ee13-4848-8886-e4c79aee9c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:12.102120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 782/1541] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:12.112567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10cb94-4fd6-4cdb-bbc7-318500fa543c None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:12.127140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10cb94-4fd6-4cdb-bbc7-318500fa543c None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:12.133903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc652c-8566-4916-b909-d90b0b54c014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:12.134571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc652c-8566-4916-b909-d90b0b54c014 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.135186 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc652c-8566-4916-b909-d90b0b54c014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.135464 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc652c-8566-4916-b909-d90b0b54c014 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.136130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc652c-8566-4916-b909-d90b0b54c014 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:36:12.136432 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc652c-8566-4916-b909-d90b0b54c014 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:12.138078 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc652c-8566-4916-b909-d90b0b54c014 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:12.159895 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 760/1542] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:36:12.168393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d50f0-ee13-4848-8886-e4c79aee9c3f None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:12.185291 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d50f0-ee13-4848-8886-e4c79aee9c3f None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:12.199839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d25f31-f4a1-4b94-a9ec-7498bcfe7468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:12.200475 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d25f31-f4a1-4b94-a9ec-7498bcfe7468 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.200758 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d25f31-f4a1-4b94-a9ec-7498bcfe7468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.201176 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d25f31-f4a1-4b94-a9ec-7498bcfe7468 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.201849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d25f31-f4a1-4b94-a9ec-7498bcfe7468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:12.204049 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d25f31-f4a1-4b94-a9ec-7498bcfe7468 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:12.275663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 783/1543] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:12 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:12.280148 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc652c-8566-4916-b909-d90b0b54c014 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:12.290997 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b907ec-3c52-4c01-8989-d3fe271c0de9 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.291312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b907ec-3c52-4c01-8989-d3fe271c0de9 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.291558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b907ec-3c52-4c01-8989-d3fe271c0de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.297928 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc652c-8566-4916-b909-d90b0b54c014 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:12.327188 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-a2b907ec-3c52-4c01-8989-d3fe271c0de9 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:12.328427 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a2b907ec-3c52-4c01-8989-d3fe271c0de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:12.399217 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d17334-57ac-44e8-b8ce-d15672cd6a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:12.399584 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d17334-57ac-44e8-b8ce-d15672cd6a9f admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.401326 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d17334-57ac-44e8-b8ce-d15672cd6a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.401326 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d17334-57ac-44e8-b8ce-d15672cd6a9f admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.401326 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d17334-57ac-44e8-b8ce-d15672cd6a9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:12.403572 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d17334-57ac-44e8-b8ce-d15672cd6a9f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:12.457652 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 761/1544] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:12 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:12.459056 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c34d4-8002-4a03-9cfc-8d4979b95336 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.459343 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c34d4-8002-4a03-9cfc-8d4979b95336 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.459619 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c34d4-8002-4a03-9cfc-8d4979b95336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.509337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 784/1545] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:36:12.510239 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b907ec-3c52-4c01-8989-d3fe271c0de9 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:12.510764 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-512c34d4-8002-4a03-9cfc-8d4979b95336 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:12.512474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-512c34d4-8002-4a03-9cfc-8d4979b95336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:12.537830 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b907ec-3c52-4c01-8989-d3fe271c0de9 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:12.562618 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 762/1546] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:12.564476 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ff12b-3b43-4397-b0f2-962b065f14ca None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.564757 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ff12b-3b43-4397-b0f2-962b065f14ca None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.565025 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ff12b-3b43-4397-b0f2-962b065f14ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.569941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06e88d-4d51-4dcf-9e94-748340dfb8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:12.570629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06e88d-4d51-4dcf-9e94-748340dfb8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.570935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06e88d-4d51-4dcf-9e94-748340dfb8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.571212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06e88d-4d51-4dcf-9e94-748340dfb8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.571897 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06e88d-4d51-4dcf-9e94-748340dfb8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:12.573751 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06e88d-4d51-4dcf-9e94-748340dfb8b8 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:12.603830 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 785/1547] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:12.604357 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-4a3ff12b-3b43-4397-b0f2-962b065f14ca None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:12.605184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebc15f-9f20-4284-8499-ab0e2d4932ab None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.605472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebc15f-9f20-4284-8499-ab0e2d4932ab None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.605750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebc15f-9f20-4284-8499-ab0e2d4932ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.605951 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4a3ff12b-3b43-4397-b0f2-962b065f14ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:12.626600 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 763/1548] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:12.636705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57177b-ec83-4faa-9803-4d97ab680f56 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.636705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57177b-ec83-4faa-9803-4d97ab680f56 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.637018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57177b-ec83-4faa-9803-4d97ab680f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.651214 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-b8ebc15f-9f20-4284-8499-ab0e2d4932ab None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:12.652714 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b8ebc15f-9f20-4284-8499-ab0e2d4932ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:12.661252 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 786/1549] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:12.662863 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd3291-c84c-4645-b68c-7081e6281ade None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.663432 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd3291-c84c-4645-b68c-7081e6281ade None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.663974 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd3291-c84c-4645-b68c-7081e6281ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.670086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-3f57177b-ec83-4faa-9803-4d97ab680f56 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:12.671316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3f57177b-ec83-4faa-9803-4d97ab680f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:12.680025 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 764/1550] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:12.680600 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57177b-ec83-4faa-9803-4d97ab680f56 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:12.686579 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-4cbd3291-c84c-4645-b68c-7081e6281ade None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:12.688061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4cbd3291-c84c-4645-b68c-7081e6281ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:12.693466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57177b-ec83-4faa-9803-4d97ab680f56 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:12.697608 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 787/1551] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:12.698874 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0ac80-08ac-4e2e-8409-7aa0299e3473 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.699233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0ac80-08ac-4e2e-8409-7aa0299e3473 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.699578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0ac80-08ac-4e2e-8409-7aa0299e3473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.706410 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de372772-a243-4ae0-af87-3ef1bf17c1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:12.707150 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de372772-a243-4ae0-af87-3ef1bf17c1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.707432 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de372772-a243-4ae0-af87-3ef1bf17c1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.707704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de372772-a243-4ae0-af87-3ef1bf17c1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.708355 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de372772-a243-4ae0-af87-3ef1bf17c1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:12.710070 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de372772-a243-4ae0-af87-3ef1bf17c1d7 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:12.721059 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-abc0ac80-08ac-4e2e-8409-7aa0299e3473 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:12.721287 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 765/1552] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:12.722445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-abc0ac80-08ac-4e2e-8409-7aa0299e3473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:12.722629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cb902-c945-4b74-abc2-839ff5a0a2fb None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.722907 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cb902-c945-4b74-abc2-839ff5a0a2fb None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.723188 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cb902-c945-4b74-abc2-839ff5a0a2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.738871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 788/1553] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:12.746574 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2e6cb902-c945-4b74-abc2-839ff5a0a2fb None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:12.747814 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350b024-8cd2-4f64-b19c-d62cea66c430 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.748104 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350b024-8cd2-4f64-b19c-d62cea66c430 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.748386 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350b024-8cd2-4f64-b19c-d62cea66c430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.748604 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2e6cb902-c945-4b74-abc2-839ff5a0a2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:12.759416 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 766/1554] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:12.768106 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c6483-736f-419d-b8ac-5b5061bbe1c6 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.768475 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c6483-736f-419d-b8ac-5b5061bbe1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.768791 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c6483-736f-419d-b8ac-5b5061bbe1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.771907 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-0350b024-8cd2-4f64-b19c-d62cea66c430 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:12.773763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0350b024-8cd2-4f64-b19c-d62cea66c430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:12.782868 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 789/1555] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:12.783635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350b024-8cd2-4f64-b19c-d62cea66c430 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:12.793306 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-eb5c6483-736f-419d-b8ac-5b5061bbe1c6 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:12.793486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350b024-8cd2-4f64-b19c-d62cea66c430 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:12.794597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-eb5c6483-736f-419d-b8ac-5b5061bbe1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:12.798058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f33bd-3f32-4c25-8e92-76407ce9d88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:12.798653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f33bd-3f32-4c25-8e92-76407ce9d88f admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.798962 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f33bd-3f32-4c25-8e92-76407ce9d88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.799232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f33bd-3f32-4c25-8e92-76407ce9d88f admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.799870 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f33bd-3f32-4c25-8e92-76407ce9d88f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:36:12.800169 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f33bd-3f32-4c25-8e92-76407ce9d88f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:12.801158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: WARNING py.warnings [None req-e87f33bd-3f32-4c25-8e92-76407ce9d88f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 01:36:12.801158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: warnings.warn(msg) Sep 26 01:36:12.801158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: Sep 26 01:36:12.802032 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f33bd-3f32-4c25-8e92-76407ce9d88f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:12.803176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 767/1556] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:12.807831 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c6483-736f-419d-b8ac-5b5061bbe1c6 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:12.818964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c6483-736f-419d-b8ac-5b5061bbe1c6 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:12.822253 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 790/1557] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:36:12.823608 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b532ab-e79b-4fb2-b28f-0dca7ff6fd2b None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.823932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b532ab-e79b-4fb2-b28f-0dca7ff6fd2b None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.824166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b532ab-e79b-4fb2-b28f-0dca7ff6fd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.825135 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8760e-0543-4ac3-bb1d-586167412f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:12.825728 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8760e-0543-4ac3-bb1d-586167412f0e admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.826004 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8760e-0543-4ac3-bb1d-586167412f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.826274 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8760e-0543-4ac3-bb1d-586167412f0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.827038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8760e-0543-4ac3-bb1d-586167412f0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:36:12.827290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8760e-0543-4ac3-bb1d-586167412f0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:12.828829 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8760e-0543-4ac3-bb1d-586167412f0e admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:12.841128 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 768/1558] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:36:12.849122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8760e-0543-4ac3-bb1d-586167412f0e admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:12.858004 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-51b532ab-e79b-4fb2-b28f-0dca7ff6fd2b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:12.859901 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-51b532ab-e79b-4fb2-b28f-0dca7ff6fd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:12.861572 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8760e-0543-4ac3-bb1d-586167412f0e admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:12.869594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 791/1559] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:12.870895 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c729eab-78b9-4999-95ec-c8a452d867b7 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.871233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c729eab-78b9-4999-95ec-c8a452d867b7 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.871523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c729eab-78b9-4999-95ec-c8a452d867b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.877125 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367de2d-6e1c-415c-9208-7e78c4575587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:12.878202 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367de2d-6e1c-415c-9208-7e78c4575587 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.878653 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367de2d-6e1c-415c-9208-7e78c4575587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.879117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367de2d-6e1c-415c-9208-7e78c4575587 admin admin] PATH_INFO: `/v3/projects/0134e2ffc3f245699629579eee860242/users/5b5c8f664d1c4b4599c1d459782e02d3/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.895714 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-3c729eab-78b9-4999-95ec-c8a452d867b7 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:12.897220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-3c729eab-78b9-4999-95ec-c8a452d867b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:12.904708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367de2d-6e1c-415c-9208-7e78c4575587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0134e2ffc3f245699629579eee860242, user_id=5b5c8f664d1c4b4599c1d459782e02d3, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:12.905726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: WARNING py.warnings [None req-d367de2d-6e1c-415c-9208-7e78c4575587 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 01:36:12.905726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: warnings.warn(msg) Sep 26 01:36:12.905726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: Sep 26 01:36:12.907891 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 792/1560] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:12.909487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3338d86-0db2-4be1-b12a-b2efcab6e75c None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:12.909487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3338d86-0db2-4be1-b12a-b2efcab6e75c None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:12.909732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3338d86-0db2-4be1-b12a-b2efcab6e75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:12.915064 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367de2d-6e1c-415c-9208-7e78c4575587 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:12.931454 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 769/1561] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:12 2022] PUT /identity/v3/projects/0134e2ffc3f245699629579eee860242/users/5b5c8f664d1c4b4599c1d459782e02d3/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:12.935394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367de2d-6e1c-415c-9208-7e78c4575587 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:12.939658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-e3338d86-0db2-4be1-b12a-b2efcab6e75c None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:12.941867 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e3338d86-0db2-4be1-b12a-b2efcab6e75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:12.998234 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:13.004737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:13.014317 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 793/1562] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:13.018770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544482f3-e039-47cb-b194-e90d2aa48024 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.018770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544482f3-e039-47cb-b194-e90d2aa48024 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.018770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544482f3-e039-47cb-b194-e90d2aa48024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.021751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367de2d-6e1c-415c-9208-7e78c4575587 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.027856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471046a-6e08-4bce-ab64-b7aa75c3ccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.028492 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471046a-6e08-4bce-ab64-b7aa75c3ccf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.028901 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471046a-6e08-4bce-ab64-b7aa75c3ccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.029174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471046a-6e08-4bce-ab64-b7aa75c3ccf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.029817 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471046a-6e08-4bce-ab64-b7aa75c3ccf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:36:13.030117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471046a-6e08-4bce-ab64-b7aa75c3ccf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.031749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471046a-6e08-4bce-ab64-b7aa75c3ccf9 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.037948 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-544482f3-e039-47cb-b194-e90d2aa48024 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:13.040425 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-544482f3-e039-47cb-b194-e90d2aa48024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:13.045597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 770/1563] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:36:13.046565 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471046a-6e08-4bce-ab64-b7aa75c3ccf9 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.049975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 794/1564] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:13.054917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544482f3-e039-47cb-b194-e90d2aa48024 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.060181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471046a-6e08-4bce-ab64-b7aa75c3ccf9 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.064925 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b395f8-c847-4611-836a-e059a4a74cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.065425 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544482f3-e039-47cb-b194-e90d2aa48024 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.065913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b395f8-c847-4611-836a-e059a4a74cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.065913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b395f8-c847-4611-836a-e059a4a74cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.066113 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b395f8-c847-4611-836a-e059a4a74cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.066643 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b395f8-c847-4611-836a-e059a4a74cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.067679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: WARNING py.warnings [None req-49b395f8-c847-4611-836a-e059a4a74cc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 01:36:13.067679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: warnings.warn(msg) Sep 26 01:36:13.067679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: Sep 26 01:36:13.068921 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b395f8-c847-4611-836a-e059a4a74cc6 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.070877 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4a982-2e3f-4ba8-9181-d15deda48c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.071783 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4a982-2e3f-4ba8-9181-d15deda48c00 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.072482 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4a982-2e3f-4ba8-9181-d15deda48c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.072770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4a982-2e3f-4ba8-9181-d15deda48c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.073410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4a982-2e3f-4ba8-9181-d15deda48c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.075325 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4a982-2e3f-4ba8-9181-d15deda48c00 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.100811 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 771/1565] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:13 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:13.104724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b395f8-c847-4611-836a-e059a4a74cc6 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.112075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 795/1566] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:13 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:13.112075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4a982-2e3f-4ba8-9181-d15deda48c00 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.181051 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b395f8-c847-4611-836a-e059a4a74cc6 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.184071 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4a982-2e3f-4ba8-9181-d15deda48c00 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.185778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac095b80-8650-462f-93f3-0f6c7fe12bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.186384 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac095b80-8650-462f-93f3-0f6c7fe12bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.186660 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac095b80-8650-462f-93f3-0f6c7fe12bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.187032 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac095b80-8650-462f-93f3-0f6c7fe12bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.187681 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac095b80-8650-462f-93f3-0f6c7fe12bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:36:13.187982 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac095b80-8650-462f-93f3-0f6c7fe12bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.189415 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d78d2-4a15-4fd3-84d5-a54b536b6005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.189550 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac095b80-8650-462f-93f3-0f6c7fe12bdd admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.190005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d78d2-4a15-4fd3-84d5-a54b536b6005 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.190290 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d78d2-4a15-4fd3-84d5-a54b536b6005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.190556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d78d2-4a15-4fd3-84d5-a54b536b6005 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.191287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d78d2-4a15-4fd3-84d5-a54b536b6005 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:36:13.191725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d78d2-4a15-4fd3-84d5-a54b536b6005 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.193326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d78d2-4a15-4fd3-84d5-a54b536b6005 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.202245 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 772/1567] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:36:13.203628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bde03-3469-4da0-a227-6469d647f4c1 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.203909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bde03-3469-4da0-a227-6469d647f4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.204178 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bde03-3469-4da0-a227-6469d647f4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.208933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 796/1568] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:36:13.216156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d78d2-4a15-4fd3-84d5-a54b536b6005 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.225863 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-699bde03-3469-4da0-a227-6469d647f4c1 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:13.227683 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d78d2-4a15-4fd3-84d5-a54b536b6005 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.227842 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-699bde03-3469-4da0-a227-6469d647f4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:13.232321 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec60396-17f0-4c7f-9288-870c2ad9ffb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.232923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec60396-17f0-4c7f-9288-870c2ad9ffb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.233206 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec60396-17f0-4c7f-9288-870c2ad9ffb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.233477 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec60396-17f0-4c7f-9288-870c2ad9ffb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.234123 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec60396-17f0-4c7f-9288-870c2ad9ffb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:36:13.234425 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec60396-17f0-4c7f-9288-870c2ad9ffb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.235501 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 773/1569] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:13.236044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec60396-17f0-4c7f-9288-870c2ad9ffb6 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.236264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bde03-3469-4da0-a227-6469d647f4c1 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.247202 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bde03-3469-4da0-a227-6469d647f4c1 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.251891 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 797/1570] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:36:13.252154 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09117b7f-1935-44f1-a3ca-50dd1920a687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.252732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec60396-17f0-4c7f-9288-870c2ad9ffb6 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.252845 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09117b7f-1935-44f1-a3ca-50dd1920a687 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.253042 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09117b7f-1935-44f1-a3ca-50dd1920a687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.253284 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09117b7f-1935-44f1-a3ca-50dd1920a687 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.253923 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09117b7f-1935-44f1-a3ca-50dd1920a687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.255846 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09117b7f-1935-44f1-a3ca-50dd1920a687 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.266754 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec60396-17f0-4c7f-9288-870c2ad9ffb6 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.272104 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2400a4f-2de8-4234-a3c7-d0eca34fa685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.272709 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2400a4f-2de8-4234-a3c7-d0eca34fa685 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.273058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2400a4f-2de8-4234-a3c7-d0eca34fa685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.273284 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2400a4f-2de8-4234-a3c7-d0eca34fa685 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.273979 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2400a4f-2de8-4234-a3c7-d0eca34fa685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:36:13.274331 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2400a4f-2de8-4234-a3c7-d0eca34fa685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.275969 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2400a4f-2de8-4234-a3c7-d0eca34fa685 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.283932 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 774/1571] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:13 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:13.284737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09117b7f-1935-44f1-a3ca-50dd1920a687 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.288355 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 798/1572] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:36:13.289976 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2400a4f-2de8-4234-a3c7-d0eca34fa685 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.306489 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2400a4f-2de8-4234-a3c7-d0eca34fa685 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.355706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09117b7f-1935-44f1-a3ca-50dd1920a687 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.360932 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e1a2d-4519-47af-a053-e3a8b700eda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.361533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e1a2d-4519-47af-a053-e3a8b700eda8 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.361807 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e1a2d-4519-47af-a053-e3a8b700eda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.362074 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e1a2d-4519-47af-a053-e3a8b700eda8 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.362697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e1a2d-4519-47af-a053-e3a8b700eda8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.364666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e1a2d-4519-47af-a053-e3a8b700eda8 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.370406 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e95c7e-ca0d-4ba6-b81a-42057df9b529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.371070 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e95c7e-ca0d-4ba6-b81a-42057df9b529 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.371343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e95c7e-ca0d-4ba6-b81a-42057df9b529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.371611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e95c7e-ca0d-4ba6-b81a-42057df9b529 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.372237 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e95c7e-ca0d-4ba6-b81a-42057df9b529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.373289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: WARNING py.warnings [None req-80e95c7e-ca0d-4ba6-b81a-42057df9b529 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 01:36:13.373289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: warnings.warn(msg) Sep 26 01:36:13.373289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: Sep 26 01:36:13.374495 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e95c7e-ca0d-4ba6-b81a-42057df9b529 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.390360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 775/1573] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:13 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:13.395568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e1a2d-4519-47af-a053-e3a8b700eda8 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.406205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 799/1574] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:13 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:13.406205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e95c7e-ca0d-4ba6-b81a-42057df9b529 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.407489 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e1a2d-4519-47af-a053-e3a8b700eda8 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.413267 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296362b3-1a70-44fc-a89f-4e5a173a249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.414439 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296362b3-1a70-44fc-a89f-4e5a173a249e admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.414721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296362b3-1a70-44fc-a89f-4e5a173a249e admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.415109 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296362b3-1a70-44fc-a89f-4e5a173a249e admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.415753 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296362b3-1a70-44fc-a89f-4e5a173a249e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.417676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296362b3-1a70-44fc-a89f-4e5a173a249e admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.420977 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e95c7e-ca0d-4ba6-b81a-42057df9b529 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.425940 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f32c5-fa43-47a8-bbf1-96562806c8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.426548 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f32c5-fa43-47a8-bbf1-96562806c8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.426869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f32c5-fa43-47a8-bbf1-96562806c8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.427188 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f32c5-fa43-47a8-bbf1-96562806c8d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.427826 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f32c5-fa43-47a8-bbf1-96562806c8d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.430378 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f32c5-fa43-47a8-bbf1-96562806c8d3 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.436804 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:13.452712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 776/1575] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:13 2022] POST /identity/v3/projects => generated 405 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:13.453779 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296362b3-1a70-44fc-a89f-4e5a173a249e admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.461427 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 800/1576] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:13 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:13.464929 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f32c5-fa43-47a8-bbf1-96562806c8d3 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.471378 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:13.518516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296362b3-1a70-44fc-a89f-4e5a173a249e admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.535751 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f32c5-fa43-47a8-bbf1-96562806c8d3 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.541820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fddaf73-89c9-4efe-b784-394811acd9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.542459 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddaf73-89c9-4efe-b784-394811acd9bb admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.542734 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddaf73-89c9-4efe-b784-394811acd9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.543045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddaf73-89c9-4efe-b784-394811acd9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.543679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fddaf73-89c9-4efe-b784-394811acd9bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.545694 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fddaf73-89c9-4efe-b784-394811acd9bb admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.574996 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 801/1577] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:13 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:13.575728 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fddaf73-89c9-4efe-b784-394811acd9bb admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.584875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8d636-d438-4885-835d-cd57cc94fa90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.585978 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8d636-d438-4885-835d-cd57cc94fa90 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.586277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8d636-d438-4885-835d-cd57cc94fa90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.586519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8d636-d438-4885-835d-cd57cc94fa90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.596847 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8d636-d438-4885-835d-cd57cc94fa90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.598280 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8d636-d438-4885-835d-cd57cc94fa90 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.609070 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 777/1578] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:13.609684 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8d636-d438-4885-835d-cd57cc94fa90 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.621842 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8d636-d438-4885-835d-cd57cc94fa90 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.653418 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fddaf73-89c9-4efe-b784-394811acd9bb admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.661366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9abdb0-3657-49a3-8c20-fa8f728c03f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.661983 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9abdb0-3657-49a3-8c20-fa8f728c03f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.662265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9abdb0-3657-49a3-8c20-fa8f728c03f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.662642 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9abdb0-3657-49a3-8c20-fa8f728c03f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.663382 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9abdb0-3657-49a3-8c20-fa8f728c03f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.666245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9abdb0-3657-49a3-8c20-fa8f728c03f9 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.689281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 802/1579] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:13 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:13.690468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9abdb0-3657-49a3-8c20-fa8f728c03f9 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.700714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f9732-c755-4637-ad14-9f6c6be4c011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.701462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f9732-c755-4637-ad14-9f6c6be4c011 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.701821 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f9732-c755-4637-ad14-9f6c6be4c011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.702160 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f9732-c755-4637-ad14-9f6c6be4c011 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.702484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9abdb0-3657-49a3-8c20-fa8f728c03f9 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.703310 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f9732-c755-4637-ad14-9f6c6be4c011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.704991 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f9732-c755-4637-ad14-9f6c6be4c011 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.709384 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7269fb-475d-4af4-a5a5-3dc86af718a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.710029 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7269fb-475d-4af4-a5a5-3dc86af718a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.710307 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7269fb-475d-4af4-a5a5-3dc86af718a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.711194 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7269fb-475d-4af4-a5a5-3dc86af718a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.711797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7269fb-475d-4af4-a5a5-3dc86af718a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.713378 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7269fb-475d-4af4-a5a5-3dc86af718a2 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.729305 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 803/1580] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:13.730170 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7269fb-475d-4af4-a5a5-3dc86af718a2 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.737342 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 778/1581] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:13 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:13.741956 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f9732-c755-4637-ad14-9f6c6be4c011 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.750564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7269fb-475d-4af4-a5a5-3dc86af718a2 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.786759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:13.810464 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f9732-c755-4637-ad14-9f6c6be4c011 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.815905 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b0255-2a4f-459e-963a-d1e859b82ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.816464 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b0255-2a4f-459e-963a-d1e859b82ddb admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.816837 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b0255-2a4f-459e-963a-d1e859b82ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.817110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b0255-2a4f-459e-963a-d1e859b82ddb admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.817851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b0255-2a4f-459e-963a-d1e859b82ddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.820361 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b0255-2a4f-459e-963a-d1e859b82ddb admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.839895 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be930f-99a9-4155-85cb-312ac38a11ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.840580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be930f-99a9-4155-85cb-312ac38a11ea admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.840875 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be930f-99a9-4155-85cb-312ac38a11ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.841154 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be930f-99a9-4155-85cb-312ac38a11ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.841897 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be930f-99a9-4155-85cb-312ac38a11ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.843699 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be930f-99a9-4155-85cb-312ac38a11ea admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.844276 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 779/1582] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:13 2022] POST /identity/v3/users => generated 303 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:13.845162 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b0255-2a4f-459e-963a-d1e859b82ddb admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.858199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b0255-2a4f-459e-963a-d1e859b82ddb admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.863846 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d60ce8-95d8-4878-a03a-bfac8f02a946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.864677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d60ce8-95d8-4878-a03a-bfac8f02a946 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.864807 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 804/1583] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:13.864952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d60ce8-95d8-4878-a03a-bfac8f02a946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.865323 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d60ce8-95d8-4878-a03a-bfac8f02a946 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.865485 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be930f-99a9-4155-85cb-312ac38a11ea admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.866219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d60ce8-95d8-4878-a03a-bfac8f02a946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.868768 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d60ce8-95d8-4878-a03a-bfac8f02a946 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.877466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be930f-99a9-4155-85cb-312ac38a11ea admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.886879 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219bf12-279e-4416-960f-abf2cb5a7531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.887497 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219bf12-279e-4416-960f-abf2cb5a7531 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.887772 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219bf12-279e-4416-960f-abf2cb5a7531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.888051 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219bf12-279e-4416-960f-abf2cb5a7531 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.888830 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219bf12-279e-4416-960f-abf2cb5a7531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.891124 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219bf12-279e-4416-960f-abf2cb5a7531 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.894868 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 780/1584] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:13 2022] POST /identity/v3/users => generated 283 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:13.894868 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d60ce8-95d8-4878-a03a-bfac8f02a946 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.902215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:13.906573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d60ce8-95d8-4878-a03a-bfac8f02a946 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.912112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a0a1d-5d33-49d7-90d8-3af86db6a0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.912714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a0a1d-5d33-49d7-90d8-3af86db6a0af admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.913023 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a0a1d-5d33-49d7-90d8-3af86db6a0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.913341 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a0a1d-5d33-49d7-90d8-3af86db6a0af admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.914072 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a0a1d-5d33-49d7-90d8-3af86db6a0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.915807 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a0a1d-5d33-49d7-90d8-3af86db6a0af admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.923377 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 805/1585] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:13 2022] POST /identity/v3/users => generated 284 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:13.924388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219bf12-279e-4416-960f-abf2cb5a7531 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.929567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 781/1586] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:13.930439 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a0a1d-5d33-49d7-90d8-3af86db6a0af admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.935584 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219bf12-279e-4416-960f-abf2cb5a7531 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.940576 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c262164-5137-410f-8fa5-8b46602a0b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.941021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a0a1d-5d33-49d7-90d8-3af86db6a0af admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.941179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c262164-5137-410f-8fa5-8b46602a0b6b admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.941462 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c262164-5137-410f-8fa5-8b46602a0b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.941734 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c262164-5137-410f-8fa5-8b46602a0b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.942379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c262164-5137-410f-8fa5-8b46602a0b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.944015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c262164-5137-410f-8fa5-8b46602a0b6b admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.947420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79873517-d6df-47a4-a3cf-aeb9bd5db303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.947774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79873517-d6df-47a4-a3cf-aeb9bd5db303 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.948047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79873517-d6df-47a4-a3cf-aeb9bd5db303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.948317 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79873517-d6df-47a4-a3cf-aeb9bd5db303 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.949078 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79873517-d6df-47a4-a3cf-aeb9bd5db303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.951190 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79873517-d6df-47a4-a3cf-aeb9bd5db303 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.957001 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 806/1587] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:13.961983 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c262164-5137-410f-8fa5-8b46602a0b6b admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.973468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c262164-5137-410f-8fa5-8b46602a0b6b admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.975761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 782/1588] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:13 2022] POST /identity/v3/users => generated 285 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:13.976618 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79873517-d6df-47a4-a3cf-aeb9bd5db303 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.978688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722faa0-0ee8-46c0-8b0d-28c812612b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.979451 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722faa0-0ee8-46c0-8b0d-28c812612b0c admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.979835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722faa0-0ee8-46c0-8b0d-28c812612b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.980214 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722faa0-0ee8-46c0-8b0d-28c812612b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.980966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722faa0-0ee8-46c0-8b0d-28c812612b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:13.982679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722faa0-0ee8-46c0-8b0d-28c812612b0c admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:13.988002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79873517-d6df-47a4-a3cf-aeb9bd5db303 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:13.994135 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 807/1589] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:13.995008 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722faa0-0ee8-46c0-8b0d-28c812612b0c admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:13.997209 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835fc5e-8895-4d65-a519-c7299d6e7fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:13.997641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835fc5e-8895-4d65-a519-c7299d6e7fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:13.997948 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835fc5e-8895-4d65-a519-c7299d6e7fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:13.998195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835fc5e-8895-4d65-a519-c7299d6e7fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:13.998909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835fc5e-8895-4d65-a519-c7299d6e7fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:14.000538 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835fc5e-8895-4d65-a519-c7299d6e7fc3 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:14.006329 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722faa0-0ee8-46c0-8b0d-28c812612b0c admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:14.011770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21ae31-6625-4682-b766-33bcaff99b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:14.012372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21ae31-6625-4682-b766-33bcaff99b44 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.012796 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21ae31-6625-4682-b766-33bcaff99b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.013100 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21ae31-6625-4682-b766-33bcaff99b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.013821 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 783/1590] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:14.014469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835fc5e-8895-4d65-a519-c7299d6e7fc3 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:14.016874 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21ae31-6625-4682-b766-33bcaff99b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:14.018452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21ae31-6625-4682-b766-33bcaff99b44 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:14.025315 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835fc5e-8895-4d65-a519-c7299d6e7fc3 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:14.030238 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea50811-b12a-4f6e-94c2-2204fca88ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:14.033753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 808/1591] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:14.033911 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea50811-b12a-4f6e-94c2-2204fca88ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.033911 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea50811-b12a-4f6e-94c2-2204fca88ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.033911 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea50811-b12a-4f6e-94c2-2204fca88ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.034184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21ae31-6625-4682-b766-33bcaff99b44 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:14.034281 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea50811-b12a-4f6e-94c2-2204fca88ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:14.034281 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea50811-b12a-4f6e-94c2-2204fca88ce4 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:14.045844 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21ae31-6625-4682-b766-33bcaff99b44 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:14.048684 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 784/1592] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:14.049503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea50811-b12a-4f6e-94c2-2204fca88ce4 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:14.051676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4a581-f2f3-4620-b38d-318addc9cef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:14.052459 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4a581-f2f3-4620-b38d-318addc9cef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.052928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4a581-f2f3-4620-b38d-318addc9cef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.053568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4a581-f2f3-4620-b38d-318addc9cef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.054534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4a581-f2f3-4620-b38d-318addc9cef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:14.057992 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4a581-f2f3-4620-b38d-318addc9cef3 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:14.060722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea50811-b12a-4f6e-94c2-2204fca88ce4 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:14.066655 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a6055-ded0-42a9-9d59-609036b5339c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:14.067355 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a6055-ded0-42a9-9d59-609036b5339c admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.067695 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a6055-ded0-42a9-9d59-609036b5339c admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.067972 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a6055-ded0-42a9-9d59-609036b5339c admin admin] PATH_INFO: `/v3/projects/8f8511807c494cb0afb140c3e2aae135/users/832cdaff3e394070b4708964ab0cb6e6/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.076772 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 809/1593] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:14.077814 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4a581-f2f3-4620-b38d-318addc9cef3 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:14.088157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a6055-ded0-42a9-9d59-609036b5339c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8511807c494cb0afb140c3e2aae135, user_id=832cdaff3e394070b4708964ab0cb6e6, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:14.090734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a6055-ded0-42a9-9d59-609036b5339c admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:14.091193 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4a581-f2f3-4620-b38d-318addc9cef3 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:14.096590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451bdf3-8f06-4829-82e0-7fb1802a662a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:14.097325 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451bdf3-8f06-4829-82e0-7fb1802a662a admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.097709 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451bdf3-8f06-4829-82e0-7fb1802a662a admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.098084 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451bdf3-8f06-4829-82e0-7fb1802a662a admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.098863 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451bdf3-8f06-4829-82e0-7fb1802a662a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:14.100625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451bdf3-8f06-4829-82e0-7fb1802a662a admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:14.110809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 785/1594] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:14 2022] PUT /identity/v3/projects/8f8511807c494cb0afb140c3e2aae135/users/832cdaff3e394070b4708964ab0cb6e6/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:14.123307 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a6055-ded0-42a9-9d59-609036b5339c admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:14.133265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 810/1595] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:14.135100 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451bdf3-8f06-4829-82e0-7fb1802a662a admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:14.153100 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451bdf3-8f06-4829-82e0-7fb1802a662a admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:14.235463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a6055-ded0-42a9-9d59-609036b5339c admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:14.242634 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de188e-3594-4136-89ad-e132ec760ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:14.243313 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de188e-3594-4136-89ad-e132ec760ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.243670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de188e-3594-4136-89ad-e132ec760ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.243957 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de188e-3594-4136-89ad-e132ec760ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.244602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de188e-3594-4136-89ad-e132ec760ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:14.246195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de188e-3594-4136-89ad-e132ec760ff6 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:14.246791 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21886d2-493c-4a9e-9c65-ce5adebce1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:14.248208 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21886d2-493c-4a9e-9c65-ce5adebce1cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.249027 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21886d2-493c-4a9e-9c65-ce5adebce1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.249403 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21886d2-493c-4a9e-9c65-ce5adebce1cf admin admin] PATH_INFO: `/v3/projects/23355a519b7648bc98a112b2a2f2cec4/users/33b264f4cc3c4eac8944e7e2f34370f5/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.259795 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 786/1596] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:14.260657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de188e-3594-4136-89ad-e132ec760ff6 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:14.271109 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21886d2-493c-4a9e-9c65-ce5adebce1cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=23355a519b7648bc98a112b2a2f2cec4, user_id=33b264f4cc3c4eac8944e7e2f34370f5, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:14.272965 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de188e-3594-4136-89ad-e132ec760ff6 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:14.274585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21886d2-493c-4a9e-9c65-ce5adebce1cf admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:14.278175 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37f0ee-194d-4cbe-b7fd-ad2c4ed68a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:14.278894 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37f0ee-194d-4cbe-b7fd-ad2c4ed68a05 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.279252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37f0ee-194d-4cbe-b7fd-ad2c4ed68a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.279598 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37f0ee-194d-4cbe-b7fd-ad2c4ed68a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.280451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37f0ee-194d-4cbe-b7fd-ad2c4ed68a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:14.282199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37f0ee-194d-4cbe-b7fd-ad2c4ed68a05 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:14.291332 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 811/1597] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:14 2022] PUT /identity/v3/projects/23355a519b7648bc98a112b2a2f2cec4/users/33b264f4cc3c4eac8944e7e2f34370f5/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:14.292911 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21886d2-493c-4a9e-9c65-ce5adebce1cf admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:14.296510 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 787/1598] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:14.296510 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37f0ee-194d-4cbe-b7fd-ad2c4ed68a05 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:14.305604 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37f0ee-194d-4cbe-b7fd-ad2c4ed68a05 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:14.326360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:14.369447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21886d2-493c-4a9e-9c65-ce5adebce1cf admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:14.373586 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240b53b-5251-4b44-b4de-eec79724b047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:14.374308 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240b53b-5251-4b44-b4de-eec79724b047 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.374591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240b53b-5251-4b44-b4de-eec79724b047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.374698 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02d2e2-2dfa-4e8a-9fc9-cfdf465823bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:14.374883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240b53b-5251-4b44-b4de-eec79724b047 admin admin] PATH_INFO: `/v3/projects/8e8b37c0a2c74cfe8a371ef123de87aa/users/c52e611cab734987bea6b2c5cc48a21f/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.375574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02d2e2-2dfa-4e8a-9fc9-cfdf465823bf admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.375955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02d2e2-2dfa-4e8a-9fc9-cfdf465823bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.376296 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02d2e2-2dfa-4e8a-9fc9-cfdf465823bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.377037 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02d2e2-2dfa-4e8a-9fc9-cfdf465823bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:14.378705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02d2e2-2dfa-4e8a-9fc9-cfdf465823bf admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:14.390299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 812/1599] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:14.391536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f289af-ecc9-4556-86ed-72e0ae9c4da2 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.391897 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f289af-ecc9-4556-86ed-72e0ae9c4da2 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.392244 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f289af-ecc9-4556-86ed-72e0ae9c4da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.394936 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240b53b-5251-4b44-b4de-eec79724b047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8b37c0a2c74cfe8a371ef123de87aa, user_id=c52e611cab734987bea6b2c5cc48a21f, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:14.400169 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240b53b-5251-4b44-b4de-eec79724b047 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:14.422462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 788/1600] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:14 2022] PUT /identity/v3/projects/8e8b37c0a2c74cfe8a371ef123de87aa/users/c52e611cab734987bea6b2c5cc48a21f/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:14.426663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:14.427782 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240b53b-5251-4b44-b4de-eec79724b047 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:14.431677 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-27f289af-ecc9-4556-86ed-72e0ae9c4da2 None None] MFA Rules not processed for user `832cdaff3e394070b4708964ab0cb6e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:14.432911 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-27f289af-ecc9-4556-86ed-72e0ae9c4da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:14.501576 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240b53b-5251-4b44-b4de-eec79724b047 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:14.508538 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e113ce6-ee64-4d56-81c0-b47005aa513b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:14.509784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e113ce6-ee64-4d56-81c0-b47005aa513b admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.509912 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e113ce6-ee64-4d56-81c0-b47005aa513b admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.510678 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e113ce6-ee64-4d56-81c0-b47005aa513b admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.510892 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e113ce6-ee64-4d56-81c0-b47005aa513b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:14.512827 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e113ce6-ee64-4d56-81c0-b47005aa513b admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:14.524984 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 813/1601] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:14.529412 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f289af-ecc9-4556-86ed-72e0ae9c4da2 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:14.529572 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 789/1602] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:14.529572 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e113ce6-ee64-4d56-81c0-b47005aa513b admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:14.539718 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f289af-ecc9-4556-86ed-72e0ae9c4da2 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:14.541722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e113ce6-ee64-4d56-81c0-b47005aa513b admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:14.549692 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c79ab1-9064-42ed-a147-ddb611d1297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:14.550697 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c79ab1-9064-42ed-a147-ddb611d1297f admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.551183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c79ab1-9064-42ed-a147-ddb611d1297f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.551640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c79ab1-9064-42ed-a147-ddb611d1297f admin admin] PATH_INFO: `/v3/projects/3aa20559fb4447cd8ba057b17d16f25f/users/c294add551b14edc858e588fa2da2c45/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.552439 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd7852-02fb-4360-9ff3-663a15a33278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:14.554345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd7852-02fb-4360-9ff3-663a15a33278 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.554953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd7852-02fb-4360-9ff3-663a15a33278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.555597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd7852-02fb-4360-9ff3-663a15a33278 admin admin] PATH_INFO: `/v3/projects/5a6923932ddd4f7a8ca19a7a16f3c343/users/ba8baba2b31a412fb266cdb406e9814b/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.572384 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c79ab1-9064-42ed-a147-ddb611d1297f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa20559fb4447cd8ba057b17d16f25f, user_id=c294add551b14edc858e588fa2da2c45, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:14.575421 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c79ab1-9064-42ed-a147-ddb611d1297f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:14.582453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd7852-02fb-4360-9ff3-663a15a33278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6923932ddd4f7a8ca19a7a16f3c343, user_id=ba8baba2b31a412fb266cdb406e9814b, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:14.587287 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd7852-02fb-4360-9ff3-663a15a33278 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:14.594916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 814/1603] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:14 2022] PUT /identity/v3/projects/3aa20559fb4447cd8ba057b17d16f25f/users/c294add551b14edc858e588fa2da2c45/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:14.609374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04468b-05e8-4b37-ba50-715eb1d0489f None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.609737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04468b-05e8-4b37-ba50-715eb1d0489f None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.610127 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04468b-05e8-4b37-ba50-715eb1d0489f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.612176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 790/1604] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:14 2022] PUT /identity/v3/projects/5a6923932ddd4f7a8ca19a7a16f3c343/users/ba8baba2b31a412fb266cdb406e9814b/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:14.613096 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd7852-02fb-4360-9ff3-663a15a33278 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:14.642669 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-fe04468b-05e8-4b37-ba50-715eb1d0489f None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:14.643988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-fe04468b-05e8-4b37-ba50-715eb1d0489f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:14.710920 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd7852-02fb-4360-9ff3-663a15a33278 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:14.716185 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd38afc-c283-4d65-81f4-16c74d660eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:14.716920 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd38afc-c283-4d65-81f4-16c74d660eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.717039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 815/1605] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:14.717314 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd38afc-c283-4d65-81f4-16c74d660eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.717412 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd38afc-c283-4d65-81f4-16c74d660eb7 admin admin] PATH_INFO: `/v3/projects/8ce4ac32149d4c458bb382c739e69a83/users/a3537b0388ed4a67890ad3d81c9175d6/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.718354 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58c389-5f72-4e93-a39a-4acfd71003ab None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.718645 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58c389-5f72-4e93-a39a-4acfd71003ab None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.718959 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58c389-5f72-4e93-a39a-4acfd71003ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.737172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd38afc-c283-4d65-81f4-16c74d660eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce4ac32149d4c458bb382c739e69a83, user_id=a3537b0388ed4a67890ad3d81c9175d6, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:14.740343 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd38afc-c283-4d65-81f4-16c74d660eb7 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:14.741283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-5b58c389-5f72-4e93-a39a-4acfd71003ab None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:14.743291 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-5b58c389-5f72-4e93-a39a-4acfd71003ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:14.752086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 816/1606] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:14.755710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:14.757716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58c389-5f72-4e93-a39a-4acfd71003ab None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:14.768123 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 791/1607] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:14 2022] PUT /identity/v3/projects/8ce4ac32149d4c458bb382c739e69a83/users/a3537b0388ed4a67890ad3d81c9175d6/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:14.769057 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd38afc-c283-4d65-81f4-16c74d660eb7 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:14.773977 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58c389-5f72-4e93-a39a-4acfd71003ab None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:14.857259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3c753-c556-4971-83a7-4f9326dc7148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:14.857943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3c753-c556-4971-83a7-4f9326dc7148 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.858276 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3c753-c556-4971-83a7-4f9326dc7148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.858562 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3c753-c556-4971-83a7-4f9326dc7148 admin admin] PATH_INFO: `/v3/projects/c9e1b90ede12449aa918c243e1c936bb/users/3e0597e48ada4c21adc16b2578194a50/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.858955 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd38afc-c283-4d65-81f4-16c74d660eb7 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:14.866096 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f6f80-eff9-4e53-8bed-e247b4a743f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:14.869044 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f6f80-eff9-4e53-8bed-e247b4a743f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.869499 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f6f80-eff9-4e53-8bed-e247b4a743f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.869617 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f6f80-eff9-4e53-8bed-e247b4a743f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.883637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3c753-c556-4971-83a7-4f9326dc7148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e1b90ede12449aa918c243e1c936bb, user_id=3e0597e48ada4c21adc16b2578194a50, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:14.886440 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3c753-c556-4971-83a7-4f9326dc7148 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:14.890797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:14.909136 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 817/1608] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:14 2022] PUT /identity/v3/projects/c9e1b90ede12449aa918c243e1c936bb/users/3e0597e48ada4c21adc16b2578194a50/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:14.910435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d9fbf-9921-4a8f-b215-2c779fa0d3dc None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.910862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d9fbf-9921-4a8f-b215-2c779fa0d3dc None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.911287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d9fbf-9921-4a8f-b215-2c779fa0d3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:14.952699 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f6f80-eff9-4e53-8bed-e247b4a743f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:14.954449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f6f80-eff9-4e53-8bed-e247b4a743f3 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:14.954859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-212d9fbf-9921-4a8f-b215-2c779fa0d3dc None None] MFA Rules not processed for user `c294add551b14edc858e588fa2da2c45`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:14.956898 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-212d9fbf-9921-4a8f-b215-2c779fa0d3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:14.965556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 792/1609] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:14.967143 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb08e79-5708-46b9-87e2-a962df773b74 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:14.967484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb08e79-5708-46b9-87e2-a962df773b74 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:14.967768 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb08e79-5708-46b9-87e2-a962df773b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:15.001785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-3bb08e79-5708-46b9-87e2-a962df773b74 None None] MFA Rules not processed for user `ba8baba2b31a412fb266cdb406e9814b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:15.003240 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3bb08e79-5708-46b9-87e2-a962df773b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:15.051163 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 818/1610] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:15.052379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d9fbf-9921-4a8f-b215-2c779fa0d3dc None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:15.109177 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 793/1611] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:15.110908 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb08e79-5708-46b9-87e2-a962df773b74 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:15.170407 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:15.179614 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d9fbf-9921-4a8f-b215-2c779fa0d3dc None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:15.192277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b2ca2-5dd6-43b0-a79e-6e3781207bc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:15.192910 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b2ca2-5dd6-43b0-a79e-6e3781207bc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:15.193191 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b2ca2-5dd6-43b0-a79e-6e3781207bc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:15.193466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b2ca2-5dd6-43b0-a79e-6e3781207bc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:15.199037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb08e79-5708-46b9-87e2-a962df773b74 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:15.207718 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9424a-e8e8-4176-949a-0387afeef44f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:15.209384 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9424a-e8e8-4176-949a-0387afeef44f service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:15.209971 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9424a-e8e8-4176-949a-0387afeef44f service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:15.210258 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9424a-e8e8-4176-949a-0387afeef44f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:15.332582 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b2ca2-5dd6-43b0-a79e-6e3781207bc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:15.335554 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b2ca2-5dd6-43b0-a79e-6e3781207bc8 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:15.336736 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9424a-e8e8-4176-949a-0387afeef44f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:15.338326 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9424a-e8e8-4176-949a-0387afeef44f service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:15.350388 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 794/1612] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:15.352527 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6aaefe-93ac-4fac-9ec6-80c72d6a7eb7 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:15.352803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6aaefe-93ac-4fac-9ec6-80c72d6a7eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:15.353080 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6aaefe-93ac-4fac-9ec6-80c72d6a7eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:15.365456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 819/1613] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:15.366958 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e260bed-2edb-4466-ae68-3ddb1e90bb6b None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:15.367402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e260bed-2edb-4466-ae68-3ddb1e90bb6b None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:15.367799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e260bed-2edb-4466-ae68-3ddb1e90bb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:15.399815 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-cb6aaefe-93ac-4fac-9ec6-80c72d6a7eb7 None None] MFA Rules not processed for user `a3537b0388ed4a67890ad3d81c9175d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:15.406471 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-cb6aaefe-93ac-4fac-9ec6-80c72d6a7eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:15.432718 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-6e260bed-2edb-4466-ae68-3ddb1e90bb6b None None] MFA Rules not processed for user `3e0597e48ada4c21adc16b2578194a50`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:15.434001 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6e260bed-2edb-4466-ae68-3ddb1e90bb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:15.485228 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:15.520287 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 795/1614] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:15.526022 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6aaefe-93ac-4fac-9ec6-80c72d6a7eb7 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:15.545830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6aaefe-93ac-4fac-9ec6-80c72d6a7eb7 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:15.566206 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f54b3-1c96-4323-9a39-56f87322be77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:15.567391 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f54b3-1c96-4323-9a39-56f87322be77 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:15.568291 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f54b3-1c96-4323-9a39-56f87322be77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:15.568938 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f54b3-1c96-4323-9a39-56f87322be77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:15.569836 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f54b3-1c96-4323-9a39-56f87322be77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:15.574276 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f54b3-1c96-4323-9a39-56f87322be77 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:15.578556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 820/1615] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:15.578781 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e260bed-2edb-4466-ae68-3ddb1e90bb6b None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:15.602320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e260bed-2edb-4466-ae68-3ddb1e90bb6b None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:15.614786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67e73e-decb-440a-be50-d7d542163c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:15.618075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67e73e-decb-440a-be50-d7d542163c5c admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:15.619228 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67e73e-decb-440a-be50-d7d542163c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:15.620372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67e73e-decb-440a-be50-d7d542163c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:15.622339 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67e73e-decb-440a-be50-d7d542163c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:15.627845 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67e73e-decb-440a-be50-d7d542163c5c admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:15.635931 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 796/1616] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:15 2022] POST /identity/v3/projects => generated 403 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:15.638470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f54b3-1c96-4323-9a39-56f87322be77 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:15.687592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 821/1617] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:15 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:15.688954 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67e73e-decb-440a-be50-d7d542163c5c admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:15.834661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f54b3-1c96-4323-9a39-56f87322be77 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:15.845755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:15.875726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67e73e-decb-440a-be50-d7d542163c5c admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:15.890287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e779ed5-9caa-4a90-a216-de94ee25d941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:15.893483 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e779ed5-9caa-4a90-a216-de94ee25d941 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:15.894280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e779ed5-9caa-4a90-a216-de94ee25d941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:15.894557 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e779ed5-9caa-4a90-a216-de94ee25d941 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:15.896521 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e779ed5-9caa-4a90-a216-de94ee25d941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:15.903583 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e779ed5-9caa-4a90-a216-de94ee25d941 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:16.027342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 822/1618] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:15 2022] POST /identity/v3/projects => generated 373 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:16.027342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e779ed5-9caa-4a90-a216-de94ee25d941 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:16.031646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bc858-5018-443f-8b95-a6ba8864fe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:16.031646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bc858-5018-443f-8b95-a6ba8864fe2a admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:16.031646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bc858-5018-443f-8b95-a6ba8864fe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:16.031646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bc858-5018-443f-8b95-a6ba8864fe2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:16.032345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032bc858-5018-443f-8b95-a6ba8864fe2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:16.033957 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032bc858-5018-443f-8b95-a6ba8864fe2a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:16.095521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 797/1619] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:15 2022] POST /identity/v3/projects => generated 369 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:16.098293 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bc858-5018-443f-8b95-a6ba8864fe2a admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:16.188112 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e779ed5-9caa-4a90-a216-de94ee25d941 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:16.221227 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bc858-5018-443f-8b95-a6ba8864fe2a admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:16.228186 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb5658-ec73-48e7-b714-7d5127b34f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:16.228985 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb5658-ec73-48e7-b714-7d5127b34f5d admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:16.229363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb5658-ec73-48e7-b714-7d5127b34f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:16.229739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb5658-ec73-48e7-b714-7d5127b34f5d admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:16.230524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb5658-ec73-48e7-b714-7d5127b34f5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:16.232831 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb5658-ec73-48e7-b714-7d5127b34f5d admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:16.245065 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:16.272176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 798/1620] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:16 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:16.274157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb5658-ec73-48e7-b714-7d5127b34f5d admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:16.287409 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb5658-ec73-48e7-b714-7d5127b34f5d admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:16.294259 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb001c4e-0c8d-41ea-8036-1943dcea850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:16.294259 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb001c4e-0c8d-41ea-8036-1943dcea850f admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:16.294683 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb001c4e-0c8d-41ea-8036-1943dcea850f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:16.295754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb001c4e-0c8d-41ea-8036-1943dcea850f admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:16.296513 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb001c4e-0c8d-41ea-8036-1943dcea850f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:16.298946 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb001c4e-0c8d-41ea-8036-1943dcea850f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:16.319262 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab2999-1017-4533-842f-52c03d8b55e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:16.320071 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab2999-1017-4533-842f-52c03d8b55e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:16.320689 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab2999-1017-4533-842f-52c03d8b55e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:16.321377 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab2999-1017-4533-842f-52c03d8b55e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:16.323215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab2999-1017-4533-842f-52c03d8b55e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:16.327485 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab2999-1017-4533-842f-52c03d8b55e2 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:16.344820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 799/1621] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:16 2022] POST /identity/v3/users => generated 293 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:16.345866 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb001c4e-0c8d-41ea-8036-1943dcea850f admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:16.367595 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb001c4e-0c8d-41ea-8036-1943dcea850f admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:16.376485 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40eb66b-5690-42a3-bee9-83f7466bbb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:16.376485 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eb66b-5690-42a3-bee9-83f7466bbb7a admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:16.376690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eb66b-5690-42a3-bee9-83f7466bbb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:16.376953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eb66b-5690-42a3-bee9-83f7466bbb7a admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:16.377700 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40eb66b-5690-42a3-bee9-83f7466bbb7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:16.380275 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 823/1622] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:16 2022] POST /identity/v3/users => generated 308 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:16.380942 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab2999-1017-4533-842f-52c03d8b55e2 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:16.383456 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40eb66b-5690-42a3-bee9-83f7466bbb7a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:16.394439 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab2999-1017-4533-842f-52c03d8b55e2 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:16.401609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecba4a-7cd3-4007-8b7b-177e07754147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:16.402391 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecba4a-7cd3-4007-8b7b-177e07754147 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:16.404356 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecba4a-7cd3-4007-8b7b-177e07754147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:16.404799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecba4a-7cd3-4007-8b7b-177e07754147 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:16.406165 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecba4a-7cd3-4007-8b7b-177e07754147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:16.408831 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecba4a-7cd3-4007-8b7b-177e07754147 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:16.424918 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 824/1623] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:16.425995 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecba4a-7cd3-4007-8b7b-177e07754147 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:16.430948 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 800/1624] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:16 2022] POST /identity/v3/users => generated 291 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:16.436583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40eb66b-5690-42a3-bee9-83f7466bbb7a admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:16.448388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecba4a-7cd3-4007-8b7b-177e07754147 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:16.456093 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40eb66b-5690-42a3-bee9-83f7466bbb7a admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:16.459958 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badc2ec-8edd-4188-a067-a44514dbfa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:16.461866 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badc2ec-8edd-4188-a067-a44514dbfa5f admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:16.462251 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badc2ec-8edd-4188-a067-a44514dbfa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:16.462725 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8deae-4c89-42e4-af06-b6d4f93d70ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:16.462900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badc2ec-8edd-4188-a067-a44514dbfa5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:16.463535 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8deae-4c89-42e4-af06-b6d4f93d70ad admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:16.463687 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8deae-4c89-42e4-af06-b6d4f93d70ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:16.463801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badc2ec-8edd-4188-a067-a44514dbfa5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:16.463991 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8deae-4c89-42e4-af06-b6d4f93d70ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:16.464713 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8deae-4c89-42e4-af06-b6d4f93d70ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:16.466333 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badc2ec-8edd-4188-a067-a44514dbfa5f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:16.466489 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8deae-4c89-42e4-af06-b6d4f93d70ad admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:16.481897 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 801/1625] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:16.482794 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8deae-4c89-42e4-af06-b6d4f93d70ad admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:16.484895 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 825/1626] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:16.485941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badc2ec-8edd-4188-a067-a44514dbfa5f admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:16.497593 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8deae-4c89-42e4-af06-b6d4f93d70ad admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:16.501930 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badc2ec-8edd-4188-a067-a44514dbfa5f admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:16.502821 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3e722-db7c-4163-a732-b6f51d9e6574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:16.503615 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3e722-db7c-4163-a732-b6f51d9e6574 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:16.503896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3e722-db7c-4163-a732-b6f51d9e6574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:16.504255 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3e722-db7c-4163-a732-b6f51d9e6574 admin admin] PATH_INFO: `/v3/projects/0738a562893c48d8a3dc23a9fa4dfc8a/users/9445a375ce0d45e5aebf8cf10c742ce6/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:16.509278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d55ce7-5db1-443d-8c2c-faadad6b843c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:16.510010 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55ce7-5db1-443d-8c2c-faadad6b843c admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:16.510392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55ce7-5db1-443d-8c2c-faadad6b843c admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:16.510767 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55ce7-5db1-443d-8c2c-faadad6b843c admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:16.512324 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d55ce7-5db1-443d-8c2c-faadad6b843c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:16.515061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d55ce7-5db1-443d-8c2c-faadad6b843c admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:16.521239 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3e722-db7c-4163-a732-b6f51d9e6574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0738a562893c48d8a3dc23a9fa4dfc8a, user_id=9445a375ce0d45e5aebf8cf10c742ce6, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:16.524318 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3e722-db7c-4163-a732-b6f51d9e6574 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:16.531148 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 826/1627] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:16.536516 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d55ce7-5db1-443d-8c2c-faadad6b843c admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:16.540697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 802/1628] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:16 2022] PUT /identity/v3/projects/0738a562893c48d8a3dc23a9fa4dfc8a/users/9445a375ce0d45e5aebf8cf10c742ce6/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:16.542392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3e722-db7c-4163-a732-b6f51d9e6574 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:16.552685 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d55ce7-5db1-443d-8c2c-faadad6b843c admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:16.558817 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:16.640318 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3e722-db7c-4163-a732-b6f51d9e6574 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:16.650547 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e6226-595a-4070-92bf-731197ad8c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:16.650879 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a2792-4709-4abe-a760-0d9f6e809ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:16.652145 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e6226-595a-4070-92bf-731197ad8c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:16.652719 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e6226-595a-4070-92bf-731197ad8c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:16.652845 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a2792-4709-4abe-a760-0d9f6e809ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:16.653091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a2792-4709-4abe-a760-0d9f6e809ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:16.653696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e6226-595a-4070-92bf-731197ad8c16 admin admin] PATH_INFO: `/v3/projects/4b0a27833db248b19428bcd2560b4c1d/users/d93013a71f794e91903edce364ff0683/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:16.655446 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a2792-4709-4abe-a760-0d9f6e809ad4 admin admin] PATH_INFO: `/v3/projects/0d9faf7cadf24f728fa19bbfad10a1ec/users/a15073395ef64dfdb62b95c32b1d04a5/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:16.692434 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e6226-595a-4070-92bf-731197ad8c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0a27833db248b19428bcd2560b4c1d, user_id=d93013a71f794e91903edce364ff0683, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:16.696898 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a2792-4709-4abe-a760-0d9f6e809ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9faf7cadf24f728fa19bbfad10a1ec, user_id=a15073395ef64dfdb62b95c32b1d04a5, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:16.700044 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e6226-595a-4070-92bf-731197ad8c16 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:16.703777 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a2792-4709-4abe-a760-0d9f6e809ad4 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:16.736762 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 827/1629] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:16 2022] PUT /identity/v3/projects/0d9faf7cadf24f728fa19bbfad10a1ec/users/a15073395ef64dfdb62b95c32b1d04a5/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:16.746123 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a2792-4709-4abe-a760-0d9f6e809ad4 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:16.748979 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 803/1630] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:16 2022] PUT /identity/v3/projects/4b0a27833db248b19428bcd2560b4c1d/users/d93013a71f794e91903edce364ff0683/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:16.750105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e6226-595a-4070-92bf-731197ad8c16 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:16.883319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a2792-4709-4abe-a760-0d9f6e809ad4 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:16.911438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:16.919684 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e6226-595a-4070-92bf-731197ad8c16 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:16.935347 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0550f9-1684-488e-8ed9-885a755b9dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:16.936885 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0550f9-1684-488e-8ed9-885a755b9dbb admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:16.937180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0550f9-1684-488e-8ed9-885a755b9dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:16.937460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0550f9-1684-488e-8ed9-885a755b9dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:16.938125 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0550f9-1684-488e-8ed9-885a755b9dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:16.944662 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0550f9-1684-488e-8ed9-885a755b9dbb admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:16.969441 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 804/1631] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:16.970132 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0550f9-1684-488e-8ed9-885a755b9dbb admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:16.985517 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0550f9-1684-488e-8ed9-885a755b9dbb admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:16.991332 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577188e-a44a-465f-82ac-9b138a9ef46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:16.991905 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577188e-a44a-465f-82ac-9b138a9ef46a admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:16.992207 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577188e-a44a-465f-82ac-9b138a9ef46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:16.992542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577188e-a44a-465f-82ac-9b138a9ef46a admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:16.993196 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577188e-a44a-465f-82ac-9b138a9ef46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:16.994794 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577188e-a44a-465f-82ac-9b138a9ef46a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:16.998678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c504b6-9172-42df-a643-c8ca1395a95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:17.001136 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c504b6-9172-42df-a643-c8ca1395a95f admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:17.003509 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c504b6-9172-42df-a643-c8ca1395a95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:17.003962 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c504b6-9172-42df-a643-c8ca1395a95f admin admin] PATH_INFO: `/v3/projects/3ee208d911014b289c01f0dabb7dff37/users/8922b8941a134245b2735a9e8f908676/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:17.006113 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 805/1632] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:17.007059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577188e-a44a-465f-82ac-9b138a9ef46a admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:17.020588 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577188e-a44a-465f-82ac-9b138a9ef46a admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:17.034467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756727cb-5750-4833-af14-b471a0a47f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:17.035120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756727cb-5750-4833-af14-b471a0a47f44 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:17.035398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756727cb-5750-4833-af14-b471a0a47f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:17.035671 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756727cb-5750-4833-af14-b471a0a47f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:17.036321 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756727cb-5750-4833-af14-b471a0a47f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:17.038040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756727cb-5750-4833-af14-b471a0a47f44 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:17.046860 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c504b6-9172-42df-a643-c8ca1395a95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee208d911014b289c01f0dabb7dff37, user_id=8922b8941a134245b2735a9e8f908676, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:17.049913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 806/1633] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:17.051790 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756727cb-5750-4833-af14-b471a0a47f44 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:17.053812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c504b6-9172-42df-a643-c8ca1395a95f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:17.069326 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756727cb-5750-4833-af14-b471a0a47f44 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:17.087101 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 828/1634] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:16 2022] PUT /identity/v3/projects/3ee208d911014b289c01f0dabb7dff37/users/8922b8941a134245b2735a9e8f908676/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:17.088260 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c504b6-9172-42df-a643-c8ca1395a95f admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:17.209820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6dad9-f14e-4ab6-b325-afaf8c189b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:17.212192 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6dad9-f14e-4ab6-b325-afaf8c189b1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:17.212477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6dad9-f14e-4ab6-b325-afaf8c189b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:17.212759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6dad9-f14e-4ab6-b325-afaf8c189b1b admin admin] PATH_INFO: `/v3/projects/0738a562893c48d8a3dc23a9fa4dfc8a/users/9445a375ce0d45e5aebf8cf10c742ce6/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:17.219100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6dad9-f14e-4ab6-b325-afaf8c189b1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0738a562893c48d8a3dc23a9fa4dfc8a, user_id=9445a375ce0d45e5aebf8cf10c742ce6, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:17.225189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c504b6-9172-42df-a643-c8ca1395a95f admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:17.227019 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6dad9-f14e-4ab6-b325-afaf8c189b1b admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:17.232629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1be6a-9c99-4832-9668-0662c93c2737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:17.233863 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1be6a-9c99-4832-9668-0662c93c2737 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:17.234228 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1be6a-9c99-4832-9668-0662c93c2737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:17.235350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1be6a-9c99-4832-9668-0662c93c2737 admin admin] PATH_INFO: `/v3/projects/0d9faf7cadf24f728fa19bbfad10a1ec/users/a15073395ef64dfdb62b95c32b1d04a5/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:17.237237 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1be6a-9c99-4832-9668-0662c93c2737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9faf7cadf24f728fa19bbfad10a1ec, user_id=a15073395ef64dfdb62b95c32b1d04a5, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:17.240958 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1be6a-9c99-4832-9668-0662c93c2737 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:17.255750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 829/1635] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:17 2022] PUT /identity/v3/projects/0d9faf7cadf24f728fa19bbfad10a1ec/users/a15073395ef64dfdb62b95c32b1d04a5/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:17.256831 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1be6a-9c99-4832-9668-0662c93c2737 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:17.266562 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 807/1636] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:17 2022] PUT /identity/v3/projects/0738a562893c48d8a3dc23a9fa4dfc8a/users/9445a375ce0d45e5aebf8cf10c742ce6/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:17.267631 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6dad9-f14e-4ab6-b325-afaf8c189b1b admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:17.280272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:17.422066 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6dad9-f14e-4ab6-b325-afaf8c189b1b admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:17.424412 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1be6a-9c99-4832-9668-0662c93c2737 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:17.438317 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29931547-61d3-4f74-8bf9-93c806bcfe4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:17.439115 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa03b83-76f9-4d1a-be2d-cbaac40567b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:17.439831 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa03b83-76f9-4d1a-be2d-cbaac40567b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:17.440118 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa03b83-76f9-4d1a-be2d-cbaac40567b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:17.440558 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa03b83-76f9-4d1a-be2d-cbaac40567b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:17.441362 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa03b83-76f9-4d1a-be2d-cbaac40567b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:17.443039 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa03b83-76f9-4d1a-be2d-cbaac40567b6 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:17.443164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29931547-61d3-4f74-8bf9-93c806bcfe4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:17.443404 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29931547-61d3-4f74-8bf9-93c806bcfe4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:17.451459 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29931547-61d3-4f74-8bf9-93c806bcfe4d admin admin] PATH_INFO: `/v3/projects/4b0a27833db248b19428bcd2560b4c1d/users/d93013a71f794e91903edce364ff0683/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:17.453793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29931547-61d3-4f74-8bf9-93c806bcfe4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0a27833db248b19428bcd2560b4c1d, user_id=d93013a71f794e91903edce364ff0683, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:17.456601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29931547-61d3-4f74-8bf9-93c806bcfe4d admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:17.465422 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 808/1637] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:17.466863 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d364372-a6d3-4d8c-aab3-a3cf8a32c8be None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:17.469841 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d364372-a6d3-4d8c-aab3-a3cf8a32c8be None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:17.470120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d364372-a6d3-4d8c-aab3-a3cf8a32c8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:17.484716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 830/1638] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:17 2022] PUT /identity/v3/projects/4b0a27833db248b19428bcd2560b4c1d/users/d93013a71f794e91903edce364ff0683/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:17.486489 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc74f3-165d-4c0d-b933-485cac1037d0 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:17.494743 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc74f3-165d-4c0d-b933-485cac1037d0 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:17.495059 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc74f3-165d-4c0d-b933-485cac1037d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:17.536900 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-0d364372-a6d3-4d8c-aab3-a3cf8a32c8be None None] MFA Rules not processed for user `a15073395ef64dfdb62b95c32b1d04a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:17.538164 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0d364372-a6d3-4d8c-aab3-a3cf8a32c8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:17.551149 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-98cc74f3-165d-4c0d-b933-485cac1037d0 None None] MFA Rules not processed for user `9445a375ce0d45e5aebf8cf10c742ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:17.552659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-98cc74f3-165d-4c0d-b933-485cac1037d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:17.596237 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:17.701071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 809/1639] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:17 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:17.702006 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d364372-a6d3-4d8c-aab3-a3cf8a32c8be None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:17.715677 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 831/1640] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:17.717166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7069863-68f6-42aa-b9de-245f7abb6013 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:17.717455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7069863-68f6-42aa-b9de-245f7abb6013 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:17.717736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7069863-68f6-42aa-b9de-245f7abb6013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:17.775265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-c7069863-68f6-42aa-b9de-245f7abb6013 None None] MFA Rules not processed for user `d93013a71f794e91903edce364ff0683`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:17.776765 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c7069863-68f6-42aa-b9de-245f7abb6013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:17.836446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d364372-a6d3-4d8c-aab3-a3cf8a32c8be None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:17.852902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755f897-7f8a-4e2a-b877-505d9fa077dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:17.853591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755f897-7f8a-4e2a-b877-505d9fa077dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:17.853901 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755f897-7f8a-4e2a-b877-505d9fa077dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:17.854195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755f897-7f8a-4e2a-b877-505d9fa077dc admin admin] PATH_INFO: `/v3/projects/3ee208d911014b289c01f0dabb7dff37/users/8922b8941a134245b2735a9e8f908676/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:17.860348 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755f897-7f8a-4e2a-b877-505d9fa077dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee208d911014b289c01f0dabb7dff37, user_id=8922b8941a134245b2735a9e8f908676, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:17.872051 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755f897-7f8a-4e2a-b877-505d9fa077dc admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:17.895963 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 810/1641] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:17 2022] PUT /identity/v3/projects/3ee208d911014b289c01f0dabb7dff37/users/8922b8941a134245b2735a9e8f908676/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:17.897616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159954a-d53a-40da-b4cd-88028503fa1c None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:17.898680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159954a-d53a-40da-b4cd-88028503fa1c None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:17.898680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159954a-d53a-40da-b4cd-88028503fa1c None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:17.905014 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 811/1642] 10.222.0.26 () {54 vars in 961 bytes} [Mon Sep 26 01:36:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:36:17.910527 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159954a-d53a-40da-b4cd-88028503fa1c None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:17.961764 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 832/1643] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:17.961764 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7069863-68f6-42aa-b9de-245f7abb6013 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:17.967446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:18.028560 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159954a-d53a-40da-b4cd-88028503fa1c None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:18.033145 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942195e1-9faf-4251-83cc-9843684bafac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:18.034098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942195e1-9faf-4251-83cc-9843684bafac service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:18.034610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942195e1-9faf-4251-83cc-9843684bafac service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:18.035139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942195e1-9faf-4251-83cc-9843684bafac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:18.119912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7069863-68f6-42aa-b9de-245f7abb6013 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:18.132766 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d77e64-1418-407f-9d14-e503e9261280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:18.133732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d77e64-1418-407f-9d14-e503e9261280 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:18.133865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d77e64-1418-407f-9d14-e503e9261280 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:18.136003 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d77e64-1418-407f-9d14-e503e9261280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:18.151255 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942195e1-9faf-4251-83cc-9843684bafac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:18.153627 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942195e1-9faf-4251-83cc-9843684bafac service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:18.169467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 812/1644] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:17 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:18.171889 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2b9c8-d5d6-49d0-8292-4241f63dcf9d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:18.172303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2b9c8-d5d6-49d0-8292-4241f63dcf9d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:18.172814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2b9c8-d5d6-49d0-8292-4241f63dcf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:18.245567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-f0b2b9c8-d5d6-49d0-8292-4241f63dcf9d None None] MFA Rules not processed for user `3d6eaeb6bced49afabc7bdaa5e7cecfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:18.246995 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f0b2b9c8-d5d6-49d0-8292-4241f63dcf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:18.339364 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:18.352688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d77e64-1418-407f-9d14-e503e9261280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:18.354539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d77e64-1418-407f-9d14-e503e9261280 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:18.354709 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 813/1645] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Sep 26 01:36:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:18.356677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367959ae-8080-4f41-a04f-617dfe067cfc None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:18.357197 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367959ae-8080-4f41-a04f-617dfe067cfc None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:18.357664 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367959ae-8080-4f41-a04f-617dfe067cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:18.384311 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 833/1646] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:17 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:18.386183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d77e64-1418-407f-9d14-e503e9261280 service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:18.400127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-367959ae-8080-4f41-a04f-617dfe067cfc None None] MFA Rules not processed for user `8922b8941a134245b2735a9e8f908676`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:18.403433 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-367959ae-8080-4f41-a04f-617dfe067cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:18.413398 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d77e64-1418-407f-9d14-e503e9261280 service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:18.417569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac949e-09da-4e14-8d66-296985754574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:18.418184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac949e-09da-4e14-8d66-296985754574 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:18.418466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac949e-09da-4e14-8d66-296985754574 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:18.418736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac949e-09da-4e14-8d66-296985754574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:18.495208 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:18.559738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac949e-09da-4e14-8d66-296985754574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:18.562993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac949e-09da-4e14-8d66-296985754574 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:18.593933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 834/1647] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:18.609099 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f183aa-ffd7-4697-b6fe-01a8b75484e8 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:18.617640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f183aa-ffd7-4697-b6fe-01a8b75484e8 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:18.618393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f183aa-ffd7-4697-b6fe-01a8b75484e8 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:18.620218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 814/1648] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:18.629021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 835/1649] 10.222.0.26 () {54 vars in 912 bytes} [Mon Sep 26 01:36:18 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:36:18.629716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58638e77-d8c8-4e3b-b460-2f0caaebd206 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:18.630131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58638e77-d8c8-4e3b-b460-2f0caaebd206 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:18.630567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58638e77-d8c8-4e3b-b460-2f0caaebd206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:18.687550 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-58638e77-d8c8-4e3b-b460-2f0caaebd206 None None] MFA Rules not processed for user `3d6eaeb6bced49afabc7bdaa5e7cecfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:18.688959 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-58638e77-d8c8-4e3b-b460-2f0caaebd206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:18.722018 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f183aa-ffd7-4697-b6fe-01a8b75484e8 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:18.733805 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 815/1650] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 26 01:36:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:18.739476 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f183aa-ffd7-4697-b6fe-01a8b75484e8 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:18.749281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671f9d9-1104-4095-b93e-773d8b7e1030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:18.751579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58638e77-d8c8-4e3b-b460-2f0caaebd206 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:18.756798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671f9d9-1104-4095-b93e-773d8b7e1030 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:18.759615 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671f9d9-1104-4095-b93e-773d8b7e1030 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:18.759615 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671f9d9-1104-4095-b93e-773d8b7e1030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:18.768015 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58638e77-d8c8-4e3b-b460-2f0caaebd206 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:18.779241 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4b90f-2ab2-43ae-afd7-fc7bae5ebd3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:18.781150 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4b90f-2ab2-43ae-afd7-fc7bae5ebd3a service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:18.782873 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4b90f-2ab2-43ae-afd7-fc7bae5ebd3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:18.783376 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4b90f-2ab2-43ae-afd7-fc7bae5ebd3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:18.785049 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671f9d9-1104-4095-b93e-773d8b7e1030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:18.789789 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671f9d9-1104-4095-b93e-773d8b7e1030 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:18.831003 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 836/1651] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:18.874096 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4b90f-2ab2-43ae-afd7-fc7bae5ebd3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:18.875850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4b90f-2ab2-43ae-afd7-fc7bae5ebd3a service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:18.904054 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 816/1652] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:19.085713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671f9d9-1104-4095-b93e-773d8b7e1030 service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:19.110939 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671f9d9-1104-4095-b93e-773d8b7e1030 service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:19.113517 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4b90f-2ab2-43ae-afd7-fc7bae5ebd3a service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:19.118382 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cb8e3-12ea-417d-8019-ebaa50658dec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:19.120425 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cb8e3-12ea-417d-8019-ebaa50658dec service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:19.122089 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cb8e3-12ea-417d-8019-ebaa50658dec service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:19.123098 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cb8e3-12ea-417d-8019-ebaa50658dec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:19.125631 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4b90f-2ab2-43ae-afd7-fc7bae5ebd3a service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:19.135962 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435582a6-6a86-4e3a-ad42-c1fb42be8498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:19.138134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435582a6-6a86-4e3a-ad42-c1fb42be8498 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:19.139644 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435582a6-6a86-4e3a-ad42-c1fb42be8498 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:19.139945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435582a6-6a86-4e3a-ad42-c1fb42be8498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:19.160656 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cb8e3-12ea-417d-8019-ebaa50658dec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:19.164841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cb8e3-12ea-417d-8019-ebaa50658dec service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:19.192468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 837/1653] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:19.262587 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435582a6-6a86-4e3a-ad42-c1fb42be8498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:19.265906 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435582a6-6a86-4e3a-ad42-c1fb42be8498 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:19.327939 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 817/1654] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:19.480384 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cb8e3-12ea-417d-8019-ebaa50658dec service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:19.703702 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cb8e3-12ea-417d-8019-ebaa50658dec service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:19.717187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9924d-9d42-4350-9671-7bf01bf54a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:19.717840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9924d-9d42-4350-9671-7bf01bf54a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:19.718121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9924d-9d42-4350-9671-7bf01bf54a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:19.718398 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9924d-9d42-4350-9671-7bf01bf54a08 admin admin] PATH_INFO: `/v3/users/c294add551b14edc858e588fa2da2c45` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:19.720762 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9924d-9d42-4350-9671-7bf01bf54a08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c294add551b14edc858e588fa2da2c45)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:19.723097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9924d-9d42-4350-9671-7bf01bf54a08 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:19.851666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-27f9924d-9d42-4350-9671-7bf01bf54a08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c294add551b14edc858e588fa2da2c45'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:19.852437 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-27f9924d-9d42-4350-9671-7bf01bf54a08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c294add551b14edc858e588fa2da2c45'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:19.854638 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-27f9924d-9d42-4350-9671-7bf01bf54a08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c294add551b14edc858e588fa2da2c45'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:19.874221 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:19.878316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-27f9924d-9d42-4350-9671-7bf01bf54a08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c294add551b14edc858e588fa2da2c45'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:19.893619 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-27f9924d-9d42-4350-9671-7bf01bf54a08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c294add551b14edc858e588fa2da2c45'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:19.915721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 838/1655] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:36:19 2022] DELETE /identity/v3/users/c294add551b14edc858e588fa2da2c45 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:19.920315 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c9189-a417-4d1f-8d83-5f9c02311148 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:19.920804 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c9189-a417-4d1f-8d83-5f9c02311148 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:19.921165 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c9189-a417-4d1f-8d83-5f9c02311148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:19.948352 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-128c9189-a417-4d1f-8d83-5f9c02311148 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:19.949909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-128c9189-a417-4d1f-8d83-5f9c02311148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:20.119886 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 818/1656] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:36:20.216640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9924d-9d42-4350-9671-7bf01bf54a08 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:20.219480 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-27f9924d-9d42-4350-9671-7bf01bf54a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:20.413787 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9924d-9d42-4350-9671-7bf01bf54a08 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:20.431114 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b5030-5dda-40ff-bf7a-a0e049819198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:20.437042 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b5030-5dda-40ff-bf7a-a0e049819198 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:20.439028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b5030-5dda-40ff-bf7a-a0e049819198 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:20.440879 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b5030-5dda-40ff-bf7a-a0e049819198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:20.480061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b5030-5dda-40ff-bf7a-a0e049819198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:20.485296 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b5030-5dda-40ff-bf7a-a0e049819198 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:20.513646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 839/1657] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:21.696440 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c9189-a417-4d1f-8d83-5f9c02311148 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:21.699581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-128c9189-a417-4d1f-8d83-5f9c02311148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:21.715283 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:21.725086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c9189-a417-4d1f-8d83-5f9c02311148 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:21.740099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474683e-a95d-41b2-a3b4-067a81ba915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:21.741013 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474683e-a95d-41b2-a3b4-067a81ba915f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:21.741557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474683e-a95d-41b2-a3b4-067a81ba915f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:21.743084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474683e-a95d-41b2-a3b4-067a81ba915f admin admin] PATH_INFO: `/v3/users/3e0597e48ada4c21adc16b2578194a50` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:21.752832 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474683e-a95d-41b2-a3b4-067a81ba915f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0597e48ada4c21adc16b2578194a50)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:21.756920 dv-cinder-859203-2-smb devstack@keystone.service[81421]: WARNING py.warnings [None req-8474683e-a95d-41b2-a3b4-067a81ba915f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 01:36:21.756920 dv-cinder-859203-2-smb devstack@keystone.service[81421]: warnings.warn(msg) Sep 26 01:36:21.756920 dv-cinder-859203-2-smb devstack@keystone.service[81421]: Sep 26 01:36:21.760652 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474683e-a95d-41b2-a3b4-067a81ba915f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:21.903697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8474683e-a95d-41b2-a3b4-067a81ba915f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0597e48ada4c21adc16b2578194a50'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:21.905223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8474683e-a95d-41b2-a3b4-067a81ba915f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0597e48ada4c21adc16b2578194a50'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:21.907518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8474683e-a95d-41b2-a3b4-067a81ba915f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0597e48ada4c21adc16b2578194a50'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:21.959011 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8474683e-a95d-41b2-a3b4-067a81ba915f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0597e48ada4c21adc16b2578194a50'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:22.015520 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8474683e-a95d-41b2-a3b4-067a81ba915f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0597e48ada4c21adc16b2578194a50'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:22.095635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a293cfc-8684-4357-8539-fea63811eb45 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:22.096919 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 819/1658] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:36:21 2022] DELETE /identity/v3/users/3e0597e48ada4c21adc16b2578194a50 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:22.098201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a293cfc-8684-4357-8539-fea63811eb45 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:22.098679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a293cfc-8684-4357-8539-fea63811eb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:22.180319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-1a293cfc-8684-4357-8539-fea63811eb45 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:22.182050 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-1a293cfc-8684-4357-8539-fea63811eb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:22.447616 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 840/1659] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:22.498004 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83489d8-084a-4719-aa14-b24f6ec27b17 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:22.499373 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83489d8-084a-4719-aa14-b24f6ec27b17 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:22.499667 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83489d8-084a-4719-aa14-b24f6ec27b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:22.505274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a293cfc-8684-4357-8539-fea63811eb45 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:22.508432 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-1a293cfc-8684-4357-8539-fea63811eb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:22.570569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-f83489d8-084a-4719-aa14-b24f6ec27b17 None None] MFA Rules not processed for user `5b5c8f664d1c4b4599c1d459782e02d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:22.576507 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f83489d8-084a-4719-aa14-b24f6ec27b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:22.637130 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a293cfc-8684-4357-8539-fea63811eb45 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:22.642347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0ec19-8a6a-4aaa-8e30-2f5df3ca3357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:22.642998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0ec19-8a6a-4aaa-8e30-2f5df3ca3357 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:22.643314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0ec19-8a6a-4aaa-8e30-2f5df3ca3357 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:22.643646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0ec19-8a6a-4aaa-8e30-2f5df3ca3357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:22.673515 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0ec19-8a6a-4aaa-8e30-2f5df3ca3357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:22.676056 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0ec19-8a6a-4aaa-8e30-2f5df3ca3357 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:22.702048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 841/1660] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:22.751306 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 820/1661] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:22.768695 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0ec19-8a6a-4aaa-8e30-2f5df3ca3357 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:22.770505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-80b0ec19-8a6a-4aaa-8e30-2f5df3ca3357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:22.838468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:22.911791 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0ec19-8a6a-4aaa-8e30-2f5df3ca3357 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:22.921078 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aea327-3b12-41e4-90fd-da81b8f63a8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:22.922185 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aea327-3b12-41e4-90fd-da81b8f63a8b service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:22.922477 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aea327-3b12-41e4-90fd-da81b8f63a8b service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:22.922755 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aea327-3b12-41e4-90fd-da81b8f63a8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:22.932816 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aea327-3b12-41e4-90fd-da81b8f63a8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:22.935600 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aea327-3b12-41e4-90fd-da81b8f63a8b service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:22.939750 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83489d8-084a-4719-aa14-b24f6ec27b17 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:22.941337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f83489d8-084a-4719-aa14-b24f6ec27b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:22.951640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 842/1662] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:22.968606 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8176ba-3844-48ec-bd78-5d2ad2cbde52 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:22.969038 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8176ba-3844-48ec-bd78-5d2ad2cbde52 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:22.969422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8176ba-3844-48ec-bd78-5d2ad2cbde52 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:22.971508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 843/1663] 10.222.0.26 () {54 vars in 961 bytes} [Mon Sep 26 01:36:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:36:22.981315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5aff8-a674-4176-9129-db20e189025a None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:22.981745 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5aff8-a674-4176-9129-db20e189025a None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:22.982127 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5aff8-a674-4176-9129-db20e189025a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:22.986891 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83489d8-084a-4719-aa14-b24f6ec27b17 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:23.009161 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1e542-a83a-47fe-b8d7-f493d966b812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:23.009884 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1e542-a83a-47fe-b8d7-f493d966b812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:23.010166 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1e542-a83a-47fe-b8d7-f493d966b812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:23.010443 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1e542-a83a-47fe-b8d7-f493d966b812 admin admin] PATH_INFO: `/v3/projects/3aa20559fb4447cd8ba057b17d16f25f` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:23.013744 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1e542-a83a-47fe-b8d7-f493d966b812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa20559fb4447cd8ba057b17d16f25f)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:23.025361 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-2ce5aff8-a674-4176-9129-db20e189025a None None] MFA Rules not processed for user `3d6eaeb6bced49afabc7bdaa5e7cecfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:23.027381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-2ce5aff8-a674-4176-9129-db20e189025a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:23.030423 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1e542-a83a-47fe-b8d7-f493d966b812 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:23.043462 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 844/1664] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Sep 26 01:36:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:36:23.054447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fe9fe-d773-4a6f-853d-c34e4d7715e5 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:23.056797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fe9fe-d773-4a6f-853d-c34e4d7715e5 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:23.058463 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fe9fe-d773-4a6f-853d-c34e4d7715e5 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:23.067832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 845/1665] 10.222.0.26 () {54 vars in 912 bytes} [Mon Sep 26 01:36:23 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:36:23.075022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f86fd-d0d7-47e3-98ef-f9523da70e10 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:23.075715 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f86fd-d0d7-47e3-98ef-f9523da70e10 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:23.076243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f86fd-d0d7-47e3-98ef-f9523da70e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:23.143835 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bfe1e542-a83a-47fe-b8d7-f493d966b812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa20559fb4447cd8ba057b17d16f25f', 'request_id': 'req-bfe1e542-a83a-47fe-b8d7-f493d966b812'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:23.147291 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-ac9f86fd-d0d7-47e3-98ef-f9523da70e10 None None] MFA Rules not processed for user `3d6eaeb6bced49afabc7bdaa5e7cecfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:23.151207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-ac9f86fd-d0d7-47e3-98ef-f9523da70e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:23.157587 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bfe1e542-a83a-47fe-b8d7-f493d966b812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa20559fb4447cd8ba057b17d16f25f', 'request_id': 'req-bfe1e542-a83a-47fe-b8d7-f493d966b812'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:23.162978 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:23.173659 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bfe1e542-a83a-47fe-b8d7-f493d966b812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa20559fb4447cd8ba057b17d16f25f', 'request_id': 'req-bfe1e542-a83a-47fe-b8d7-f493d966b812'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:23.198295 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bfe1e542-a83a-47fe-b8d7-f493d966b812 admin admin] The token cache is being invalidate because project 3aa20559fb4447cd8ba057b17d16f25f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:36:23.198580 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bfe1e542-a83a-47fe-b8d7-f493d966b812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:23.199628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bfe1e542-a83a-47fe-b8d7-f493d966b812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:23.203086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 821/1666] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:36:22 2022] DELETE /identity/v3/projects/3aa20559fb4447cd8ba057b17d16f25f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:36:23.206578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1e542-a83a-47fe-b8d7-f493d966b812 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:23.207980 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-bfe1e542-a83a-47fe-b8d7-f493d966b812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:23.421242 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 846/1667] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 26 01:36:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:36:23.435236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f86fd-d0d7-47e3-98ef-f9523da70e10 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:23.436634 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-ac9f86fd-d0d7-47e3-98ef-f9523da70e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:23.463107 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1e542-a83a-47fe-b8d7-f493d966b812 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:23.471190 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de687912-b647-4dd7-adc1-b8c383e47d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:23.472173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de687912-b647-4dd7-adc1-b8c383e47d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:23.472692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de687912-b647-4dd7-adc1-b8c383e47d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:23.473049 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de687912-b647-4dd7-adc1-b8c383e47d34 admin admin] PATH_INFO: `/v3/users/a15073395ef64dfdb62b95c32b1d04a5` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:23.474473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de687912-b647-4dd7-adc1-b8c383e47d34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a15073395ef64dfdb62b95c32b1d04a5)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:23.491203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de687912-b647-4dd7-adc1-b8c383e47d34 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:23.634071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-de687912-b647-4dd7-adc1-b8c383e47d34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a15073395ef64dfdb62b95c32b1d04a5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:23.636180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-de687912-b647-4dd7-adc1-b8c383e47d34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a15073395ef64dfdb62b95c32b1d04a5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:23.637427 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-de687912-b647-4dd7-adc1-b8c383e47d34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a15073395ef64dfdb62b95c32b1d04a5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:23.648509 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f86fd-d0d7-47e3-98ef-f9523da70e10 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:23.664722 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76f4da-03aa-4939-833a-4b0fb3b1d419 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:23.665724 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f4da-03aa-4939-833a-4b0fb3b1d419 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:23.667560 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f4da-03aa-4939-833a-4b0fb3b1d419 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:23.667855 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f4da-03aa-4939-833a-4b0fb3b1d419 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:23.671718 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-fb76f4da-03aa-4939-833a-4b0fb3b1d419 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:23.702674 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-de687912-b647-4dd7-adc1-b8c383e47d34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a15073395ef64dfdb62b95c32b1d04a5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:23.708296 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76f4da-03aa-4939-833a-4b0fb3b1d419 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:23.709748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76f4da-03aa-4939-833a-4b0fb3b1d419 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:23.743249 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-de687912-b647-4dd7-adc1-b8c383e47d34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a15073395ef64dfdb62b95c32b1d04a5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:23.781877 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 847/1668] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:23.799155 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 822/1669] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:36:23 2022] DELETE /identity/v3/users/a15073395ef64dfdb62b95c32b1d04a5 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:25.212485 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76f4da-03aa-4939-833a-4b0fb3b1d419 service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:25.214567 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-fb76f4da-03aa-4939-833a-4b0fb3b1d419 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:25.223202 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de687912-b647-4dd7-adc1-b8c383e47d34 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:25.225209 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-de687912-b647-4dd7-adc1-b8c383e47d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:25.263427 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76f4da-03aa-4939-833a-4b0fb3b1d419 service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:25.352843 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:25.426405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56a74b-c2ff-4966-a22c-3a291ff4a9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:25.427091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56a74b-c2ff-4966-a22c-3a291ff4a9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:25.427378 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56a74b-c2ff-4966-a22c-3a291ff4a9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:25.427934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56a74b-c2ff-4966-a22c-3a291ff4a9f8 admin admin] PATH_INFO: `/v3/projects/0d9faf7cadf24f728fa19bbfad10a1ec` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:25.431048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56a74b-c2ff-4966-a22c-3a291ff4a9f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d9faf7cadf24f728fa19bbfad10a1ec)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:25.432091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: WARNING py.warnings [None req-4a56a74b-c2ff-4966-a22c-3a291ff4a9f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 01:36:25.432091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: warnings.warn(msg) Sep 26 01:36:25.432091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: Sep 26 01:36:25.434979 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56a74b-c2ff-4966-a22c-3a291ff4a9f8 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:25.445074 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de687912-b647-4dd7-adc1-b8c383e47d34 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:25.458347 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bfe59-3dff-4123-b46d-ba1eaa13abc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:25.459035 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bfe59-3dff-4123-b46d-ba1eaa13abc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:25.459313 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bfe59-3dff-4123-b46d-ba1eaa13abc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:25.459583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bfe59-3dff-4123-b46d-ba1eaa13abc5 admin admin] PATH_INFO: `/v3/users/a3537b0388ed4a67890ad3d81c9175d6` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:25.461680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bfe59-3dff-4123-b46d-ba1eaa13abc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3537b0388ed4a67890ad3d81c9175d6)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:25.465357 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bfe59-3dff-4123-b46d-ba1eaa13abc5 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:25.477232 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:25.561480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-a31bfe59-3dff-4123-b46d-ba1eaa13abc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3537b0388ed4a67890ad3d81c9175d6'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:25.562237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-a31bfe59-3dff-4123-b46d-ba1eaa13abc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3537b0388ed4a67890ad3d81c9175d6'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:25.563122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-a31bfe59-3dff-4123-b46d-ba1eaa13abc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3537b0388ed4a67890ad3d81c9175d6'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:25.582419 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-a31bfe59-3dff-4123-b46d-ba1eaa13abc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3537b0388ed4a67890ad3d81c9175d6'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:25.592060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-a31bfe59-3dff-4123-b46d-ba1eaa13abc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3537b0388ed4a67890ad3d81c9175d6'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:25.598228 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4a56a74b-c2ff-4966-a22c-3a291ff4a9f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d9faf7cadf24f728fa19bbfad10a1ec', 'request_id': 'req-4a56a74b-c2ff-4966-a22c-3a291ff4a9f8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:25.620790 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 823/1670] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:36:25 2022] DELETE /identity/v3/users/a3537b0388ed4a67890ad3d81c9175d6 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:36:25.623576 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bfe59-3dff-4123-b46d-ba1eaa13abc5 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:25.627362 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a31bfe59-3dff-4123-b46d-ba1eaa13abc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:25.669872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4a56a74b-c2ff-4966-a22c-3a291ff4a9f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d9faf7cadf24f728fa19bbfad10a1ec', 'request_id': 'req-4a56a74b-c2ff-4966-a22c-3a291ff4a9f8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:25.681906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4a56a74b-c2ff-4966-a22c-3a291ff4a9f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d9faf7cadf24f728fa19bbfad10a1ec', 'request_id': 'req-4a56a74b-c2ff-4966-a22c-3a291ff4a9f8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:25.730210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4a56a74b-c2ff-4966-a22c-3a291ff4a9f8 admin admin] The token cache is being invalidate because project 0d9faf7cadf24f728fa19bbfad10a1ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:36:25.730623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4a56a74b-c2ff-4966-a22c-3a291ff4a9f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:25.731393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4a56a74b-c2ff-4966-a22c-3a291ff4a9f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:25.736201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 848/1671] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:36:25 2022] DELETE /identity/v3/projects/0d9faf7cadf24f728fa19bbfad10a1ec => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:25.736201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a5cb7-3469-42aa-bf14-b0ddf812e931 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:25.736201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a5cb7-3469-42aa-bf14-b0ddf812e931 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:25.736201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a5cb7-3469-42aa-bf14-b0ddf812e931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:25.763311 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-562a5cb7-3469-42aa-bf14-b0ddf812e931 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:25.765422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-562a5cb7-3469-42aa-bf14-b0ddf812e931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:25.827575 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bfe59-3dff-4123-b46d-ba1eaa13abc5 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:25.833616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88634352-146e-4e1f-8bf7-b0e8410ebea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:25.834635 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88634352-146e-4e1f-8bf7-b0e8410ebea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:25.834635 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88634352-146e-4e1f-8bf7-b0e8410ebea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:25.834783 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88634352-146e-4e1f-8bf7-b0e8410ebea8 admin admin] PATH_INFO: `/v3/projects/c9e1b90ede12449aa918c243e1c936bb` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:25.848019 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88634352-146e-4e1f-8bf7-b0e8410ebea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e1b90ede12449aa918c243e1c936bb)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:25.851840 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88634352-146e-4e1f-8bf7-b0e8410ebea8 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:25.981645 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 849/1672] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:25.983353 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65a02c-7516-4cd7-8fd7-d9c769e30568 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:25.983649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65a02c-7516-4cd7-8fd7-d9c769e30568 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:25.983953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65a02c-7516-4cd7-8fd7-d9c769e30568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:25.988375 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-88634352-146e-4e1f-8bf7-b0e8410ebea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e1b90ede12449aa918c243e1c936bb', 'request_id': 'req-88634352-146e-4e1f-8bf7-b0e8410ebea8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:26.003196 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-88634352-146e-4e1f-8bf7-b0e8410ebea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e1b90ede12449aa918c243e1c936bb', 'request_id': 'req-88634352-146e-4e1f-8bf7-b0e8410ebea8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:26.021996 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-88634352-146e-4e1f-8bf7-b0e8410ebea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e1b90ede12449aa918c243e1c936bb', 'request_id': 'req-88634352-146e-4e1f-8bf7-b0e8410ebea8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:26.031869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-ef65a02c-7516-4cd7-8fd7-d9c769e30568 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:26.043810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-ef65a02c-7516-4cd7-8fd7-d9c769e30568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:26.062239 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-88634352-146e-4e1f-8bf7-b0e8410ebea8 admin admin] The token cache is being invalidate because project c9e1b90ede12449aa918c243e1c936bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:36:26.062677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-88634352-146e-4e1f-8bf7-b0e8410ebea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:26.065833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-88634352-146e-4e1f-8bf7-b0e8410ebea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:26.068574 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 824/1673] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:36:25 2022] DELETE /identity/v3/projects/c9e1b90ede12449aa918c243e1c936bb => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:26.070791 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88634352-146e-4e1f-8bf7-b0e8410ebea8 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:26.074818 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-88634352-146e-4e1f-8bf7-b0e8410ebea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:26.126317 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:26.188361 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 850/1674] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:26.189268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65a02c-7516-4cd7-8fd7-d9c769e30568 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:26.195935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-ef65a02c-7516-4cd7-8fd7-d9c769e30568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:26.214323 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88634352-146e-4e1f-8bf7-b0e8410ebea8 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:26.218652 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e33e9-b6a0-4803-88bc-75bb3251f1fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:26.219310 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e33e9-b6a0-4803-88bc-75bb3251f1fc service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:26.219611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e33e9-b6a0-4803-88bc-75bb3251f1fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:26.219868 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e33e9-b6a0-4803-88bc-75bb3251f1fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:26.219964 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65a02c-7516-4cd7-8fd7-d9c769e30568 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:26.222025 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-697e33e9-b6a0-4803-88bc-75bb3251f1fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:26.230759 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55062b77-e80a-400e-836e-775ac36a8495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:26.231462 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55062b77-e80a-400e-836e-775ac36a8495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:26.231744 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55062b77-e80a-400e-836e-775ac36a8495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:26.235087 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55062b77-e80a-400e-836e-775ac36a8495 admin admin] PATH_INFO: `/v3/users/d93013a71f794e91903edce364ff0683` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:26.236389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e33e9-b6a0-4803-88bc-75bb3251f1fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:26.237552 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55062b77-e80a-400e-836e-775ac36a8495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d93013a71f794e91903edce364ff0683)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:26.238632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e33e9-b6a0-4803-88bc-75bb3251f1fc service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:26.240034 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55062b77-e80a-400e-836e-775ac36a8495 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:26.256784 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:26.263286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 825/1675] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:26.264868 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6336c-2958-4c17-aa86-dff0dccd3702 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:26.265331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6336c-2958-4c17-aa86-dff0dccd3702 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:26.265835 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6336c-2958-4c17-aa86-dff0dccd3702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:26.305970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-9ff6336c-2958-4c17-aa86-dff0dccd3702 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:26.307370 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-9ff6336c-2958-4c17-aa86-dff0dccd3702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:26.326079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 826/1676] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:26.327116 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6336c-2958-4c17-aa86-dff0dccd3702 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:26.341221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6336c-2958-4c17-aa86-dff0dccd3702 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:26.351538 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84563f3a-86a1-4d7d-be98-228bd1beac81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:26.352273 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84563f3a-86a1-4d7d-be98-228bd1beac81 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:26.353756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84563f3a-86a1-4d7d-be98-228bd1beac81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:26.355180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84563f3a-86a1-4d7d-be98-228bd1beac81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:26.356467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84563f3a-86a1-4d7d-be98-228bd1beac81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:36:26.357427 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84563f3a-86a1-4d7d-be98-228bd1beac81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:26.360377 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-55062b77-e80a-400e-836e-775ac36a8495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd93013a71f794e91903edce364ff0683'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:26.361914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-55062b77-e80a-400e-836e-775ac36a8495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd93013a71f794e91903edce364ff0683'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:26.363220 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84563f3a-86a1-4d7d-be98-228bd1beac81 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:26.363589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-55062b77-e80a-400e-836e-775ac36a8495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd93013a71f794e91903edce364ff0683'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:26.403941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-55062b77-e80a-400e-836e-775ac36a8495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd93013a71f794e91903edce364ff0683'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:26.419641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-55062b77-e80a-400e-836e-775ac36a8495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd93013a71f794e91903edce364ff0683'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:26.441424 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 827/1677] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:36:26.445550 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84563f3a-86a1-4d7d-be98-228bd1beac81 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:26.447684 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 851/1678] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:36:26 2022] DELETE /identity/v3/users/d93013a71f794e91903edce364ff0683 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:26.451794 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-84563f3a-86a1-4d7d-be98-228bd1beac81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:26.484787 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84563f3a-86a1-4d7d-be98-228bd1beac81 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:26.652040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d4e4e-5889-44e1-812c-e66c3e8ead6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:26.653548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d4e4e-5889-44e1-812c-e66c3e8ead6e admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:26.653872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d4e4e-5889-44e1-812c-e66c3e8ead6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:26.654149 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d4e4e-5889-44e1-812c-e66c3e8ead6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:26.656029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d4e4e-5889-44e1-812c-e66c3e8ead6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:26.663137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d4e4e-5889-44e1-812c-e66c3e8ead6e admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:26.760129 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 828/1679] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:26 2022] POST /identity/v3/projects => generated 365 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:26.760820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55062b77-e80a-400e-836e-775ac36a8495 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:26.779960 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55062b77-e80a-400e-836e-775ac36a8495 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:26.937265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edc867-6fb5-4771-86b7-c23364a0f539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:26.937891 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edc867-6fb5-4771-86b7-c23364a0f539 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:26.938202 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edc867-6fb5-4771-86b7-c23364a0f539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:26.940698 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edc867-6fb5-4771-86b7-c23364a0f539 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:26.952164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edc867-6fb5-4771-86b7-c23364a0f539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:26.964379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edc867-6fb5-4771-86b7-c23364a0f539 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:27.019330 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 852/1680] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:26 2022] POST /identity/v3/users => generated 283 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:27.025297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d4e4e-5889-44e1-812c-e66c3e8ead6e admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:27.055732 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d4e4e-5889-44e1-812c-e66c3e8ead6e admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:27.073115 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec77db-9fe5-4d0b-8742-d0e267a73895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:27.073743 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec77db-9fe5-4d0b-8742-d0e267a73895 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:27.074019 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec77db-9fe5-4d0b-8742-d0e267a73895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:27.074290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec77db-9fe5-4d0b-8742-d0e267a73895 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:27.075126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec77db-9fe5-4d0b-8742-d0e267a73895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:27.076999 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec77db-9fe5-4d0b-8742-d0e267a73895 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:27.101392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edc867-6fb5-4771-86b7-c23364a0f539 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:27.102741 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 829/1681] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:27.114994 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edc867-6fb5-4771-86b7-c23364a0f539 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:27.127709 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f273e-ed0b-4caa-9b88-fec5cc210579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:27.128413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f273e-ed0b-4caa-9b88-fec5cc210579 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:27.128689 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f273e-ed0b-4caa-9b88-fec5cc210579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:27.133636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f273e-ed0b-4caa-9b88-fec5cc210579 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:27.134674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f273e-ed0b-4caa-9b88-fec5cc210579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:27.138343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f273e-ed0b-4caa-9b88-fec5cc210579 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:27.174088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec77db-9fe5-4d0b-8742-d0e267a73895 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:27.178047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 853/1682] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:27.220419 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec77db-9fe5-4d0b-8742-d0e267a73895 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:27.236312 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcaacf2-dc8c-4d9d-acc2-fb5db032b6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:27.237198 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcaacf2-dc8c-4d9d-acc2-fb5db032b6a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:27.239459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcaacf2-dc8c-4d9d-acc2-fb5db032b6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:27.239890 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcaacf2-dc8c-4d9d-acc2-fb5db032b6a6 admin admin] PATH_INFO: `/v3/projects/3fe95ca1b0644ab3bc28f674e7495f7e/users/9764e59b87e244f790ba9656c7165af0/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:27.318268 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcaacf2-dc8c-4d9d-acc2-fb5db032b6a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe95ca1b0644ab3bc28f674e7495f7e, user_id=9764e59b87e244f790ba9656c7165af0, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:27.322414 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcaacf2-dc8c-4d9d-acc2-fb5db032b6a6 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:27.357771 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 830/1683] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:27 2022] PUT /identity/v3/projects/3fe95ca1b0644ab3bc28f674e7495f7e/users/9764e59b87e244f790ba9656c7165af0/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:27.370365 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd960a09-9d63-423f-be88-adf133ddf9db None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:27.371296 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd960a09-9d63-423f-be88-adf133ddf9db None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:27.371710 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd960a09-9d63-423f-be88-adf133ddf9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:27.450645 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-bd960a09-9d63-423f-be88-adf133ddf9db None None] MFA Rules not processed for user `9764e59b87e244f790ba9656c7165af0`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:27.452958 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-bd960a09-9d63-423f-be88-adf133ddf9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:27.576807 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:27.613835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 854/1684] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:27.618820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcaacf2-dc8c-4d9d-acc2-fb5db032b6a6 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:27.743687 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:27.773816 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcaacf2-dc8c-4d9d-acc2-fb5db032b6a6 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:27.781840 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c24fb-9b00-47a2-9b2f-9d9ec750d322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:27.785029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c24fb-9b00-47a2-9b2f-9d9ec750d322 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:27.785741 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c24fb-9b00-47a2-9b2f-9d9ec750d322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:27.786254 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c24fb-9b00-47a2-9b2f-9d9ec750d322 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:27.787467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c24fb-9b00-47a2-9b2f-9d9ec750d322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:27.791706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c24fb-9b00-47a2-9b2f-9d9ec750d322 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:27.865985 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd960a09-9d63-423f-be88-adf133ddf9db None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:27.878905 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 831/1685] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:27 2022] POST /identity/v3/projects => generated 363 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:27.891304 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd960a09-9d63-423f-be88-adf133ddf9db None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:27.921009 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c24fb-9b00-47a2-9b2f-9d9ec750d322 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:27.923137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ff1c24fb-9b00-47a2-9b2f-9d9ec750d322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:28.099467 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff87b2-7ca6-4d6f-a231-a8ca5a945147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:28.100097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff87b2-7ca6-4d6f-a231-a8ca5a945147 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:28.100380 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff87b2-7ca6-4d6f-a231-a8ca5a945147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:28.100655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff87b2-7ca6-4d6f-a231-a8ca5a945147 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:28.102106 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff87b2-7ca6-4d6f-a231-a8ca5a945147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:28.104272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff87b2-7ca6-4d6f-a231-a8ca5a945147 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:28.156611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 855/1686] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:27 2022] POST /identity/v3/users => generated 288 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:28.161734 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff87b2-7ca6-4d6f-a231-a8ca5a945147 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:28.165383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c24fb-9b00-47a2-9b2f-9d9ec750d322 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:28.179561 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182caa42-2e68-4f0d-9a4a-998b459c002b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:28.180590 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182caa42-2e68-4f0d-9a4a-998b459c002b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:28.180955 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182caa42-2e68-4f0d-9a4a-998b459c002b admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:28.181303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182caa42-2e68-4f0d-9a4a-998b459c002b admin admin] PATH_INFO: `/v3/projects/8ce4ac32149d4c458bb382c739e69a83` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:28.187813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182caa42-2e68-4f0d-9a4a-998b459c002b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ce4ac32149d4c458bb382c739e69a83)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:28.190327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182caa42-2e68-4f0d-9a4a-998b459c002b admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:28.224926 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff87b2-7ca6-4d6f-a231-a8ca5a945147 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:28.241186 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edaa8ad-b120-4650-a7f8-6dff07d37284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:28.242460 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaa8ad-b120-4650-a7f8-6dff07d37284 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:28.242737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaa8ad-b120-4650-a7f8-6dff07d37284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:28.243132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaa8ad-b120-4650-a7f8-6dff07d37284 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:28.243774 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edaa8ad-b120-4650-a7f8-6dff07d37284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:28.252151 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edaa8ad-b120-4650-a7f8-6dff07d37284 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:28.280619 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 856/1687] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:28.281597 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edaa8ad-b120-4650-a7f8-6dff07d37284 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:28.291353 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-2edaa8ad-b120-4650-a7f8-6dff07d37284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:28.305358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-182caa42-2e68-4f0d-9a4a-998b459c002b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ce4ac32149d4c458bb382c739e69a83', 'request_id': 'req-182caa42-2e68-4f0d-9a4a-998b459c002b'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:28.314448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edaa8ad-b120-4650-a7f8-6dff07d37284 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:28.317301 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-182caa42-2e68-4f0d-9a4a-998b459c002b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ce4ac32149d4c458bb382c739e69a83', 'request_id': 'req-182caa42-2e68-4f0d-9a4a-998b459c002b'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:28.330316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-182caa42-2e68-4f0d-9a4a-998b459c002b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ce4ac32149d4c458bb382c739e69a83', 'request_id': 'req-182caa42-2e68-4f0d-9a4a-998b459c002b'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:28.356508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-182caa42-2e68-4f0d-9a4a-998b459c002b admin admin] The token cache is being invalidate because project 8ce4ac32149d4c458bb382c739e69a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:36:28.357126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-182caa42-2e68-4f0d-9a4a-998b459c002b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:28.359748 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-182caa42-2e68-4f0d-9a4a-998b459c002b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:28.362865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 832/1688] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:36:27 2022] DELETE /identity/v3/projects/8ce4ac32149d4c458bb382c739e69a83 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:28.363572 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182caa42-2e68-4f0d-9a4a-998b459c002b admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:28.371835 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-182caa42-2e68-4f0d-9a4a-998b459c002b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:28.452607 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653f274-4d3d-4c1e-ad25-168cdfbb3004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:28.453272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653f274-4d3d-4c1e-ad25-168cdfbb3004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:28.453549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653f274-4d3d-4c1e-ad25-168cdfbb3004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:28.453979 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653f274-4d3d-4c1e-ad25-168cdfbb3004 admin admin] PATH_INFO: `/v3/users/ba8baba2b31a412fb266cdb406e9814b` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:28.455162 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653f274-4d3d-4c1e-ad25-168cdfbb3004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba8baba2b31a412fb266cdb406e9814b)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:28.457112 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653f274-4d3d-4c1e-ad25-168cdfbb3004 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:28.503029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182caa42-2e68-4f0d-9a4a-998b459c002b admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:28.516010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48730a92-93e4-4a54-8056-ea20ccd8db0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:28.516767 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48730a92-93e4-4a54-8056-ea20ccd8db0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:28.517047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48730a92-93e4-4a54-8056-ea20ccd8db0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:28.517372 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48730a92-93e4-4a54-8056-ea20ccd8db0d admin admin] PATH_INFO: `/v3/projects/42bb5f181b844399a5233b3f2643aca8/users/13b75b01af4640af820b1f76924c18e8/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:28.534855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:28.547226 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48730a92-93e4-4a54-8056-ea20ccd8db0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=42bb5f181b844399a5233b3f2643aca8, user_id=13b75b01af4640af820b1f76924c18e8, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:28.553522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48730a92-93e4-4a54-8056-ea20ccd8db0d admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:28.560543 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b653f274-4d3d-4c1e-ad25-168cdfbb3004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba8baba2b31a412fb266cdb406e9814b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:28.561531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b653f274-4d3d-4c1e-ad25-168cdfbb3004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba8baba2b31a412fb266cdb406e9814b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:28.561912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b653f274-4d3d-4c1e-ad25-168cdfbb3004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba8baba2b31a412fb266cdb406e9814b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:28.595246 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b653f274-4d3d-4c1e-ad25-168cdfbb3004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba8baba2b31a412fb266cdb406e9814b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:28.596896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 833/1689] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:28 2022] PUT /identity/v3/projects/42bb5f181b844399a5233b3f2643aca8/users/13b75b01af4640af820b1f76924c18e8/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:28.597846 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48730a92-93e4-4a54-8056-ea20ccd8db0d admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:28.600256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-48730a92-93e4-4a54-8056-ea20ccd8db0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:28.605765 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:28.611528 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b653f274-4d3d-4c1e-ad25-168cdfbb3004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba8baba2b31a412fb266cdb406e9814b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:28.641389 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 857/1690] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:36:28 2022] DELETE /identity/v3/users/ba8baba2b31a412fb266cdb406e9814b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:28.642260 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653f274-4d3d-4c1e-ad25-168cdfbb3004 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:28.647001 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b653f274-4d3d-4c1e-ad25-168cdfbb3004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:28.735927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48730a92-93e4-4a54-8056-ea20ccd8db0d admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:28.811287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653f274-4d3d-4c1e-ad25-168cdfbb3004 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:28.817361 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ef0d8-b562-4b9a-b303-27c799efcc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:28.818225 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ef0d8-b562-4b9a-b303-27c799efcc47 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:28.818645 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ef0d8-b562-4b9a-b303-27c799efcc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:28.819259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ef0d8-b562-4b9a-b303-27c799efcc47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:28.820848 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ef0d8-b562-4b9a-b303-27c799efcc47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:28.822850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ef0d8-b562-4b9a-b303-27c799efcc47 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:28.840105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248ccd1-a97d-4b33-a26a-b68dd16112bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:28.840743 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248ccd1-a97d-4b33-a26a-b68dd16112bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:28.841091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248ccd1-a97d-4b33-a26a-b68dd16112bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:28.841361 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248ccd1-a97d-4b33-a26a-b68dd16112bb admin admin] PATH_INFO: `/v3/users/8922b8941a134245b2735a9e8f908676` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:28.842802 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248ccd1-a97d-4b33-a26a-b68dd16112bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8922b8941a134245b2735a9e8f908676)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:28.844987 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248ccd1-a97d-4b33-a26a-b68dd16112bb admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:28.849766 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 858/1691] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:28.853640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7ab22-0f6a-4532-9454-763d6ce0a73a None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:28.853640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7ab22-0f6a-4532-9454-763d6ce0a73a None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:28.853640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7ab22-0f6a-4532-9454-763d6ce0a73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:28.892880 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-54e7ab22-0f6a-4532-9454-763d6ce0a73a None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:28.894220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-54e7ab22-0f6a-4532-9454-763d6ce0a73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:28.911742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 859/1692] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:28.913275 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e82c58-572e-4cb0-8e4a-5150c9a4c564 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:28.913824 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e82c58-572e-4cb0-8e4a-5150c9a4c564 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:28.921666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e82c58-572e-4cb0-8e4a-5150c9a4c564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:28.937725 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-2248ccd1-a97d-4b33-a26a-b68dd16112bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8922b8941a134245b2735a9e8f908676'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:28.938471 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-2248ccd1-a97d-4b33-a26a-b68dd16112bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8922b8941a134245b2735a9e8f908676'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:28.940407 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-2248ccd1-a97d-4b33-a26a-b68dd16112bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8922b8941a134245b2735a9e8f908676'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:28.964838 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-17e82c58-572e-4cb0-8e4a-5150c9a4c564 None None] MFA Rules not processed for user `5b5c8f664d1c4b4599c1d459782e02d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:28.966800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-2248ccd1-a97d-4b33-a26a-b68dd16112bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8922b8941a134245b2735a9e8f908676'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:28.970648 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-17e82c58-572e-4cb0-8e4a-5150c9a4c564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:28.979730 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-2248ccd1-a97d-4b33-a26a-b68dd16112bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8922b8941a134245b2735a9e8f908676'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:29.005540 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 834/1693] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:36:28 2022] DELETE /identity/v3/users/8922b8941a134245b2735a9e8f908676 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:29.011853 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248ccd1-a97d-4b33-a26a-b68dd16112bb admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:29.014867 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2248ccd1-a97d-4b33-a26a-b68dd16112bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:29.047171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:29.102617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 860/1694] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:29.103872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e82c58-572e-4cb0-8e4a-5150c9a4c564 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:29.124236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-17e82c58-572e-4cb0-8e4a-5150c9a4c564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:29.171417 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e82c58-572e-4cb0-8e4a-5150c9a4c564 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:29.174578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248ccd1-a97d-4b33-a26a-b68dd16112bb admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:29.187565 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2442247-2df4-4c57-b011-1cc49906f0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:29.188230 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2442247-2df4-4c57-b011-1cc49906f0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:29.188514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2442247-2df4-4c57-b011-1cc49906f0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:29.188787 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2442247-2df4-4c57-b011-1cc49906f0e7 admin admin] PATH_INFO: `/v3/projects/42bb5f181b844399a5233b3f2643aca8/users/13b75b01af4640af820b1f76924c18e8/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:29.191596 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2442247-2df4-4c57-b011-1cc49906f0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42bb5f181b844399a5233b3f2643aca8, user_id=13b75b01af4640af820b1f76924c18e8, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:29.194217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2442247-2df4-4c57-b011-1cc49906f0e7 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:29.203548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a9a0d-8a81-4bad-85e2-2e137c7eedc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:29.204219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a9a0d-8a81-4bad-85e2-2e137c7eedc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:29.204490 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a9a0d-8a81-4bad-85e2-2e137c7eedc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:29.204790 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a9a0d-8a81-4bad-85e2-2e137c7eedc7 admin admin] PATH_INFO: `/v3/projects/4b0a27833db248b19428bcd2560b4c1d` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:29.205932 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a9a0d-8a81-4bad-85e2-2e137c7eedc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0a27833db248b19428bcd2560b4c1d)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:29.208172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a9a0d-8a81-4bad-85e2-2e137c7eedc7 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:29.254392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 861/1695] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:29 2022] PUT /identity/v3/projects/42bb5f181b844399a5233b3f2643aca8/users/13b75b01af4640af820b1f76924c18e8/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:29.255472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2442247-2df4-4c57-b011-1cc49906f0e7 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:29.260227 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c2442247-2df4-4c57-b011-1cc49906f0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:29.332940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b26a9a0d-8a81-4bad-85e2-2e137c7eedc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0a27833db248b19428bcd2560b4c1d', 'request_id': 'req-b26a9a0d-8a81-4bad-85e2-2e137c7eedc7'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:29.348034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b26a9a0d-8a81-4bad-85e2-2e137c7eedc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0a27833db248b19428bcd2560b4c1d', 'request_id': 'req-b26a9a0d-8a81-4bad-85e2-2e137c7eedc7'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:29.358846 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b26a9a0d-8a81-4bad-85e2-2e137c7eedc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0a27833db248b19428bcd2560b4c1d', 'request_id': 'req-b26a9a0d-8a81-4bad-85e2-2e137c7eedc7'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:29.385613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b26a9a0d-8a81-4bad-85e2-2e137c7eedc7 admin admin] The token cache is being invalidate because project 4b0a27833db248b19428bcd2560b4c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:36:29.386136 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b26a9a0d-8a81-4bad-85e2-2e137c7eedc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:29.388805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2442247-2df4-4c57-b011-1cc49906f0e7 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:29.389735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b26a9a0d-8a81-4bad-85e2-2e137c7eedc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:29.395209 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 835/1696] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:36:29 2022] DELETE /identity/v3/projects/4b0a27833db248b19428bcd2560b4c1d => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:29.395209 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76dfd0-d3a6-4871-9f8a-848a43672759 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:29.395209 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76dfd0-d3a6-4871-9f8a-848a43672759 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:29.395209 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76dfd0-d3a6-4871-9f8a-848a43672759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:29.439523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:29.459536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-dc76dfd0-d3a6-4871-9f8a-848a43672759 None None] MFA Rules not processed for user `13b75b01af4640af820b1f76924c18e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:29.461392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-dc76dfd0-d3a6-4871-9f8a-848a43672759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:29.499841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281b7d7-cdf9-4c44-93d8-3fd7e23eb1dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:29.500512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281b7d7-cdf9-4c44-93d8-3fd7e23eb1dd service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:29.500751 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281b7d7-cdf9-4c44-93d8-3fd7e23eb1dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:29.501026 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281b7d7-cdf9-4c44-93d8-3fd7e23eb1dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:29.503040 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-7281b7d7-cdf9-4c44-93d8-3fd7e23eb1dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:29.607164 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 836/1697] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:29.613845 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197656c8-1bce-475e-af62-0f8af236943b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:29.613845 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197656c8-1bce-475e-af62-0f8af236943b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:29.614093 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197656c8-1bce-475e-af62-0f8af236943b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:29.652891 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-197656c8-1bce-475e-af62-0f8af236943b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:29.654297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-197656c8-1bce-475e-af62-0f8af236943b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:29.687011 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281b7d7-cdf9-4c44-93d8-3fd7e23eb1dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:29.689001 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281b7d7-cdf9-4c44-93d8-3fd7e23eb1dd service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:29.702723 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 862/1698] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:29.707401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281b7d7-cdf9-4c44-93d8-3fd7e23eb1dd service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:29.709232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-7281b7d7-cdf9-4c44-93d8-3fd7e23eb1dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:29.728008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:29.806197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281b7d7-cdf9-4c44-93d8-3fd7e23eb1dd service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:29.815686 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94341180-df3b-4950-ad06-4fa005bab2fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:29.816302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94341180-df3b-4950-ad06-4fa005bab2fa service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:29.816611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94341180-df3b-4950-ad06-4fa005bab2fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:29.816901 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94341180-df3b-4950-ad06-4fa005bab2fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:29.834278 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 837/1699] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:29.834278 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197656c8-1bce-475e-af62-0f8af236943b None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:29.834568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94341180-df3b-4950-ad06-4fa005bab2fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:29.834568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94341180-df3b-4950-ad06-4fa005bab2fa service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:29.838753 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-197656c8-1bce-475e-af62-0f8af236943b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:29.843626 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 863/1700] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:29.845331 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f7859-a369-411c-a0bb-c99809a079c1 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:29.845787 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f7859-a369-411c-a0bb-c99809a079c1 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:29.846182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f7859-a369-411c-a0bb-c99809a079c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:29.868446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197656c8-1bce-475e-af62-0f8af236943b None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:29.869623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-df2f7859-a369-411c-a0bb-c99809a079c1 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:29.871146 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-df2f7859-a369-411c-a0bb-c99809a079c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:29.880941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 864/1701] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:29.885779 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f7859-a369-411c-a0bb-c99809a079c1 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:29.886499 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4219f-f58f-4e1c-abc7-2937dae70a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:29.887232 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4219f-f58f-4e1c-abc7-2937dae70a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:29.887506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4219f-f58f-4e1c-abc7-2937dae70a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:29.887776 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4219f-f58f-4e1c-abc7-2937dae70a44 admin admin] PATH_INFO: `/v3/projects/3ee208d911014b289c01f0dabb7dff37` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:29.889010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4219f-f58f-4e1c-abc7-2937dae70a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee208d911014b289c01f0dabb7dff37)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:29.890971 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4219f-f58f-4e1c-abc7-2937dae70a44 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:29.901183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f7859-a369-411c-a0bb-c99809a079c1 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:29.910732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03102c-cdda-46ac-8f94-beb77f0d69fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:29.911689 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03102c-cdda-46ac-8f94-beb77f0d69fe admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:29.917720 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03102c-cdda-46ac-8f94-beb77f0d69fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:29.918401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03102c-cdda-46ac-8f94-beb77f0d69fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:29.921444 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03102c-cdda-46ac-8f94-beb77f0d69fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:36:29.922407 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03102c-cdda-46ac-8f94-beb77f0d69fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:29.924254 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03102c-cdda-46ac-8f94-beb77f0d69fe admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:29.949994 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 865/1702] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:36:29.954066 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03102c-cdda-46ac-8f94-beb77f0d69fe admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:29.980275 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03102c-cdda-46ac-8f94-beb77f0d69fe admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:29.991860 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213459c-7a35-4905-ab67-5d3ffa8ca05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:29.992562 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213459c-7a35-4905-ab67-5d3ffa8ca05f admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:29.992912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213459c-7a35-4905-ab67-5d3ffa8ca05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:29.993253 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213459c-7a35-4905-ab67-5d3ffa8ca05f admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:29.994065 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213459c-7a35-4905-ab67-5d3ffa8ca05f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:30.012555 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213459c-7a35-4905-ab67-5d3ffa8ca05f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:30.031543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-13a4219f-f58f-4e1c-abc7-2937dae70a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee208d911014b289c01f0dabb7dff37', 'request_id': 'req-13a4219f-f58f-4e1c-abc7-2937dae70a44'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:30.040079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-13a4219f-f58f-4e1c-abc7-2937dae70a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee208d911014b289c01f0dabb7dff37', 'request_id': 'req-13a4219f-f58f-4e1c-abc7-2937dae70a44'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:30.061661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-13a4219f-f58f-4e1c-abc7-2937dae70a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee208d911014b289c01f0dabb7dff37', 'request_id': 'req-13a4219f-f58f-4e1c-abc7-2937dae70a44'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:30.093714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-13a4219f-f58f-4e1c-abc7-2937dae70a44 admin admin] The token cache is being invalidate because project 3ee208d911014b289c01f0dabb7dff37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:36:30.093714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-13a4219f-f58f-4e1c-abc7-2937dae70a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:30.093714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-13a4219f-f58f-4e1c-abc7-2937dae70a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:30.097396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 838/1703] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:36:29 2022] DELETE /identity/v3/projects/3ee208d911014b289c01f0dabb7dff37 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:30.101780 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f869bed-5eeb-4312-8817-71f328b11f2d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:30.103297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f869bed-5eeb-4312-8817-71f328b11f2d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:30.104156 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f869bed-5eeb-4312-8817-71f328b11f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:30.145241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 866/1704] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:29 2022] POST /identity/v3/projects => generated 357 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:30.151189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201e09d-50c9-46b0-8675-355d62ab135f None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:30.151486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201e09d-50c9-46b0-8675-355d62ab135f None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:30.152457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201e09d-50c9-46b0-8675-355d62ab135f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:30.199152 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-e201e09d-50c9-46b0-8675-355d62ab135f None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:30.200556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e201e09d-50c9-46b0-8675-355d62ab135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:30.201276 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-8f869bed-5eeb-4312-8817-71f328b11f2d None None] MFA Rules not processed for user `c52e611cab734987bea6b2c5cc48a21f`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:30.203338 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8f869bed-5eeb-4312-8817-71f328b11f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:30.386718 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:30.456755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 839/1705] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:30.457829 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f869bed-5eeb-4312-8817-71f328b11f2d None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:30.471286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8f869bed-5eeb-4312-8817-71f328b11f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:30.517682 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 867/1706] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:30.517682 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201e09d-50c9-46b0-8675-355d62ab135f None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:30.517682 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e201e09d-50c9-46b0-8675-355d62ab135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:30.564120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201e09d-50c9-46b0-8675-355d62ab135f None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:30.585656 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12003999-0831-4668-88de-7630b01a72ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:30.586450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12003999-0831-4668-88de-7630b01a72ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:30.587878 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12003999-0831-4668-88de-7630b01a72ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:30.588371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12003999-0831-4668-88de-7630b01a72ea admin admin] PATH_INFO: `/v3/projects/5a6923932ddd4f7a8ca19a7a16f3c343` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:30.592811 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12003999-0831-4668-88de-7630b01a72ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a6923932ddd4f7a8ca19a7a16f3c343)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:30.595476 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12003999-0831-4668-88de-7630b01a72ea admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:30.692544 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:30.748230 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-12003999-0831-4668-88de-7630b01a72ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a6923932ddd4f7a8ca19a7a16f3c343', 'request_id': 'req-12003999-0831-4668-88de-7630b01a72ea'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:30.753982 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f869bed-5eeb-4312-8817-71f328b11f2d None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:30.763679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-12003999-0831-4668-88de-7630b01a72ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a6923932ddd4f7a8ca19a7a16f3c343', 'request_id': 'req-12003999-0831-4668-88de-7630b01a72ea'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:30.777793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-12003999-0831-4668-88de-7630b01a72ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a6923932ddd4f7a8ca19a7a16f3c343', 'request_id': 'req-12003999-0831-4668-88de-7630b01a72ea'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:30.814065 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-12003999-0831-4668-88de-7630b01a72ea admin admin] The token cache is being invalidate because project 5a6923932ddd4f7a8ca19a7a16f3c343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:36:30.814401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-12003999-0831-4668-88de-7630b01a72ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:30.816666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-12003999-0831-4668-88de-7630b01a72ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:30.825762 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 868/1707] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:36:30 2022] DELETE /identity/v3/projects/5a6923932ddd4f7a8ca19a7a16f3c343 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:30.825982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ec99-9b43-4db3-af9e-0f598274160d None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:30.826271 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ec99-9b43-4db3-af9e-0f598274160d None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:30.827457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ec99-9b43-4db3-af9e-0f598274160d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:30.878960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccc593-563b-4371-98e0-b0c2804393f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:30.879858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccc593-563b-4371-98e0-b0c2804393f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:30.880485 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccc593-563b-4371-98e0-b0c2804393f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:30.880920 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccc593-563b-4371-98e0-b0c2804393f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:30.881980 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccc593-563b-4371-98e0-b0c2804393f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:30.882785 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-4336ec99-9b43-4db3-af9e-0f598274160d None None] MFA Rules not processed for user `c52e611cab734987bea6b2c5cc48a21f`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:30.886803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccc593-563b-4371-98e0-b0c2804393f9 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:30.891009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4336ec99-9b43-4db3-af9e-0f598274160d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:30.924059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 840/1708] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:30 2022] POST /identity/v3/users => generated 279 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:30.927524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c281192-90a4-4bdd-9b42-60efb3e5a668 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:30.927811 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c281192-90a4-4bdd-9b42-60efb3e5a668 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:30.928086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c281192-90a4-4bdd-9b42-60efb3e5a668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:30.950505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-1c281192-90a4-4bdd-9b42-60efb3e5a668 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:30.951906 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1c281192-90a4-4bdd-9b42-60efb3e5a668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:30.968842 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 841/1709] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:30.974684 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2623984-e52b-44f1-a58d-6f68c8df5647 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:30.975011 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2623984-e52b-44f1-a58d-6f68c8df5647 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:30.975266 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2623984-e52b-44f1-a58d-6f68c8df5647 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:30.976692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 842/1710] 10.222.0.26 () {54 vars in 912 bytes} [Mon Sep 26 01:36:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:36:30.979187 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2623984-e52b-44f1-a58d-6f68c8df5647 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:30.987734 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 869/1711] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:30.987734 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336ec99-9b43-4db3-af9e-0f598274160d None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:30.989389 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4336ec99-9b43-4db3-af9e-0f598274160d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:30.996925 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d2623984-e52b-44f1-a58d-6f68c8df5647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:31.009965 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336ec99-9b43-4db3-af9e-0f598274160d None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:31.014796 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a5316-f423-4eea-986c-5d93403fa449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:31.015586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a5316-f423-4eea-986c-5d93403fa449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:31.015939 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a5316-f423-4eea-986c-5d93403fa449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:31.016430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a5316-f423-4eea-986c-5d93403fa449 admin admin] PATH_INFO: `/v3/users/9764e59b87e244f790ba9656c7165af0` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:31.017681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a5316-f423-4eea-986c-5d93403fa449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9764e59b87e244f790ba9656c7165af0)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:31.018904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2623984-e52b-44f1-a58d-6f68c8df5647 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:31.020412 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a5316-f423-4eea-986c-5d93403fa449 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:31.026668 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb20430-293e-4deb-bd4c-f38337333e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:31.027642 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb20430-293e-4deb-bd4c-f38337333e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:31.027916 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb20430-293e-4deb-bd4c-f38337333e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:31.028245 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb20430-293e-4deb-bd4c-f38337333e80 admin admin] PATH_INFO: `/v3/users/9445a375ce0d45e5aebf8cf10c742ce6` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:31.029600 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb20430-293e-4deb-bd4c-f38337333e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9445a375ce0d45e5aebf8cf10c742ce6)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:31.031826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb20430-293e-4deb-bd4c-f38337333e80 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:31.119959 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-aeb20430-293e-4deb-bd4c-f38337333e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9445a375ce0d45e5aebf8cf10c742ce6'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:31.120811 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-0a2a5316-f423-4eea-986c-5d93403fa449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9764e59b87e244f790ba9656c7165af0'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:31.121476 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-0a2a5316-f423-4eea-986c-5d93403fa449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9764e59b87e244f790ba9656c7165af0'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:31.121701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-aeb20430-293e-4deb-bd4c-f38337333e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9445a375ce0d45e5aebf8cf10c742ce6'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:31.122205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-0a2a5316-f423-4eea-986c-5d93403fa449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9764e59b87e244f790ba9656c7165af0'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:31.122809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-aeb20430-293e-4deb-bd4c-f38337333e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9445a375ce0d45e5aebf8cf10c742ce6'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:31.147463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-aeb20430-293e-4deb-bd4c-f38337333e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9445a375ce0d45e5aebf8cf10c742ce6'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:31.154293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:31.157748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-0a2a5316-f423-4eea-986c-5d93403fa449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9764e59b87e244f790ba9656c7165af0'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:31.166714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-aeb20430-293e-4deb-bd4c-f38337333e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9445a375ce0d45e5aebf8cf10c742ce6'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:31.177219 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-0a2a5316-f423-4eea-986c-5d93403fa449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9764e59b87e244f790ba9656c7165af0'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:31.192110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 843/1712] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:36:30 2022] DELETE /identity/v3/users/9445a375ce0d45e5aebf8cf10c742ce6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:31.193467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb20430-293e-4deb-bd4c-f38337333e80 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:31.195329 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-aeb20430-293e-4deb-bd4c-f38337333e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:31.212116 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 870/1713] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:36:30 2022] DELETE /identity/v3/users/9764e59b87e244f790ba9656c7165af0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:31.214813 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a5316-f423-4eea-986c-5d93403fa449 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:31.233841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0a2a5316-f423-4eea-986c-5d93403fa449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:31.319784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:31.409701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb20430-293e-4deb-bd4c-f38337333e80 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:31.467760 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a5316-f423-4eea-986c-5d93403fa449 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:31.485133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f06cc7-95f8-4735-aa0b-d2bd45f185a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:31.486030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f06cc7-95f8-4735-aa0b-d2bd45f185a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:31.486320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f06cc7-95f8-4735-aa0b-d2bd45f185a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:31.486602 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f06cc7-95f8-4735-aa0b-d2bd45f185a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:31.487312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f06cc7-95f8-4735-aa0b-d2bd45f185a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:36:31.487624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f06cc7-95f8-4735-aa0b-d2bd45f185a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:31.495191 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f06cc7-95f8-4735-aa0b-d2bd45f185a9 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:31.535782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 871/1714] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:36:31.537856 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06be4b-c03a-47e6-8804-49974d258035 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:31.538181 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06be4b-c03a-47e6-8804-49974d258035 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:31.538473 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06be4b-c03a-47e6-8804-49974d258035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:31.583444 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32396fa-8e50-46a8-b387-d986ce5de0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:31.584644 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32396fa-8e50-46a8-b387-d986ce5de0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:31.585093 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32396fa-8e50-46a8-b387-d986ce5de0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:31.585562 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32396fa-8e50-46a8-b387-d986ce5de0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:31.586522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32396fa-8e50-46a8-b387-d986ce5de0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:31.588397 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32396fa-8e50-46a8-b387-d986ce5de0c5 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:31.608639 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 844/1715] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:31.609831 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32396fa-8e50-46a8-b387-d986ce5de0c5 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:31.612189 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f32396fa-8e50-46a8-b387-d986ce5de0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:31.652475 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-6a06be4b-c03a-47e6-8804-49974d258035 None None] MFA Rules not processed for user `80c1005979d04c55b8746c25b0994086`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:31.654284 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6a06be4b-c03a-47e6-8804-49974d258035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:31.816410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 872/1716] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 26 01:36:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:31.825445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300dd9-39d7-45db-9ed8-e03da7f97959 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:31.825738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300dd9-39d7-45db-9ed8-e03da7f97959 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:31.826014 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300dd9-39d7-45db-9ed8-e03da7f97959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:31.834059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32396fa-8e50-46a8-b387-d986ce5de0c5 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:31.859569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0ddbc-4f27-437f-bda2-5f8036da126f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:31.860383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0ddbc-4f27-437f-bda2-5f8036da126f service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:31.861887 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0ddbc-4f27-437f-bda2-5f8036da126f service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:31.862150 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0ddbc-4f27-437f-bda2-5f8036da126f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:31.869002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-36b0ddbc-4f27-437f-bda2-5f8036da126f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:31.875802 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-91300dd9-39d7-45db-9ed8-e03da7f97959 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:31.877237 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-91300dd9-39d7-45db-9ed8-e03da7f97959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:31.892510 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 873/1717] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:31.893707 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300dd9-39d7-45db-9ed8-e03da7f97959 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:31.919539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300dd9-39d7-45db-9ed8-e03da7f97959 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:31.931746 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58477e6-29fe-475b-b2b6-0f7e20bde324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:31.932816 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58477e6-29fe-475b-b2b6-0f7e20bde324 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:31.933464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58477e6-29fe-475b-b2b6-0f7e20bde324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:31.933834 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58477e6-29fe-475b-b2b6-0f7e20bde324 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:31.934743 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58477e6-29fe-475b-b2b6-0f7e20bde324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:31.937065 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58477e6-29fe-475b-b2b6-0f7e20bde324 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:31.965351 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0ddbc-4f27-437f-bda2-5f8036da126f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:31.967114 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0ddbc-4f27-437f-bda2-5f8036da126f service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:31.978752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 845/1718] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:31 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:31.979857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0ddbc-4f27-437f-bda2-5f8036da126f service nova] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:31.981790 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-36b0ddbc-4f27-437f-bda2-5f8036da126f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:31.982921 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 874/1719] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:31 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:31.984076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58477e6-29fe-475b-b2b6-0f7e20bde324 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:31.985878 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c58477e6-29fe-475b-b2b6-0f7e20bde324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:31.999396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0ddbc-4f27-437f-bda2-5f8036da126f service nova] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:32.025721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:32.043842 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:32.101965 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58477e6-29fe-475b-b2b6-0f7e20bde324 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:32.107425 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329549aa-bf38-437e-99f7-a584d4093902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:32.108061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329549aa-bf38-437e-99f7-a584d4093902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:32.108338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329549aa-bf38-437e-99f7-a584d4093902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:32.108611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329549aa-bf38-437e-99f7-a584d4093902 admin admin] PATH_INFO: `/v3/users/832cdaff3e394070b4708964ab0cb6e6` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:32.109771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329549aa-bf38-437e-99f7-a584d4093902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=832cdaff3e394070b4708964ab0cb6e6)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:32.112707 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329549aa-bf38-437e-99f7-a584d4093902 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:32.115954 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cce7b-543e-47d4-b24b-b3b4717e61db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:32.117579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cce7b-543e-47d4-b24b-b3b4717e61db admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:32.117857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cce7b-543e-47d4-b24b-b3b4717e61db admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:32.118131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cce7b-543e-47d4-b24b-b3b4717e61db admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:32.118779 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cce7b-543e-47d4-b24b-b3b4717e61db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:32.120422 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cce7b-543e-47d4-b24b-b3b4717e61db admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:32.135313 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 846/1720] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:32.137243 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cce7b-543e-47d4-b24b-b3b4717e61db admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:32.139916 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-925cce7b-543e-47d4-b24b-b3b4717e61db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:32.186864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-329549aa-bf38-437e-99f7-a584d4093902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832cdaff3e394070b4708964ab0cb6e6'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:32.187652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-329549aa-bf38-437e-99f7-a584d4093902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832cdaff3e394070b4708964ab0cb6e6'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:32.188648 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-329549aa-bf38-437e-99f7-a584d4093902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832cdaff3e394070b4708964ab0cb6e6'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:32.212763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-329549aa-bf38-437e-99f7-a584d4093902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832cdaff3e394070b4708964ab0cb6e6'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:32.223230 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-329549aa-bf38-437e-99f7-a584d4093902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832cdaff3e394070b4708964ab0cb6e6'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:32.225390 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cce7b-543e-47d4-b24b-b3b4717e61db admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:32.232377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab5900-55ca-48d9-b2d8-5f85b198e0d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:32.233365 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab5900-55ca-48d9-b2d8-5f85b198e0d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:32.233854 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab5900-55ca-48d9-b2d8-5f85b198e0d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:32.234408 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab5900-55ca-48d9-b2d8-5f85b198e0d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:32.236864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-20ab5900-55ca-48d9-b2d8-5f85b198e0d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:32.244540 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 875/1721] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:36:31 2022] DELETE /identity/v3/users/832cdaff3e394070b4708964ab0cb6e6 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:32.246261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de067b-f6aa-4663-9b55-7d4ed73cb384 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:32.246635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de067b-f6aa-4663-9b55-7d4ed73cb384 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:32.247214 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de067b-f6aa-4663-9b55-7d4ed73cb384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:32.259815 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab5900-55ca-48d9-b2d8-5f85b198e0d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:32.261344 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab5900-55ca-48d9-b2d8-5f85b198e0d2 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:32.270229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 847/1722] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:32.271820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab5900-55ca-48d9-b2d8-5f85b198e0d2 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:32.274533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-20ab5900-55ca-48d9-b2d8-5f85b198e0d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:32.283998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-39de067b-f6aa-4663-9b55-7d4ed73cb384 None None] MFA Rules not processed for user `33b264f4cc3c4eac8944e7e2f34370f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:32.286275 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-39de067b-f6aa-4663-9b55-7d4ed73cb384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:32.291687 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab5900-55ca-48d9-b2d8-5f85b198e0d2 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:32.402892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 876/1723] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:32.402892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de067b-f6aa-4663-9b55-7d4ed73cb384 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:32.402892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-39de067b-f6aa-4663-9b55-7d4ed73cb384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:32.439725 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70229c-9ab2-4685-a523-9e780622b790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:32.440545 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70229c-9ab2-4685-a523-9e780622b790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:32.440959 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70229c-9ab2-4685-a523-9e780622b790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:32.441432 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70229c-9ab2-4685-a523-9e780622b790 admin admin] PATH_INFO: `/v3/projects/0738a562893c48d8a3dc23a9fa4dfc8a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:32.442958 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70229c-9ab2-4685-a523-9e780622b790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0738a562893c48d8a3dc23a9fa4dfc8a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:32.445679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70229c-9ab2-4685-a523-9e780622b790 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:32.522597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7c70229c-9ab2-4685-a523-9e780622b790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0738a562893c48d8a3dc23a9fa4dfc8a', 'request_id': 'req-7c70229c-9ab2-4685-a523-9e780622b790'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:32.525518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:32.529925 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de067b-f6aa-4663-9b55-7d4ed73cb384 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:32.532272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7c70229c-9ab2-4685-a523-9e780622b790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0738a562893c48d8a3dc23a9fa4dfc8a', 'request_id': 'req-7c70229c-9ab2-4685-a523-9e780622b790'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:32.549187 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7c70229c-9ab2-4685-a523-9e780622b790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0738a562893c48d8a3dc23a9fa4dfc8a', 'request_id': 'req-7c70229c-9ab2-4685-a523-9e780622b790'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:32.555022 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:32.575167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7c70229c-9ab2-4685-a523-9e780622b790 admin admin] The token cache is being invalidate because project 0738a562893c48d8a3dc23a9fa4dfc8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:36:32.575682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7c70229c-9ab2-4685-a523-9e780622b790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:32.576792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7c70229c-9ab2-4685-a523-9e780622b790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:32.579695 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 848/1724] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:36:32 2022] DELETE /identity/v3/projects/0738a562893c48d8a3dc23a9fa4dfc8a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:32.580723 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70229c-9ab2-4685-a523-9e780622b790 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:32.582212 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7c70229c-9ab2-4685-a523-9e780622b790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:32.599365 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9b1b9-f5fd-47da-97d6-60ef39bd37ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:32.599974 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9b1b9-f5fd-47da-97d6-60ef39bd37ca service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:32.600261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9b1b9-f5fd-47da-97d6-60ef39bd37ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:32.600592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9b1b9-f5fd-47da-97d6-60ef39bd37ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:32.603320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f1d9b1b9-f5fd-47da-97d6-60ef39bd37ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:32.670257 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70229c-9ab2-4685-a523-9e780622b790 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:32.675583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe474fb-2632-480f-a139-7aba4491ccc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:32.676496 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe474fb-2632-480f-a139-7aba4491ccc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:32.676987 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe474fb-2632-480f-a139-7aba4491ccc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:32.677324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe474fb-2632-480f-a139-7aba4491ccc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:32.678171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe474fb-2632-480f-a139-7aba4491ccc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:32.680948 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe474fb-2632-480f-a139-7aba4491ccc4 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:32.683503 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9b1b9-f5fd-47da-97d6-60ef39bd37ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:32.685450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9b1b9-f5fd-47da-97d6-60ef39bd37ca service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:32.702105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 877/1725] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:32.703559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9b1b9-f5fd-47da-97d6-60ef39bd37ca service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:32.705652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f1d9b1b9-f5fd-47da-97d6-60ef39bd37ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:32.710658 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 849/1726] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:32 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:32.710658 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f25c3-4b3c-40a1-9375-4a61a08777b0 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:32.710658 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f25c3-4b3c-40a1-9375-4a61a08777b0 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:32.710658 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f25c3-4b3c-40a1-9375-4a61a08777b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:32.728400 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9b1b9-f5fd-47da-97d6-60ef39bd37ca service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:32.732372 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-fb5f25c3-4b3c-40a1-9375-4a61a08777b0 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:32.733587 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-fb5f25c3-4b3c-40a1-9375-4a61a08777b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:32.736557 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee53e1-e394-45a9-847e-77d65b7da18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:32.737505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee53e1-e394-45a9-847e-77d65b7da18d admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:32.737861 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee53e1-e394-45a9-847e-77d65b7da18d admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:32.738855 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee53e1-e394-45a9-847e-77d65b7da18d admin admin] PATH_INFO: `/v3/projects/46fddd5a8d494eb59853be31f3041483/users/9976bf4001984799a4d53b581c4f5790/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:32.742469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 850/1727] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:32.743473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eddaf6-e9ca-4667-b935-06b548c74814 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:32.743921 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eddaf6-e9ca-4667-b935-06b548c74814 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:32.744255 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eddaf6-e9ca-4667-b935-06b548c74814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:32.776098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-e2eddaf6-e9ca-4667-b935-06b548c74814 None None] MFA Rules not processed for user `33b264f4cc3c4eac8944e7e2f34370f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:32.777533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e2eddaf6-e9ca-4667-b935-06b548c74814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:32.801797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee53e1-e394-45a9-847e-77d65b7da18d admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fddd5a8d494eb59853be31f3041483, user_id=9976bf4001984799a4d53b581c4f5790, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:32.814439 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee53e1-e394-45a9-847e-77d65b7da18d admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:32.843355 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 878/1728] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:32 2022] PUT /identity/v3/projects/46fddd5a8d494eb59853be31f3041483/users/9976bf4001984799a4d53b581c4f5790/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:32.846547 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8d7a0-a551-4a5c-878d-01a2e7a8e889 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:32.850104 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8d7a0-a551-4a5c-878d-01a2e7a8e889 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:32.850547 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8d7a0-a551-4a5c-878d-01a2e7a8e889 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:32.853459 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 879/1729] 10.222.0.26 () {54 vars in 912 bytes} [Mon Sep 26 01:36:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:36:32.855159 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127e37f-e139-477e-811c-e24af14e540d None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:32.855519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127e37f-e139-477e-811c-e24af14e540d None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:32.856306 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 851/1730] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:32.859473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eddaf6-e9ca-4667-b935-06b548c74814 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:32.863920 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127e37f-e139-477e-811c-e24af14e540d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:32.876045 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eddaf6-e9ca-4667-b935-06b548c74814 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:32.899172 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-7127e37f-e139-477e-811c-e24af14e540d None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:32.900688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-7127e37f-e139-477e-811c-e24af14e540d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:32.984719 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c08af-5b8a-4b41-ae8d-6d191c01c99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:32.985534 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c08af-5b8a-4b41-ae8d-6d191c01c99c admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:32.985641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c08af-5b8a-4b41-ae8d-6d191c01c99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:32.985862 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c08af-5b8a-4b41-ae8d-6d191c01c99c admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:32.986530 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c08af-5b8a-4b41-ae8d-6d191c01c99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:32.988287 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c08af-5b8a-4b41-ae8d-6d191c01c99c admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:32.997026 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 880/1731] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:32.999734 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127e37f-e139-477e-811c-e24af14e540d None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:33.001906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-7127e37f-e139-477e-811c-e24af14e540d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:33.010922 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 852/1732] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:33.012645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf2ed3-9c4f-4468-84d0-39101e229d09 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:33.012930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf2ed3-9c4f-4468-84d0-39101e229d09 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:33.013275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf2ed3-9c4f-4468-84d0-39101e229d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:33.041543 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:33.046397 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-cbaf2ed3-9c4f-4468-84d0-39101e229d09 None None] MFA Rules not processed for user `9976bf4001984799a4d53b581c4f5790`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:33.047872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-cbaf2ed3-9c4f-4468-84d0-39101e229d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:33.056758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:33.070097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127e37f-e139-477e-811c-e24af14e540d None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:33.074804 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bed65-8778-4e18-8a39-e87a19b6837a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:33.075490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bed65-8778-4e18-8a39-e87a19b6837a service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:33.075772 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bed65-8778-4e18-8a39-e87a19b6837a service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:33.076144 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bed65-8778-4e18-8a39-e87a19b6837a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:33.086647 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bed65-8778-4e18-8a39-e87a19b6837a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:33.088273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bed65-8778-4e18-8a39-e87a19b6837a service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:33.099214 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 881/1733] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:33.100402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0a0e5-63aa-4a93-9bab-9ce8c091b360 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:33.100785 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0a0e5-63aa-4a93-9bab-9ce8c091b360 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:33.101130 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0a0e5-63aa-4a93-9bab-9ce8c091b360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:33.122085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-7ad0a0e5-63aa-4a93-9bab-9ce8c091b360 None None] MFA Rules not processed for user `80c1005979d04c55b8746c25b0994086`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:33.123336 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-7ad0a0e5-63aa-4a93-9bab-9ce8c091b360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:33.128509 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 853/1734] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:33.129539 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf2ed3-9c4f-4468-84d0-39101e229d09 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:33.131000 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-cbaf2ed3-9c4f-4468-84d0-39101e229d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:33.134398 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 882/1735] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 26 01:36:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:33.135383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0a0e5-63aa-4a93-9bab-9ce8c091b360 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:33.136917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-7ad0a0e5-63aa-4a93-9bab-9ce8c091b360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:33.275880 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf2ed3-9c4f-4468-84d0-39101e229d09 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:33.286524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac4818-cb3c-42a5-834b-dfaceefb53fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7a1b839a6f4bdb9870217fa4d2527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:33.287248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac4818-cb3c-42a5-834b-dfaceefb53fb service placement] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:33.287631 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac4818-cb3c-42a5-834b-dfaceefb53fb service placement] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:33.288002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac4818-cb3c-42a5-834b-dfaceefb53fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:33.290623 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-42ac4818-cb3c-42a5-834b-dfaceefb53fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:33.307947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac4818-cb3c-42a5-834b-dfaceefb53fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:33.308652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0a0e5-63aa-4a93-9bab-9ce8c091b360 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:33.311018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac4818-cb3c-42a5-834b-dfaceefb53fb service placement] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:33.318088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545969cb-901a-4ddc-8c95-b5a2e0e58626 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:33.318088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545969cb-901a-4ddc-8c95-b5a2e0e58626 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:33.318088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545969cb-901a-4ddc-8c95-b5a2e0e58626 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:33.318088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545969cb-901a-4ddc-8c95-b5a2e0e58626 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:33.320253 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-545969cb-901a-4ddc-8c95-b5a2e0e58626 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:33.328180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 854/1736] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:33.329689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d4e66-b7f0-4544-8ef9-1d896b5e80d5 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:33.329927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d4e66-b7f0-4544-8ef9-1d896b5e80d5 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:33.330140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d4e66-b7f0-4544-8ef9-1d896b5e80d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:33.352074 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-135d4e66-b7f0-4544-8ef9-1d896b5e80d5 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:33.353481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-135d4e66-b7f0-4544-8ef9-1d896b5e80d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:33.362273 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 855/1737] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:33.363202 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d4e66-b7f0-4544-8ef9-1d896b5e80d5 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:33.374338 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d4e66-b7f0-4544-8ef9-1d896b5e80d5 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:33.379970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e1b02-6fa3-45ae-ad62-e53b8b833929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:33.380492 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e1b02-6fa3-45ae-ad62-e53b8b833929 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:33.380771 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e1b02-6fa3-45ae-ad62-e53b8b833929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:33.381045 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e1b02-6fa3-45ae-ad62-e53b8b833929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:33.382633 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e1b02-6fa3-45ae-ad62-e53b8b833929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:33.384228 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e1b02-6fa3-45ae-ad62-e53b8b833929 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:33.400916 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 856/1738] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:33.402263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e1b02-6fa3-45ae-ad62-e53b8b833929 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:33.415675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e1b02-6fa3-45ae-ad62-e53b8b833929 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:33.420535 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f689e-fb0e-434c-bbd1-f24cb3ac2413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:33.421341 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f689e-fb0e-434c-bbd1-f24cb3ac2413 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:33.421692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f689e-fb0e-434c-bbd1-f24cb3ac2413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:33.422040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f689e-fb0e-434c-bbd1-f24cb3ac2413 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:33.422916 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f689e-fb0e-434c-bbd1-f24cb3ac2413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:33.424903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f689e-fb0e-434c-bbd1-f24cb3ac2413 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:33.425022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545969cb-901a-4ddc-8c95-b5a2e0e58626 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:33.426854 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545969cb-901a-4ddc-8c95-b5a2e0e58626 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:33.438178 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 883/1739] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:33.439063 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545969cb-901a-4ddc-8c95-b5a2e0e58626 service nova] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:33.440527 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-545969cb-901a-4ddc-8c95-b5a2e0e58626 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:33.470818 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545969cb-901a-4ddc-8c95-b5a2e0e58626 service nova] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:33.479618 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe1070-69d0-4b50-9d0b-73f7efcd2c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:33.482577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 857/1740] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:33 2022] POST /identity/v3/projects => generated 355 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:33.484923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe1070-69d0-4b50-9d0b-73f7efcd2c75 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:33.485269 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe1070-69d0-4b50-9d0b-73f7efcd2c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:33.485619 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe1070-69d0-4b50-9d0b-73f7efcd2c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:33.487226 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f689e-fb0e-434c-bbd1-f24cb3ac2413 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:33.489688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-443f689e-fb0e-434c-bbd1-f24cb3ac2413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:33.503345 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe1070-69d0-4b50-9d0b-73f7efcd2c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:33.504698 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe1070-69d0-4b50-9d0b-73f7efcd2c75 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:33.525998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 884/1741] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:33.527698 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe1070-69d0-4b50-9d0b-73f7efcd2c75 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:33.580725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe1070-69d0-4b50-9d0b-73f7efcd2c75 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:33.612802 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:33.617652 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f689e-fb0e-434c-bbd1-f24cb3ac2413 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:33.625600 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce2aa0-cc9a-4644-a6ca-3fe123d23c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:33.626600 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce2aa0-cc9a-4644-a6ca-3fe123d23c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:33.626924 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce2aa0-cc9a-4644-a6ca-3fe123d23c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:33.627528 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce2aa0-cc9a-4644-a6ca-3fe123d23c9b admin admin] PATH_INFO: `/v3/projects/3fe95ca1b0644ab3bc28f674e7495f7e` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:33.628839 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce2aa0-cc9a-4644-a6ca-3fe123d23c9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fe95ca1b0644ab3bc28f674e7495f7e)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:33.630713 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce2aa0-cc9a-4644-a6ca-3fe123d23c9b admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:33.668658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:33.698795 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7582e1b-e53a-49fe-a0e4-bb290a2e0af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:33.700522 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7582e1b-e53a-49fe-a0e4-bb290a2e0af7 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:33.701719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7582e1b-e53a-49fe-a0e4-bb290a2e0af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:33.702257 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7582e1b-e53a-49fe-a0e4-bb290a2e0af7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:33.703134 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7582e1b-e53a-49fe-a0e4-bb290a2e0af7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:36:33.703621 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7582e1b-e53a-49fe-a0e4-bb290a2e0af7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:33.705413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7582e1b-e53a-49fe-a0e4-bb290a2e0af7 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:33.723351 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 885/1742] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:36:33.723351 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7582e1b-e53a-49fe-a0e4-bb290a2e0af7 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:33.737394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8dce2aa0-cc9a-4644-a6ca-3fe123d23c9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fe95ca1b0644ab3bc28f674e7495f7e', 'request_id': 'req-8dce2aa0-cc9a-4644-a6ca-3fe123d23c9b'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:33.743609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7582e1b-e53a-49fe-a0e4-bb290a2e0af7 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:33.752131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8dce2aa0-cc9a-4644-a6ca-3fe123d23c9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fe95ca1b0644ab3bc28f674e7495f7e', 'request_id': 'req-8dce2aa0-cc9a-4644-a6ca-3fe123d23c9b'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:33.765470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8dce2aa0-cc9a-4644-a6ca-3fe123d23c9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fe95ca1b0644ab3bc28f674e7495f7e', 'request_id': 'req-8dce2aa0-cc9a-4644-a6ca-3fe123d23c9b'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:33.810483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8dce2aa0-cc9a-4644-a6ca-3fe123d23c9b admin admin] The token cache is being invalidate because project 3fe95ca1b0644ab3bc28f674e7495f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:36:33.810483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8dce2aa0-cc9a-4644-a6ca-3fe123d23c9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:33.811255 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8dce2aa0-cc9a-4644-a6ca-3fe123d23c9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:33.813559 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 858/1743] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:36:33 2022] DELETE /identity/v3/projects/3fe95ca1b0644ab3bc28f674e7495f7e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:33.817710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce2aa0-cc9a-4644-a6ca-3fe123d23c9b admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:33.819369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8dce2aa0-cc9a-4644-a6ca-3fe123d23c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:33.836706 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fab7c2-a83a-46be-9ad3-3def82c34c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:33.837377 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fab7c2-a83a-46be-9ad3-3def82c34c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:33.837650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fab7c2-a83a-46be-9ad3-3def82c34c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:33.837927 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fab7c2-a83a-46be-9ad3-3def82c34c30 admin admin] PATH_INFO: `/v3/projects/835383d03b2f4e9dad6661710e5fd5c3/users/670b6c001b1f4a97a2d61ec4b4a8b8e1/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:33.865006 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fab7c2-a83a-46be-9ad3-3def82c34c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=835383d03b2f4e9dad6661710e5fd5c3, user_id=670b6c001b1f4a97a2d61ec4b4a8b8e1, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:33.869106 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fab7c2-a83a-46be-9ad3-3def82c34c30 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:33.895085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 886/1744] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:33 2022] PUT /identity/v3/projects/835383d03b2f4e9dad6661710e5fd5c3/users/670b6c001b1f4a97a2d61ec4b4a8b8e1/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:33.896151 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fab7c2-a83a-46be-9ad3-3def82c34c30 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:33.899079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e7fab7c2-a83a-46be-9ad3-3def82c34c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:33.914100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce2aa0-cc9a-4644-a6ca-3fe123d23c9b admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:34.003069 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85680dbc-2652-4e78-b951-44fef4d6cbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:34.003934 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85680dbc-2652-4e78-b951-44fef4d6cbaa admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:34.004227 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85680dbc-2652-4e78-b951-44fef4d6cbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:34.004597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85680dbc-2652-4e78-b951-44fef4d6cbaa admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:34.005241 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85680dbc-2652-4e78-b951-44fef4d6cbaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:34.006412 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fab7c2-a83a-46be-9ad3-3def82c34c30 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:34.007989 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85680dbc-2652-4e78-b951-44fef4d6cbaa admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:34.025110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd5aa9-7ba8-4524-bbf8-3bd1a76d389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:34.026046 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd5aa9-7ba8-4524-bbf8-3bd1a76d389e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:34.026451 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd5aa9-7ba8-4524-bbf8-3bd1a76d389e admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:34.026803 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd5aa9-7ba8-4524-bbf8-3bd1a76d389e admin admin] PATH_INFO: `/v3/projects/8f8511807c494cb0afb140c3e2aae135` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:34.028080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd5aa9-7ba8-4524-bbf8-3bd1a76d389e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f8511807c494cb0afb140c3e2aae135)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:34.030647 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd5aa9-7ba8-4524-bbf8-3bd1a76d389e admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:34.035945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 859/1745] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:33 2022] POST /identity/v3/users => generated 284 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:34.036826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85680dbc-2652-4e78-b951-44fef4d6cbaa admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:34.039525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-85680dbc-2652-4e78-b951-44fef4d6cbaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:34.057297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85680dbc-2652-4e78-b951-44fef4d6cbaa admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:34.069049 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6c488-60fb-44de-b26d-f9830d4db36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:34.070449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6c488-60fb-44de-b26d-f9830d4db36f admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:34.070738 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6c488-60fb-44de-b26d-f9830d4db36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:34.071441 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6c488-60fb-44de-b26d-f9830d4db36f admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:34.071808 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6c488-60fb-44de-b26d-f9830d4db36f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:34.074377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6c488-60fb-44de-b26d-f9830d4db36f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:34.101382 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9dcd5aa9-7ba8-4524-bbf8-3bd1a76d389e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f8511807c494cb0afb140c3e2aae135', 'request_id': 'req-9dcd5aa9-7ba8-4524-bbf8-3bd1a76d389e'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:34.109317 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9dcd5aa9-7ba8-4524-bbf8-3bd1a76d389e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f8511807c494cb0afb140c3e2aae135', 'request_id': 'req-9dcd5aa9-7ba8-4524-bbf8-3bd1a76d389e'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:34.118284 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 860/1746] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:34 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:34.119766 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6c488-60fb-44de-b26d-f9830d4db36f admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:34.121437 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b7b6c488-60fb-44de-b26d-f9830d4db36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:34.123359 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9dcd5aa9-7ba8-4524-bbf8-3bd1a76d389e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f8511807c494cb0afb140c3e2aae135', 'request_id': 'req-9dcd5aa9-7ba8-4524-bbf8-3bd1a76d389e'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:34.127568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:34.139943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:34.150108 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9dcd5aa9-7ba8-4524-bbf8-3bd1a76d389e admin admin] The token cache is being invalidate because project 8f8511807c494cb0afb140c3e2aae135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:36:34.150432 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9dcd5aa9-7ba8-4524-bbf8-3bd1a76d389e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:34.152171 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9dcd5aa9-7ba8-4524-bbf8-3bd1a76d389e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:34.155387 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 887/1747] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:36:33 2022] DELETE /identity/v3/projects/8f8511807c494cb0afb140c3e2aae135 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:34.161075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f617df0-72ce-4fc4-9a02-968d77cf63ba None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:34.161832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f617df0-72ce-4fc4-9a02-968d77cf63ba None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:34.162346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f617df0-72ce-4fc4-9a02-968d77cf63ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:34.223861 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-6f617df0-72ce-4fc4-9a02-968d77cf63ba None None] MFA Rules not processed for user `670b6c001b1f4a97a2d61ec4b4a8b8e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:34.225141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6f617df0-72ce-4fc4-9a02-968d77cf63ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:34.273663 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6c488-60fb-44de-b26d-f9830d4db36f admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:34.282629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d40c7-6d54-402c-aa57-71e5f25eee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:34.283521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d40c7-6d54-402c-aa57-71e5f25eee33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:34.283946 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d40c7-6d54-402c-aa57-71e5f25eee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:34.284496 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d40c7-6d54-402c-aa57-71e5f25eee33 admin admin] PATH_INFO: `/v3/users/13b75b01af4640af820b1f76924c18e8` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:34.286661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d40c7-6d54-402c-aa57-71e5f25eee33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b75b01af4640af820b1f76924c18e8)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:34.290174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d40c7-6d54-402c-aa57-71e5f25eee33 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:34.374140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9c6d40c7-6d54-402c-aa57-71e5f25eee33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b75b01af4640af820b1f76924c18e8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:34.375461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9c6d40c7-6d54-402c-aa57-71e5f25eee33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b75b01af4640af820b1f76924c18e8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:34.376704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9c6d40c7-6d54-402c-aa57-71e5f25eee33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b75b01af4640af820b1f76924c18e8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:34.381222 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 888/1748] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:34.381222 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f617df0-72ce-4fc4-9a02-968d77cf63ba None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:34.398207 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9c6d40c7-6d54-402c-aa57-71e5f25eee33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b75b01af4640af820b1f76924c18e8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:34.410627 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6f617df0-72ce-4fc4-9a02-968d77cf63ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:34.416455 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9c6d40c7-6d54-402c-aa57-71e5f25eee33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b75b01af4640af820b1f76924c18e8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:34.472429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f617df0-72ce-4fc4-9a02-968d77cf63ba None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:34.483627 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 861/1749] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:36:34 2022] DELETE /identity/v3/users/13b75b01af4640af820b1f76924c18e8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:34.487815 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d40c7-6d54-402c-aa57-71e5f25eee33 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:34.495580 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-9c6d40c7-6d54-402c-aa57-71e5f25eee33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:34.637727 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ede221-05c0-43af-8aa3-8bc92735a6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:34.637938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ede221-05c0-43af-8aa3-8bc92735a6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:34.638167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ede221-05c0-43af-8aa3-8bc92735a6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:34.638446 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ede221-05c0-43af-8aa3-8bc92735a6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:34.647082 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ede221-05c0-43af-8aa3-8bc92735a6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:34.649380 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ede221-05c0-43af-8aa3-8bc92735a6b6 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:34.687110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 889/1750] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:34.688431 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bc218-098b-4ff8-8d9a-59972da9da51 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:34.688721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bc218-098b-4ff8-8d9a-59972da9da51 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:34.688999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bc218-098b-4ff8-8d9a-59972da9da51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:34.743769 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-076bc218-098b-4ff8-8d9a-59972da9da51 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:34.751212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-076bc218-098b-4ff8-8d9a-59972da9da51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:34.777056 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d40c7-6d54-402c-aa57-71e5f25eee33 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:34.777818 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 890/1751] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:34.779383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bc218-098b-4ff8-8d9a-59972da9da51 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:34.781219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029e150-a26b-4291-a951-277a9e39ec13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:34.781849 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029e150-a26b-4291-a951-277a9e39ec13 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:34.782119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029e150-a26b-4291-a951-277a9e39ec13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:34.782383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029e150-a26b-4291-a951-277a9e39ec13 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:34.782761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-076bc218-098b-4ff8-8d9a-59972da9da51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:34.783154 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029e150-a26b-4291-a951-277a9e39ec13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:34.791328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029e150-a26b-4291-a951-277a9e39ec13 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:34.824011 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 862/1752] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:34 2022] POST /identity/v3/users => generated 288 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:34.824011 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029e150-a26b-4291-a951-277a9e39ec13 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:34.824422 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a029e150-a26b-4291-a951-277a9e39ec13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:34.837344 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bc218-098b-4ff8-8d9a-59972da9da51 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:34.854646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6e5f7-dc39-42ff-9fd7-11e597fbd3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:34.856170 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6e5f7-dc39-42ff-9fd7-11e597fbd3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:34.856553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6e5f7-dc39-42ff-9fd7-11e597fbd3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:34.856939 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6e5f7-dc39-42ff-9fd7-11e597fbd3d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:34.857714 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed6e5f7-dc39-42ff-9fd7-11e597fbd3d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:34.859859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed6e5f7-dc39-42ff-9fd7-11e597fbd3d4 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:34.895515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029e150-a26b-4291-a951-277a9e39ec13 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:34.916624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc14933-bd6c-4886-a39c-62aaf188101b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:34.923402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc14933-bd6c-4886-a39c-62aaf188101b admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:34.923988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc14933-bd6c-4886-a39c-62aaf188101b admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:34.924459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc14933-bd6c-4886-a39c-62aaf188101b admin admin] PATH_INFO: `/v3/projects/53c9ebd6985f4f86994e84e4dff880aa/users/673e9d23317542f880fb8c2c1853e9b7/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:34.962022 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:34.981847 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc14933-bd6c-4886-a39c-62aaf188101b admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c9ebd6985f4f86994e84e4dff880aa, user_id=673e9d23317542f880fb8c2c1853e9b7, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:34.994724 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 891/1753] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:34 2022] POST /identity/v3/projects => generated 387 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:34.996472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc14933-bd6c-4886-a39c-62aaf188101b admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:35.001534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e32282-61ad-4eae-877c-47d80894faee None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:35.001821 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e32282-61ad-4eae-877c-47d80894faee None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:35.002174 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e32282-61ad-4eae-877c-47d80894faee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:35.041556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 863/1754] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:34 2022] PUT /identity/v3/projects/53c9ebd6985f4f86994e84e4dff880aa/users/673e9d23317542f880fb8c2c1853e9b7/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:35.046730 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc14933-bd6c-4886-a39c-62aaf188101b admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:35.077220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-27e32282-61ad-4eae-877c-47d80894faee None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:35.083045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-27e32282-61ad-4eae-877c-47d80894faee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:35.247120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc14933-bd6c-4886-a39c-62aaf188101b admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:35.249847 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:35.264653 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36978615-53e9-4616-967b-3ac3df02e083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:35.266370 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36978615-53e9-4616-967b-3ac3df02e083 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:35.266646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36978615-53e9-4616-967b-3ac3df02e083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:35.267907 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36978615-53e9-4616-967b-3ac3df02e083 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:35.270767 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36978615-53e9-4616-967b-3ac3df02e083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:35.274799 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36978615-53e9-4616-967b-3ac3df02e083 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:35.277604 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 892/1755] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:35.279506 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd5295-c0b9-4f63-846e-2fe116ecba6e None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:35.279789 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd5295-c0b9-4f63-846e-2fe116ecba6e None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:35.280061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd5295-c0b9-4f63-846e-2fe116ecba6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:35.302437 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 864/1756] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:35.305152 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36978615-53e9-4616-967b-3ac3df02e083 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:35.328508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36978615-53e9-4616-967b-3ac3df02e083 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:35.338164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-aefd5295-c0b9-4f63-846e-2fe116ecba6e None None] MFA Rules not processed for user `c52e611cab734987bea6b2c5cc48a21f`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:35.339699 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-aefd5295-c0b9-4f63-846e-2fe116ecba6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:35.360245 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee5358-d8cf-4828-bc7f-d1aef0010edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:35.361866 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee5358-d8cf-4828-bc7f-d1aef0010edd admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:35.362954 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee5358-d8cf-4828-bc7f-d1aef0010edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:35.363233 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee5358-d8cf-4828-bc7f-d1aef0010edd admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:35.364387 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee5358-d8cf-4828-bc7f-d1aef0010edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:35.371140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee5358-d8cf-4828-bc7f-d1aef0010edd admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:35.440182 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 865/1757] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:35 2022] POST /identity/v3/users => generated 300 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:35.441261 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee5358-d8cf-4828-bc7f-d1aef0010edd admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:35.474073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee5358-d8cf-4828-bc7f-d1aef0010edd admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:35.485283 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e2d83-3fa6-4707-b378-f27034e55330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:35.486742 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e2d83-3fa6-4707-b378-f27034e55330 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:35.487107 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e2d83-3fa6-4707-b378-f27034e55330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:35.487320 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e2d83-3fa6-4707-b378-f27034e55330 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:35.487978 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e2d83-3fa6-4707-b378-f27034e55330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:35.489579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e2d83-3fa6-4707-b378-f27034e55330 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:35.492921 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 893/1758] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:35.493980 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd5295-c0b9-4f63-846e-2fe116ecba6e None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:35.509195 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd5295-c0b9-4f63-846e-2fe116ecba6e None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:35.525948 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc9f39-7b64-4199-a189-16de09fd3f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:35.526572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc9f39-7b64-4199-a189-16de09fd3f4e admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:35.526881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc9f39-7b64-4199-a189-16de09fd3f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:35.527128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc9f39-7b64-4199-a189-16de09fd3f4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:35.527782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc9f39-7b64-4199-a189-16de09fd3f4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:36:35.529513 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc9f39-7b64-4199-a189-16de09fd3f4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:35.533460 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc9f39-7b64-4199-a189-16de09fd3f4e admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:35.549643 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 866/1759] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:35.558033 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e2d83-3fa6-4707-b378-f27034e55330 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:35.571208 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 894/1760] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:36:35.572535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc9f39-7b64-4199-a189-16de09fd3f4e admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:35.576721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-05dc9f39-7b64-4199-a189-16de09fd3f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:35.582327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e2d83-3fa6-4707-b378-f27034e55330 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:35.592154 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2faee-b9aa-4660-bf7a-d32c0d6769d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:35.592998 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2faee-b9aa-4660-bf7a-d32c0d6769d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:35.593382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2faee-b9aa-4660-bf7a-d32c0d6769d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:35.593756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2faee-b9aa-4660-bf7a-d32c0d6769d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:35.594694 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2faee-b9aa-4660-bf7a-d32c0d6769d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:35.622276 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2faee-b9aa-4660-bf7a-d32c0d6769d3 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:35.622628 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc9f39-7b64-4199-a189-16de09fd3f4e admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:35.636188 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92d109-9dc4-4955-9220-859c2f8e8f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:35.636841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92d109-9dc4-4955-9220-859c2f8e8f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:35.637116 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92d109-9dc4-4955-9220-859c2f8e8f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:35.642548 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92d109-9dc4-4955-9220-859c2f8e8f9f admin admin] PATH_INFO: `/v3/projects/42bb5f181b844399a5233b3f2643aca8` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:35.645482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 867/1761] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:35.647340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92d109-9dc4-4955-9220-859c2f8e8f9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=42bb5f181b844399a5233b3f2643aca8)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:35.647746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2faee-b9aa-4660-bf7a-d32c0d6769d3 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:35.649663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92d109-9dc4-4955-9220-859c2f8e8f9f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:35.660810 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2faee-b9aa-4660-bf7a-d32c0d6769d3 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:35.669156 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bec91-7c5d-4bd7-bc72-a1188bce3a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:35.669924 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bec91-7c5d-4bd7-bc72-a1188bce3a64 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:35.670273 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bec91-7c5d-4bd7-bc72-a1188bce3a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:35.670674 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bec91-7c5d-4bd7-bc72-a1188bce3a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:35.671756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03bec91-7c5d-4bd7-bc72-a1188bce3a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:35.673843 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03bec91-7c5d-4bd7-bc72-a1188bce3a64 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:35.696133 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 868/1762] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:35.696133 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bec91-7c5d-4bd7-bc72-a1188bce3a64 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:35.720723 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bec91-7c5d-4bd7-bc72-a1188bce3a64 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:35.739985 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021264d7-ed01-4b26-bddf-513ded5a4d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:35.741691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021264d7-ed01-4b26-bddf-513ded5a4d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:35.742379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021264d7-ed01-4b26-bddf-513ded5a4d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:35.742379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021264d7-ed01-4b26-bddf-513ded5a4d8a admin admin] PATH_INFO: `/v3/projects/53c9ebd6985f4f86994e84e4dff880aa/users/673e9d23317542f880fb8c2c1853e9b7/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:35.760868 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021264d7-ed01-4b26-bddf-513ded5a4d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c9ebd6985f4f86994e84e4dff880aa, user_id=673e9d23317542f880fb8c2c1853e9b7, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:35.768591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021264d7-ed01-4b26-bddf-513ded5a4d8a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:35.770469 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-3f92d109-9dc4-4955-9220-859c2f8e8f9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42bb5f181b844399a5233b3f2643aca8', 'request_id': 'req-3f92d109-9dc4-4955-9220-859c2f8e8f9f'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:35.791145 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-3f92d109-9dc4-4955-9220-859c2f8e8f9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42bb5f181b844399a5233b3f2643aca8', 'request_id': 'req-3f92d109-9dc4-4955-9220-859c2f8e8f9f'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:35.797771 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 869/1763] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:35 2022] PUT /identity/v3/projects/53c9ebd6985f4f86994e84e4dff880aa/users/673e9d23317542f880fb8c2c1853e9b7/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:35.798721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021264d7-ed01-4b26-bddf-513ded5a4d8a admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:35.816833 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-3f92d109-9dc4-4955-9220-859c2f8e8f9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42bb5f181b844399a5233b3f2643aca8', 'request_id': 'req-3f92d109-9dc4-4955-9220-859c2f8e8f9f'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:35.841591 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-3f92d109-9dc4-4955-9220-859c2f8e8f9f admin admin] The token cache is being invalidate because project 42bb5f181b844399a5233b3f2643aca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:36:35.842419 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-3f92d109-9dc4-4955-9220-859c2f8e8f9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:35.843422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-3f92d109-9dc4-4955-9220-859c2f8e8f9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:35.845862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 895/1764] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:36:35 2022] DELETE /identity/v3/projects/42bb5f181b844399a5233b3f2643aca8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:35.847188 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92d109-9dc4-4955-9220-859c2f8e8f9f admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:35.851200 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-3f92d109-9dc4-4955-9220-859c2f8e8f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:35.956271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021264d7-ed01-4b26-bddf-513ded5a4d8a admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:35.974759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477daac3-3f95-4585-afb2-d2b2bcd407c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:35.975495 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477daac3-3f95-4585-afb2-d2b2bcd407c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:35.975908 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477daac3-3f95-4585-afb2-d2b2bcd407c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:35.976250 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477daac3-3f95-4585-afb2-d2b2bcd407c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:35.979626 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477daac3-3f95-4585-afb2-d2b2bcd407c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:35.981687 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477daac3-3f95-4585-afb2-d2b2bcd407c0 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:36.016990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92d109-9dc4-4955-9220-859c2f8e8f9f admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:36.039709 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc12698-e337-4a78-bda1-913c49b4b3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:36.043881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc12698-e337-4a78-bda1-913c49b4b3ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:36.044171 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc12698-e337-4a78-bda1-913c49b4b3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:36.045717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc12698-e337-4a78-bda1-913c49b4b3ed admin admin] PATH_INFO: `/v3/projects/a35adfa02a064f32b9500f00f0c32cea/users/8bd4e77e6c2f4847a8ed1fc8779aca7e/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:36.081039 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 870/1765] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:35 2022] POST /identity/v3/projects => generated 405 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:36.083335 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477daac3-3f95-4585-afb2-d2b2bcd407c0 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:36.091309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-477daac3-3f95-4585-afb2-d2b2bcd407c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:36.097739 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc12698-e337-4a78-bda1-913c49b4b3ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a35adfa02a064f32b9500f00f0c32cea, user_id=8bd4e77e6c2f4847a8ed1fc8779aca7e, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:36.103865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc12698-e337-4a78-bda1-913c49b4b3ed admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:36.104171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:36.109217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:36.150777 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 896/1766] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:35 2022] PUT /identity/v3/projects/a35adfa02a064f32b9500f00f0c32cea/users/8bd4e77e6c2f4847a8ed1fc8779aca7e/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:36.155058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a2044-5d6e-4b1d-a2a1-c6b5f8a05f64 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:36.155584 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a2044-5d6e-4b1d-a2a1-c6b5f8a05f64 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:36.156098 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a2044-5d6e-4b1d-a2a1-c6b5f8a05f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:36.283620 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477daac3-3f95-4585-afb2-d2b2bcd407c0 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:36.366085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-7e0a2044-5d6e-4b1d-a2a1-c6b5f8a05f64 None None] MFA Rules not processed for user `673e9d23317542f880fb8c2c1853e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:36.373788 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-7e0a2044-5d6e-4b1d-a2a1-c6b5f8a05f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:36.431997 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae3c67-b244-46d3-b79a-d333279f96c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:36.432678 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae3c67-b244-46d3-b79a-d333279f96c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:36.432954 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae3c67-b244-46d3-b79a-d333279f96c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:36.433225 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae3c67-b244-46d3-b79a-d333279f96c0 admin admin] PATH_INFO: `/v3/projects/9da3fef73f98481d9880a3a4a66a452f/users/4684686df52e43fb88cd46b071fe224a/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:36.479967 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae3c67-b244-46d3-b79a-d333279f96c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da3fef73f98481d9880a3a4a66a452f, user_id=4684686df52e43fb88cd46b071fe224a, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:36.483702 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae3c67-b244-46d3-b79a-d333279f96c0 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:36.509647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 871/1767] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:36 2022] PUT /identity/v3/projects/9da3fef73f98481d9880a3a4a66a452f/users/4684686df52e43fb88cd46b071fe224a/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:36.512121 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaab797-9151-4bc0-96fb-fbe4bb2775cb None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:36.516435 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaab797-9151-4bc0-96fb-fbe4bb2775cb None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:36.516891 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaab797-9151-4bc0-96fb-fbe4bb2775cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:36.567905 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-4aaab797-9151-4bc0-96fb-fbe4bb2775cb None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:36.569408 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4aaab797-9151-4bc0-96fb-fbe4bb2775cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:36.618706 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 897/1768] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:36 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:36.619705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a2044-5d6e-4b1d-a2a1-c6b5f8a05f64 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:36.623266 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-7e0a2044-5d6e-4b1d-a2a1-c6b5f8a05f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:36.656319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a2044-5d6e-4b1d-a2a1-c6b5f8a05f64 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:36.755848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 872/1769] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:36.758367 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64cd1a-0564-4fc2-9d5f-9c7731eeed2f None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:36.758702 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64cd1a-0564-4fc2-9d5f-9c7731eeed2f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:36.759005 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64cd1a-0564-4fc2-9d5f-9c7731eeed2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:36.812570 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fb2b7-ca27-4f73-bfe2-846c4b394858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:36.813444 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fb2b7-ca27-4f73-bfe2-846c4b394858 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:36.813727 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fb2b7-ca27-4f73-bfe2-846c4b394858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:36.814006 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fb2b7-ca27-4f73-bfe2-846c4b394858 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:36.814654 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fb2b7-ca27-4f73-bfe2-846c4b394858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:36.816929 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fb2b7-ca27-4f73-bfe2-846c4b394858 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:36.831995 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-8a64cd1a-0564-4fc2-9d5f-9c7731eeed2f None None] MFA Rules not processed for user `8bd4e77e6c2f4847a8ed1fc8779aca7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:36.833171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8a64cd1a-0564-4fc2-9d5f-9c7731eeed2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:36.875868 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 898/1770] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:36 2022] POST /identity/v3/users => generated 303 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:36.876721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fb2b7-ca27-4f73-bfe2-846c4b394858 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:36.886868 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:36.906735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fb2b7-ca27-4f73-bfe2-846c4b394858 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:36.920435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36bba4-a543-4c36-a248-11ed5db2068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:36.921073 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36bba4-a543-4c36-a248-11ed5db2068d admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:36.921767 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36bba4-a543-4c36-a248-11ed5db2068d admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:36.922249 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36bba4-a543-4c36-a248-11ed5db2068d admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:36.923112 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36bba4-a543-4c36-a248-11ed5db2068d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:36.924724 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36bba4-a543-4c36-a248-11ed5db2068d admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:36.951202 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 899/1771] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:36.951901 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36bba4-a543-4c36-a248-11ed5db2068d admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:36.963969 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4a36bba4-a543-4c36-a248-11ed5db2068d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:36.984098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 873/1772] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:36.984098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f6036-0738-4da3-908c-496ca46bcc88 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:36.984098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f6036-0738-4da3-908c-496ca46bcc88 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:36.986724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f6036-0738-4da3-908c-496ca46bcc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:37.051671 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-1d4f6036-0738-4da3-908c-496ca46bcc88 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:37.052888 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1d4f6036-0738-4da3-908c-496ca46bcc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:37.079724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 874/1773] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:37.080658 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f6036-0738-4da3-908c-496ca46bcc88 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:37.094517 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f6036-0738-4da3-908c-496ca46bcc88 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:37.104591 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36bba4-a543-4c36-a248-11ed5db2068d admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:37.108826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341e0ec-e59c-4088-95d2-853064c9f600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:37.109393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341e0ec-e59c-4088-95d2-853064c9f600 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:37.109727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341e0ec-e59c-4088-95d2-853064c9f600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:37.110082 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341e0ec-e59c-4088-95d2-853064c9f600 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:37.110681 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341e0ec-e59c-4088-95d2-853064c9f600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:37.112324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341e0ec-e59c-4088-95d2-853064c9f600 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:37.125887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076abe0e-d1ac-47fb-87fb-79e949ef624a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:37.126524 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076abe0e-d1ac-47fb-87fb-79e949ef624a service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:37.126804 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076abe0e-d1ac-47fb-87fb-79e949ef624a service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:37.127104 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076abe0e-d1ac-47fb-87fb-79e949ef624a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:37.134725 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 875/1774] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:37.135519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341e0ec-e59c-4088-95d2-853064c9f600 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:37.146936 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:37.160978 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341e0ec-e59c-4088-95d2-853064c9f600 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:37.171786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48991ca7-772b-4076-a0d8-ef2430ddad55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:37.172944 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48991ca7-772b-4076-a0d8-ef2430ddad55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:37.173438 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48991ca7-772b-4076-a0d8-ef2430ddad55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:37.173755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48991ca7-772b-4076-a0d8-ef2430ddad55 admin admin] PATH_INFO: `/v3/projects/9da3fef73f98481d9880a3a4a66a452f/users/4684686df52e43fb88cd46b071fe224a/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:37.182407 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48991ca7-772b-4076-a0d8-ef2430ddad55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da3fef73f98481d9880a3a4a66a452f, user_id=4684686df52e43fb88cd46b071fe224a, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:37.185283 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48991ca7-772b-4076-a0d8-ef2430ddad55 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:37.212280 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 876/1775] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:37 2022] PUT /identity/v3/projects/9da3fef73f98481d9880a3a4a66a452f/users/4684686df52e43fb88cd46b071fe224a/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:37.223171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48991ca7-772b-4076-a0d8-ef2430ddad55 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:37.261992 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076abe0e-d1ac-47fb-87fb-79e949ef624a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:37.263623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076abe0e-d1ac-47fb-87fb-79e949ef624a service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:37.291858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 900/1776] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:36 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:37.304135 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bdc4b-4ede-4a92-ab13-2862080adc58 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:37.304419 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bdc4b-4ede-4a92-ab13-2862080adc58 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:37.304754 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bdc4b-4ede-4a92-ab13-2862080adc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:37.307947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48991ca7-772b-4076-a0d8-ef2430ddad55 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:37.314284 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0b54d-dcda-47ba-8381-7bfd2621ea56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:37.315428 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0b54d-dcda-47ba-8381-7bfd2621ea56 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:37.315428 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0b54d-dcda-47ba-8381-7bfd2621ea56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:37.315819 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0b54d-dcda-47ba-8381-7bfd2621ea56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:37.316587 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0b54d-dcda-47ba-8381-7bfd2621ea56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:37.318901 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0b54d-dcda-47ba-8381-7bfd2621ea56 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:37.375946 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 877/1777] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:37 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:37.376957 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0b54d-dcda-47ba-8381-7bfd2621ea56 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:37.506624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-6f7bdc4b-4ede-4a92-ab13-2862080adc58 None None] MFA Rules not processed for user `6f4696c410f343709be200dee463bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:37.516527 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6f7bdc4b-4ede-4a92-ab13-2862080adc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:37.540253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0b54d-dcda-47ba-8381-7bfd2621ea56 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:37.567079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c30c6-0750-447d-925b-d949f5655664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:37.568206 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c30c6-0750-447d-925b-d949f5655664 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:37.568490 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c30c6-0750-447d-925b-d949f5655664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:37.568768 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c30c6-0750-447d-925b-d949f5655664 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:37.569980 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c30c6-0750-447d-925b-d949f5655664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:36:37.579005 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c30c6-0750-447d-925b-d949f5655664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:37.580805 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c30c6-0750-447d-925b-d949f5655664 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:37.629061 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 878/1778] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:36:37.630220 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c30c6-0750-447d-925b-d949f5655664 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:37.667250 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c30c6-0750-447d-925b-d949f5655664 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:37.688844 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedb701-65d5-4d76-9fc6-7d7843268ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:37.689187 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedb701-65d5-4d76-9fc6-7d7843268ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:37.689384 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedb701-65d5-4d76-9fc6-7d7843268ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:37.689660 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedb701-65d5-4d76-9fc6-7d7843268ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:37.690307 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedb701-65d5-4d76-9fc6-7d7843268ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:37.692133 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedb701-65d5-4d76-9fc6-7d7843268ed9 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:37.696971 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 901/1779] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 26 01:36:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:37.701986 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a16779-667e-4a74-9ea8-d804ad61892e None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:37.702303 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a16779-667e-4a74-9ea8-d804ad61892e None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:37.702577 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a16779-667e-4a74-9ea8-d804ad61892e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:37.718460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 879/1780] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:37.719343 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedb701-65d5-4d76-9fc6-7d7843268ed9 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:37.729706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:37.741455 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedb701-65d5-4d76-9fc6-7d7843268ed9 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:37.764436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297e9a8-7f4d-40d8-acb5-20bad7923f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:37.765067 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297e9a8-7f4d-40d8-acb5-20bad7923f1c admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:37.765348 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297e9a8-7f4d-40d8-acb5-20bad7923f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:37.765618 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297e9a8-7f4d-40d8-acb5-20bad7923f1c admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:37.766274 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297e9a8-7f4d-40d8-acb5-20bad7923f1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:37.770085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-d5a16779-667e-4a74-9ea8-d804ad61892e None None] MFA Rules not processed for user `4684686df52e43fb88cd46b071fe224a`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:37.770237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297e9a8-7f4d-40d8-acb5-20bad7923f1c admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:37.772467 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d5a16779-667e-4a74-9ea8-d804ad61892e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:37.839309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 880/1781] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:37 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:37.842604 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297e9a8-7f4d-40d8-acb5-20bad7923f1c admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:37.983150 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297e9a8-7f4d-40d8-acb5-20bad7923f1c admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:37.989200 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bac4f1-07e8-4465-89d6-46575ccfaa5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:37.989824 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bac4f1-07e8-4465-89d6-46575ccfaa5d service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:37.990101 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bac4f1-07e8-4465-89d6-46575ccfaa5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:37.990376 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bac4f1-07e8-4465-89d6-46575ccfaa5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:37.996377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d2bac4f1-07e8-4465-89d6-46575ccfaa5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:38.001069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 902/1782] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:38.011460 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a16779-667e-4a74-9ea8-d804ad61892e None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:38.030906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:38.041952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a16779-667e-4a74-9ea8-d804ad61892e None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:38.065270 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2234f97-69e3-4091-ba08-c74d5b54d0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:38.066286 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2234f97-69e3-4091-ba08-c74d5b54d0dc admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:38.066677 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2234f97-69e3-4091-ba08-c74d5b54d0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:38.067035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2234f97-69e3-4091-ba08-c74d5b54d0dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:38.067749 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2234f97-69e3-4091-ba08-c74d5b54d0dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:38.070458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2234f97-69e3-4091-ba08-c74d5b54d0dc admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:38.143185 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 903/1783] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:38 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:38.144600 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2234f97-69e3-4091-ba08-c74d5b54d0dc admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:38.149772 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bac4f1-07e8-4465-89d6-46575ccfaa5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:38.153689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bac4f1-07e8-4465-89d6-46575ccfaa5d service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:38.176955 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 881/1784] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:38.177938 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bac4f1-07e8-4465-89d6-46575ccfaa5d service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:38.202050 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bac4f1-07e8-4465-89d6-46575ccfaa5d service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:38.277069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2234f97-69e3-4091-ba08-c74d5b54d0dc admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:38.285859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8cf37-3b28-4008-b006-82786e08f966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:38.287202 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8cf37-3b28-4008-b006-82786e08f966 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:38.287202 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8cf37-3b28-4008-b006-82786e08f966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:38.288688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8cf37-3b28-4008-b006-82786e08f966 admin admin] PATH_INFO: `/v3/projects/89f0f562e02648159c811a3bd6078638/users/d6cf9f85df6b48e1a4ced8a647785b14/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:38.346139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71441bd8-1382-41eb-ba8e-f46312b2aeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:38.348210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8cf37-3b28-4008-b006-82786e08f966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f0f562e02648159c811a3bd6078638, user_id=d6cf9f85df6b48e1a4ced8a647785b14, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:38.348859 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441bd8-1382-41eb-ba8e-f46312b2aeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:38.350906 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441bd8-1382-41eb-ba8e-f46312b2aeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:38.350906 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441bd8-1382-41eb-ba8e-f46312b2aeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:38.352395 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71441bd8-1382-41eb-ba8e-f46312b2aeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:38.359497 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8cf37-3b28-4008-b006-82786e08f966 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:38.361314 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71441bd8-1382-41eb-ba8e-f46312b2aeb8 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:38.417523 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 882/1785] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:38.418561 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71441bd8-1382-41eb-ba8e-f46312b2aeb8 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:38.422384 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 904/1786] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:38 2022] PUT /identity/v3/projects/89f0f562e02648159c811a3bd6078638/users/d6cf9f85df6b48e1a4ced8a647785b14/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:38.422384 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8cf37-3b28-4008-b006-82786e08f966 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:38.426043 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-54e8cf37-3b28-4008-b006-82786e08f966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:38.426606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-71441bd8-1382-41eb-ba8e-f46312b2aeb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:38.540543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:38.610247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71441bd8-1382-41eb-ba8e-f46312b2aeb8 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:38.747063 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8cf37-3b28-4008-b006-82786e08f966 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:38.770104 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9bc9e-8d99-4ca0-988a-c77e3d71bf46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c924da83d1a94c49814d2e7b5969c8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:38.770893 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9bc9e-8d99-4ca0-988a-c77e3d71bf46 service swift] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:38.773419 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9bc9e-8d99-4ca0-988a-c77e3d71bf46 service swift] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:38.773816 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9bc9e-8d99-4ca0-988a-c77e3d71bf46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:38.806389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53deae80-cf4d-4e6a-87cd-f22b7204af83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:38.807208 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53deae80-cf4d-4e6a-87cd-f22b7204af83 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:38.809407 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53deae80-cf4d-4e6a-87cd-f22b7204af83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:38.809793 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53deae80-cf4d-4e6a-87cd-f22b7204af83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:38.879275 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:38.906016 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9bc9e-8d99-4ca0-988a-c77e3d71bf46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:38.910821 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9bc9e-8d99-4ca0-988a-c77e3d71bf46 service swift] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:38.930490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 905/1787] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 26 01:36:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 01:36:38.933333 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9bc9e-8d99-4ca0-988a-c77e3d71bf46 service swift] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:38.945013 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53deae80-cf4d-4e6a-87cd-f22b7204af83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:38.950922 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53deae80-cf4d-4e6a-87cd-f22b7204af83 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:39.005066 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 883/1788] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:39.006132 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53deae80-cf4d-4e6a-87cd-f22b7204af83 service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:39.185249 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9bc9e-8d99-4ca0-988a-c77e3d71bf46 service swift] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:39.195487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7486420-062c-4ea9-9877-ee2ece598941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:39.196113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7486420-062c-4ea9-9877-ee2ece598941 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:39.197441 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7486420-062c-4ea9-9877-ee2ece598941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:39.197842 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7486420-062c-4ea9-9877-ee2ece598941 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:39.198528 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7486420-062c-4ea9-9877-ee2ece598941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:39.202132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7486420-062c-4ea9-9877-ee2ece598941 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:39.236927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53deae80-cf4d-4e6a-87cd-f22b7204af83 service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:39.251315 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132694d-52ba-4a03-8c3b-48e18b9af3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:39.252442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132694d-52ba-4a03-8c3b-48e18b9af3a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:39.252915 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132694d-52ba-4a03-8c3b-48e18b9af3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:39.253363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132694d-52ba-4a03-8c3b-48e18b9af3a9 admin admin] PATH_INFO: `/v3/projects/5fafb45a6c9147a0accceaa92415d96c/users/b4ed7088cf7f405eaac21c05d512a759/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:39.260579 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 906/1789] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:38 2022] POST /identity/v3/users => generated 283 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:39.267496 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975a18f-291a-4928-904a-368c4a4d3579 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:39.268036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975a18f-291a-4928-904a-368c4a4d3579 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:39.268376 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975a18f-291a-4928-904a-368c4a4d3579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:39.297748 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132694d-52ba-4a03-8c3b-48e18b9af3a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fafb45a6c9147a0accceaa92415d96c, user_id=b4ed7088cf7f405eaac21c05d512a759, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:39.300671 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132694d-52ba-4a03-8c3b-48e18b9af3a9 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:39.331617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-0975a18f-291a-4928-904a-368c4a4d3579 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:39.334397 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0975a18f-291a-4928-904a-368c4a4d3579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:39.363859 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 884/1790] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:39 2022] PUT /identity/v3/projects/5fafb45a6c9147a0accceaa92415d96c/users/b4ed7088cf7f405eaac21c05d512a759/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:39.366123 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132694d-52ba-4a03-8c3b-48e18b9af3a9 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:39.455326 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:39.528111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132694d-52ba-4a03-8c3b-48e18b9af3a9 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:39.541250 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba27fea-ec63-4675-aa7e-ba1732ddc2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:39.542077 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba27fea-ec63-4675-aa7e-ba1732ddc2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:39.542447 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba27fea-ec63-4675-aa7e-ba1732ddc2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:39.542888 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba27fea-ec63-4675-aa7e-ba1732ddc2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:39.543651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba27fea-ec63-4675-aa7e-ba1732ddc2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:39.546469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba27fea-ec63-4675-aa7e-ba1732ddc2e7 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:39.569700 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 907/1791] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:39.574415 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975a18f-291a-4928-904a-368c4a4d3579 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:39.595229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 885/1792] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:39.607944 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba27fea-ec63-4675-aa7e-ba1732ddc2e7 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:39.610715 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975a18f-291a-4928-904a-368c4a4d3579 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:39.636429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9209d15-9b90-4aff-af9a-8426a749ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:39.641198 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9209d15-9b90-4aff-af9a-8426a749ee6b admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:39.644639 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9209d15-9b90-4aff-af9a-8426a749ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:39.646214 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9209d15-9b90-4aff-af9a-8426a749ee6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:39.647071 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9209d15-9b90-4aff-af9a-8426a749ee6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:39.649140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba27fea-ec63-4675-aa7e-ba1732ddc2e7 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:39.650960 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9209d15-9b90-4aff-af9a-8426a749ee6b admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:39.670245 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953bfa4-34cc-45a0-93fd-40ae36e0652c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:39.671062 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953bfa4-34cc-45a0-93fd-40ae36e0652c admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:39.671763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953bfa4-34cc-45a0-93fd-40ae36e0652c admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:39.675076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953bfa4-34cc-45a0-93fd-40ae36e0652c admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:39.675894 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953bfa4-34cc-45a0-93fd-40ae36e0652c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:39.682008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953bfa4-34cc-45a0-93fd-40ae36e0652c admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:39.695326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 908/1793] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:39.700697 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9209d15-9b90-4aff-af9a-8426a749ee6b admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:39.709850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e9209d15-9b90-4aff-af9a-8426a749ee6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:39.727902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 886/1794] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:39.733735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b41c50-4667-4fd1-8ce6-1a32c61a9afe None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:39.738164 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b41c50-4667-4fd1-8ce6-1a32c61a9afe None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:39.740000 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b41c50-4667-4fd1-8ce6-1a32c61a9afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:39.820116 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-68b41c50-4667-4fd1-8ce6-1a32c61a9afe None None] MFA Rules not processed for user `80c1005979d04c55b8746c25b0994086`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:39.824358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-68b41c50-4667-4fd1-8ce6-1a32c61a9afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:39.955092 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9209d15-9b90-4aff-af9a-8426a749ee6b admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:39.979608 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262de453-4f2e-46d9-96f1-7c6af35e93f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:39.983649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262de453-4f2e-46d9-96f1-7c6af35e93f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:39.986451 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262de453-4f2e-46d9-96f1-7c6af35e93f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:39.986782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262de453-4f2e-46d9-96f1-7c6af35e93f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:40.030018 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262de453-4f2e-46d9-96f1-7c6af35e93f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:40.031502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262de453-4f2e-46d9-96f1-7c6af35e93f4 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:40.084895 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 909/1795] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:40.087756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 887/1796] 10.222.0.60 () {58 vars in 1015 bytes} [Mon Sep 26 01:36:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:40.091026 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262de453-4f2e-46d9-96f1-7c6af35e93f4 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:40.092646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b41c50-4667-4fd1-8ce6-1a32c61a9afe None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:40.143499 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262de453-4f2e-46d9-96f1-7c6af35e93f4 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:40.148345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b41c50-4667-4fd1-8ce6-1a32c61a9afe None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:40.165538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc11d6a-07db-436a-938e-d4e7c2a8bd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:40.173313 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc11d6a-07db-436a-938e-d4e7c2a8bd20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:40.174495 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250721c-88b2-462d-a24e-c8911d00c498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:40.174814 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc11d6a-07db-436a-938e-d4e7c2a8bd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:40.177283 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250721c-88b2-462d-a24e-c8911d00c498 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:40.177575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc11d6a-07db-436a-938e-d4e7c2a8bd20 admin admin] PATH_INFO: `/v3/projects/5fafb45a6c9147a0accceaa92415d96c/users/b4ed7088cf7f405eaac21c05d512a759/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:40.190434 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250721c-88b2-462d-a24e-c8911d00c498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:40.190789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250721c-88b2-462d-a24e-c8911d00c498 admin admin] PATH_INFO: `/v3/projects/e24ca970af7a4177a464ef1ebce1618f/users/10097c65939747ce9bf7b4863bbe72bf/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:40.196017 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc11d6a-07db-436a-938e-d4e7c2a8bd20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fafb45a6c9147a0accceaa92415d96c, user_id=b4ed7088cf7f405eaac21c05d512a759, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:40.228885 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc11d6a-07db-436a-938e-d4e7c2a8bd20 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:40.250390 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:40.307101 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250721c-88b2-462d-a24e-c8911d00c498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e24ca970af7a4177a464ef1ebce1618f, user_id=10097c65939747ce9bf7b4863bbe72bf, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:40.316548 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 910/1797] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:40 2022] PUT /identity/v3/projects/5fafb45a6c9147a0accceaa92415d96c/users/b4ed7088cf7f405eaac21c05d512a759/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:40.327284 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250721c-88b2-462d-a24e-c8911d00c498 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:40.328243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3d518-6f0c-4a2f-aaea-f6feda2b3876 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:40.328797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3d518-6f0c-4a2f-aaea-f6feda2b3876 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:40.329147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3d518-6f0c-4a2f-aaea-f6feda2b3876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:40.369378 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 888/1798] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:40 2022] PUT /identity/v3/projects/e24ca970af7a4177a464ef1ebce1618f/users/10097c65939747ce9bf7b4863bbe72bf/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:40.380179 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e74406-185b-46c9-aee1-1a48597c0d37 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:40.380466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e74406-185b-46c9-aee1-1a48597c0d37 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:40.380792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e74406-185b-46c9-aee1-1a48597c0d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:40.455137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-29e3d518-6f0c-4a2f-aaea-f6feda2b3876 None None] MFA Rules not processed for user `b4ed7088cf7f405eaac21c05d512a759`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:40.463885 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-c4e74406-185b-46c9-aee1-1a48597c0d37 None None] MFA Rules not processed for user `10097c65939747ce9bf7b4863bbe72bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:40.465381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c4e74406-185b-46c9-aee1-1a48597c0d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:40.466173 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-29e3d518-6f0c-4a2f-aaea-f6feda2b3876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:40.738388 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 889/1799] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:40.738388 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e74406-185b-46c9-aee1-1a48597c0d37 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:40.739957 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c4e74406-185b-46c9-aee1-1a48597c0d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:40.834370 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 911/1800] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:40.838503 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3d518-6f0c-4a2f-aaea-f6feda2b3876 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:40.842628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:40.981277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e74406-185b-46c9-aee1-1a48597c0d37 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:41.012855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab9747-7722-4bed-aa3d-eba8286685b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:41.013502 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab9747-7722-4bed-aa3d-eba8286685b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:41.013778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab9747-7722-4bed-aa3d-eba8286685b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:41.014051 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab9747-7722-4bed-aa3d-eba8286685b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:41.033473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab9747-7722-4bed-aa3d-eba8286685b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:41.034971 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab9747-7722-4bed-aa3d-eba8286685b7 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:41.051719 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 890/1801] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:41.052647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab9747-7722-4bed-aa3d-eba8286685b7 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:41.136180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3d518-6f0c-4a2f-aaea-f6feda2b3876 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:41.168810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b7b8c-0321-4912-b402-be2f07e258fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:41.169398 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b7b8c-0321-4912-b402-be2f07e258fb admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:41.175964 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b7b8c-0321-4912-b402-be2f07e258fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:41.176806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b7b8c-0321-4912-b402-be2f07e258fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:41.181501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b7b8c-0321-4912-b402-be2f07e258fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:41.193788 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b7b8c-0321-4912-b402-be2f07e258fb admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:41.195370 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab9747-7722-4bed-aa3d-eba8286685b7 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:41.211659 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f95ac1-10df-4b78-a688-60fd85542f05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:41.212301 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f95ac1-10df-4b78-a688-60fd85542f05 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:41.212583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f95ac1-10df-4b78-a688-60fd85542f05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:41.212861 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f95ac1-10df-4b78-a688-60fd85542f05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:41.300767 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 912/1802] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:40 2022] POST /identity/v3/projects => generated 365 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:41.301567 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b7b8c-0321-4912-b402-be2f07e258fb admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:41.452305 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f95ac1-10df-4b78-a688-60fd85542f05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:41.453846 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f95ac1-10df-4b78-a688-60fd85542f05 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:41.476658 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 891/1803] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:41.477524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f95ac1-10df-4b78-a688-60fd85542f05 service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:41.494620 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f95ac1-10df-4b78-a688-60fd85542f05 service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:41.586889 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b7b8c-0321-4912-b402-be2f07e258fb admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:41.607506 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b461cbe-a2dd-4cf4-8951-807172f9c28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:41.608425 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b461cbe-a2dd-4cf4-8951-807172f9c28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:41.609496 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b461cbe-a2dd-4cf4-8951-807172f9c28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:41.611090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b461cbe-a2dd-4cf4-8951-807172f9c28c admin admin] PATH_INFO: `/v3/users/670b6c001b1f4a97a2d61ec4b4a8b8e1` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:41.625507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b461cbe-a2dd-4cf4-8951-807172f9c28c admin admin] RBAC: Authorizing `identity:delete_user(user_id=670b6c001b1f4a97a2d61ec4b4a8b8e1)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:41.626129 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cdd1d-f108-414b-b722-7a3b5aa79bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:41.626758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cdd1d-f108-414b-b722-7a3b5aa79bfd admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:41.627075 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cdd1d-f108-414b-b722-7a3b5aa79bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:41.627342 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cdd1d-f108-414b-b722-7a3b5aa79bfd admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:41.627980 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cdd1d-f108-414b-b722-7a3b5aa79bfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:41.629892 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cdd1d-f108-414b-b722-7a3b5aa79bfd admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:41.630216 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b461cbe-a2dd-4cf4-8951-807172f9c28c admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:41.659575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:41.675260 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 892/1804] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:41 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:41.679341 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cdd1d-f108-414b-b722-7a3b5aa79bfd admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:41.691553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cdd1d-f108-414b-b722-7a3b5aa79bfd admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:41.698769 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ace6a2-24c8-4584-af5d-6009a9db1654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:41.698769 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ace6a2-24c8-4584-af5d-6009a9db1654 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:41.699365 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ace6a2-24c8-4584-af5d-6009a9db1654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:41.699785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ace6a2-24c8-4584-af5d-6009a9db1654 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:41.700619 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ace6a2-24c8-4584-af5d-6009a9db1654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:41.702551 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ace6a2-24c8-4584-af5d-6009a9db1654 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:41.710761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:41.722185 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 893/1805] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:36:41.723576 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ace6a2-24c8-4584-af5d-6009a9db1654 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:41.761643 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ace6a2-24c8-4584-af5d-6009a9db1654 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:41.773956 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20577df6-9a9c-4e8e-81d7-ccfab9c193e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:41.774653 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20577df6-9a9c-4e8e-81d7-ccfab9c193e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:41.775424 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20577df6-9a9c-4e8e-81d7-ccfab9c193e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:41.775424 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20577df6-9a9c-4e8e-81d7-ccfab9c193e8 admin admin] PATH_INFO: `/v3/projects/729bb15c3dd547f5a8a01928f874f624/users/bcc455e7d21744abb95a5c8eb95e6c40/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:41.802487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-7b461cbe-a2dd-4cf4-8951-807172f9c28c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '670b6c001b1f4a97a2d61ec4b4a8b8e1'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:41.810078 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-7b461cbe-a2dd-4cf4-8951-807172f9c28c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '670b6c001b1f4a97a2d61ec4b4a8b8e1'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:41.811212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-7b461cbe-a2dd-4cf4-8951-807172f9c28c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '670b6c001b1f4a97a2d61ec4b4a8b8e1'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:41.827457 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20577df6-9a9c-4e8e-81d7-ccfab9c193e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=729bb15c3dd547f5a8a01928f874f624, user_id=bcc455e7d21744abb95a5c8eb95e6c40, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:41.841961 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20577df6-9a9c-4e8e-81d7-ccfab9c193e8 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:41.858865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-7b461cbe-a2dd-4cf4-8951-807172f9c28c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '670b6c001b1f4a97a2d61ec4b4a8b8e1'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:41.894867 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-7b461cbe-a2dd-4cf4-8951-807172f9c28c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '670b6c001b1f4a97a2d61ec4b4a8b8e1'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:41.906307 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 894/1806] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:41 2022] PUT /identity/v3/projects/729bb15c3dd547f5a8a01928f874f624/users/bcc455e7d21744abb95a5c8eb95e6c40/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:41.909549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20577df6-9a9c-4e8e-81d7-ccfab9c193e8 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:41.918486 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-20577df6-9a9c-4e8e-81d7-ccfab9c193e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:41.945767 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 913/1807] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:36:41 2022] DELETE /identity/v3/users/670b6c001b1f4a97a2d61ec4b4a8b8e1 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:41.962414 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e2374-53bd-4d52-a405-2a8e7889f3fd None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:41.965130 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e2374-53bd-4d52-a405-2a8e7889f3fd None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:41.965885 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e2374-53bd-4d52-a405-2a8e7889f3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:42.003365 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-d57e2374-53bd-4d52-a405-2a8e7889f3fd None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:42.005284 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d57e2374-53bd-4d52-a405-2a8e7889f3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:42.130868 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20577df6-9a9c-4e8e-81d7-ccfab9c193e8 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:42.141833 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 914/1808] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:42.148828 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72060b6c-ecb6-45a5-a735-f611891b62ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:42.151144 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72060b6c-ecb6-45a5-a735-f611891b62ae admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:42.152298 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72060b6c-ecb6-45a5-a735-f611891b62ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:42.152677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72060b6c-ecb6-45a5-a735-f611891b62ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:42.154746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72060b6c-ecb6-45a5-a735-f611891b62ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:42.160071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72060b6c-ecb6-45a5-a735-f611891b62ae admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:42.199654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 895/1809] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:42.201735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e2374-53bd-4d52-a405-2a8e7889f3fd None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:42.224668 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e2374-53bd-4d52-a405-2a8e7889f3fd None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:42.243575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae40ab-ce27-45b0-b0b6-8579dbf95aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:42.244399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae40ab-ce27-45b0-b0b6-8579dbf95aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:42.244763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae40ab-ce27-45b0-b0b6-8579dbf95aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:42.245045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae40ab-ce27-45b0-b0b6-8579dbf95aa1 admin admin] PATH_INFO: `/v3/projects/729bb15c3dd547f5a8a01928f874f624/users/bcc455e7d21744abb95a5c8eb95e6c40/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:42.248771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae40ab-ce27-45b0-b0b6-8579dbf95aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=729bb15c3dd547f5a8a01928f874f624, user_id=bcc455e7d21744abb95a5c8eb95e6c40, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:42.251517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae40ab-ce27-45b0-b0b6-8579dbf95aa1 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:42.297946 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72060b6c-ecb6-45a5-a735-f611891b62ae admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:42.299971 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-72060b6c-ecb6-45a5-a735-f611891b62ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:42.321978 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 915/1810] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:42 2022] PUT /identity/v3/projects/729bb15c3dd547f5a8a01928f874f624/users/bcc455e7d21744abb95a5c8eb95e6c40/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:42.328097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656aafb-98fa-4594-9d91-affc38b88b24 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:42.328367 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656aafb-98fa-4594-9d91-affc38b88b24 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:42.328673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656aafb-98fa-4594-9d91-affc38b88b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:42.464792 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-a656aafb-98fa-4594-9d91-affc38b88b24 None None] MFA Rules not processed for user `bcc455e7d21744abb95a5c8eb95e6c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:42.466303 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a656aafb-98fa-4594-9d91-affc38b88b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:42.535556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72060b6c-ecb6-45a5-a735-f611891b62ae admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:42.690977 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:42.703194 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a3dc0-50e8-4b32-9124-dca97c39902f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:42.704792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a3dc0-50e8-4b32-9124-dca97c39902f service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:42.706438 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a3dc0-50e8-4b32-9124-dca97c39902f service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:42.706857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a3dc0-50e8-4b32-9124-dca97c39902f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:42.708561 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 916/1811] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:42.726993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656aafb-98fa-4594-9d91-affc38b88b24 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:42.729657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a656aafb-98fa-4594-9d91-affc38b88b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:42.829737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:42.874996 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656aafb-98fa-4594-9d91-affc38b88b24 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:42.879461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a3dc0-50e8-4b32-9124-dca97c39902f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:42.885910 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a3dc0-50e8-4b32-9124-dca97c39902f service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:42.887545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60f3c8-fd0f-4d9c-9cc7-7929261e1bc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:42.888823 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60f3c8-fd0f-4d9c-9cc7-7929261e1bc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:42.890568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60f3c8-fd0f-4d9c-9cc7-7929261e1bc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:42.890568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60f3c8-fd0f-4d9c-9cc7-7929261e1bc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:42.911703 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 896/1812] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:42.912969 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60f3c8-fd0f-4d9c-9cc7-7929261e1bc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:42.915435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60f3c8-fd0f-4d9c-9cc7-7929261e1bc9 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:42.932262 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 917/1813] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:36:43.174052 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a3dc0-50e8-4b32-9124-dca97c39902f service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:43.211324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a3dc0-50e8-4b32-9124-dca97c39902f service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:43.223065 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830d293-4f4d-44cf-ab6d-81b2e618d310 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:43.227551 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830d293-4f4d-44cf-ab6d-81b2e618d310 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:43.227915 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830d293-4f4d-44cf-ab6d-81b2e618d310 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:43.240807 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830d293-4f4d-44cf-ab6d-81b2e618d310 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:43.248962 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8830d293-4f4d-44cf-ab6d-81b2e618d310 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:43.401258 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830d293-4f4d-44cf-ab6d-81b2e618d310 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:43.402788 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830d293-4f4d-44cf-ab6d-81b2e618d310 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:43.457266 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 897/1814] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:44.129416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60f3c8-fd0f-4d9c-9cc7-7929261e1bc9 service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:44.130989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-5b60f3c8-fd0f-4d9c-9cc7-7929261e1bc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:44.180424 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60f3c8-fd0f-4d9c-9cc7-7929261e1bc9 service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:44.203907 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc60c5-eae7-4d7c-a8f4-69e414134fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:44.204551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc60c5-eae7-4d7c-a8f4-69e414134fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:44.204827 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc60c5-eae7-4d7c-a8f4-69e414134fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:44.208344 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc60c5-eae7-4d7c-a8f4-69e414134fa8 admin admin] PATH_INFO: `/v3/projects/835383d03b2f4e9dad6661710e5fd5c3` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:44.211976 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc60c5-eae7-4d7c-a8f4-69e414134fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=835383d03b2f4e9dad6661710e5fd5c3)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:44.221396 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc60c5-eae7-4d7c-a8f4-69e414134fa8 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:44.536182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-d4bc60c5-eae7-4d7c-a8f4-69e414134fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '835383d03b2f4e9dad6661710e5fd5c3', 'request_id': 'req-d4bc60c5-eae7-4d7c-a8f4-69e414134fa8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:44.591210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-d4bc60c5-eae7-4d7c-a8f4-69e414134fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '835383d03b2f4e9dad6661710e5fd5c3', 'request_id': 'req-d4bc60c5-eae7-4d7c-a8f4-69e414134fa8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:44.626021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-d4bc60c5-eae7-4d7c-a8f4-69e414134fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '835383d03b2f4e9dad6661710e5fd5c3', 'request_id': 'req-d4bc60c5-eae7-4d7c-a8f4-69e414134fa8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:44.662097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-d4bc60c5-eae7-4d7c-a8f4-69e414134fa8 admin admin] The token cache is being invalidate because project 835383d03b2f4e9dad6661710e5fd5c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:36:44.663571 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-d4bc60c5-eae7-4d7c-a8f4-69e414134fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:44.680013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-d4bc60c5-eae7-4d7c-a8f4-69e414134fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:44.696738 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830d293-4f4d-44cf-ab6d-81b2e618d310 service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:44.697588 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 918/1815] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:36:44 2022] DELETE /identity/v3/projects/835383d03b2f4e9dad6661710e5fd5c3 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:44.715333 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830d293-4f4d-44cf-ab6d-81b2e618d310 service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:44.931207 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aaab03-72a9-4934-a70a-f1326b5eec0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:44.931968 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaab03-72a9-4934-a70a-f1326b5eec0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:44.932257 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaab03-72a9-4934-a70a-f1326b5eec0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:44.932531 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaab03-72a9-4934-a70a-f1326b5eec0c admin admin] PATH_INFO: `/v3/users/4684686df52e43fb88cd46b071fe224a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:44.934722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aaab03-72a9-4934-a70a-f1326b5eec0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4684686df52e43fb88cd46b071fe224a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:44.937301 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aaab03-72a9-4934-a70a-f1326b5eec0c admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:45.124002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-72aaab03-72a9-4934-a70a-f1326b5eec0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4684686df52e43fb88cd46b071fe224a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:45.127243 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-72aaab03-72a9-4934-a70a-f1326b5eec0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4684686df52e43fb88cd46b071fe224a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:45.129813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-72aaab03-72a9-4934-a70a-f1326b5eec0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4684686df52e43fb88cd46b071fe224a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:45.201033 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-72aaab03-72a9-4934-a70a-f1326b5eec0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4684686df52e43fb88cd46b071fe224a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:45.232164 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-72aaab03-72a9-4934-a70a-f1326b5eec0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4684686df52e43fb88cd46b071fe224a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:45.246353 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:45.269090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc60c5-eae7-4d7c-a8f4-69e414134fa8 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:45.271209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d4bc60c5-eae7-4d7c-a8f4-69e414134fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:45.289268 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 898/1816] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:36:44 2022] DELETE /identity/v3/users/4684686df52e43fb88cd46b071fe224a => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:45.501771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc60c5-eae7-4d7c-a8f4-69e414134fa8 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:45.652231 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:45.674912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09033f9a-282e-4996-9212-bde3b39e730c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:45.675691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09033f9a-282e-4996-9212-bde3b39e730c service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:45.676087 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09033f9a-282e-4996-9212-bde3b39e730c service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:45.676454 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09033f9a-282e-4996-9212-bde3b39e730c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:45.679116 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-09033f9a-282e-4996-9212-bde3b39e730c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:45.908427 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09033f9a-282e-4996-9212-bde3b39e730c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:45.909978 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09033f9a-282e-4996-9212-bde3b39e730c service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:45.934261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 919/1817] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:46.993106 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aaab03-72a9-4934-a70a-f1326b5eec0c admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:46.994734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-72aaab03-72a9-4934-a70a-f1326b5eec0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:47.084426 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4cc8e-369f-430a-9534-ee551f646842 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:47.085659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4cc8e-369f-430a-9534-ee551f646842 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:47.085659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4cc8e-369f-430a-9534-ee551f646842 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:47.086871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 920/1818] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 26 01:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:36:47.150584 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aaab03-72a9-4934-a70a-f1326b5eec0c admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:47.157254 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355175f-2a2c-41d5-b3fb-a8a6d3274b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:47.159165 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355175f-2a2c-41d5-b3fb-a8a6d3274b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:47.159619 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355175f-2a2c-41d5-b3fb-a8a6d3274b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:47.159981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355175f-2a2c-41d5-b3fb-a8a6d3274b5a admin admin] PATH_INFO: `/v3/users/10097c65939747ce9bf7b4863bbe72bf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:47.162039 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355175f-2a2c-41d5-b3fb-a8a6d3274b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=10097c65939747ce9bf7b4863bbe72bf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:47.164358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355175f-2a2c-41d5-b3fb-a8a6d3274b5a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:47.183826 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4bc63-5c69-4220-a4e2-4e5f90186ce9 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:47.184465 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4bc63-5c69-4220-a4e2-4e5f90186ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:47.184942 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4bc63-5c69-4220-a4e2-4e5f90186ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:47.247286 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-8da4bc63-5c69-4220-a4e2-4e5f90186ce9 None None] MFA Rules not processed for user `3d6eaeb6bced49afabc7bdaa5e7cecfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:47.251930 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-8da4bc63-5c69-4220-a4e2-4e5f90186ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:47.275337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9355175f-2a2c-41d5-b3fb-a8a6d3274b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10097c65939747ce9bf7b4863bbe72bf'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:47.277357 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9355175f-2a2c-41d5-b3fb-a8a6d3274b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10097c65939747ce9bf7b4863bbe72bf'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:47.279119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9355175f-2a2c-41d5-b3fb-a8a6d3274b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10097c65939747ce9bf7b4863bbe72bf'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:47.327450 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9355175f-2a2c-41d5-b3fb-a8a6d3274b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10097c65939747ce9bf7b4863bbe72bf'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:47.356724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9355175f-2a2c-41d5-b3fb-a8a6d3274b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10097c65939747ce9bf7b4863bbe72bf'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:47.412102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 899/1819] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:36:46 2022] DELETE /identity/v3/users/10097c65939747ce9bf7b4863bbe72bf => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:47.421354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf7024-55a9-4f09-a2bd-5049f74fb14e None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:47.421640 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf7024-55a9-4f09-a2bd-5049f74fb14e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:47.421915 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf7024-55a9-4f09-a2bd-5049f74fb14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:47.444860 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 921/1820] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 26 01:36:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:47.465973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-7dcf7024-55a9-4f09-a2bd-5049f74fb14e None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:47.467258 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7dcf7024-55a9-4f09-a2bd-5049f74fb14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:47.555439 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4bc63-5c69-4220-a4e2-4e5f90186ce9 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:47.558598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-8da4bc63-5c69-4220-a4e2-4e5f90186ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:47.597814 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4bc63-5c69-4220-a4e2-4e5f90186ce9 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:47.681486 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 900/1821] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:47.752979 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec303edf-c317-44cf-9297-50615f810298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:47.753781 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec303edf-c317-44cf-9297-50615f810298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:47.754135 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec303edf-c317-44cf-9297-50615f810298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:47.754964 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec303edf-c317-44cf-9297-50615f810298 admin admin] PATH_INFO: `/v3/projects/9da3fef73f98481d9880a3a4a66a452f` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:47.757118 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec303edf-c317-44cf-9297-50615f810298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da3fef73f98481d9880a3a4a66a452f)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:47.761845 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec303edf-c317-44cf-9297-50615f810298 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:47.798036 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf7024-55a9-4f09-a2bd-5049f74fb14e None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:47.799629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7dcf7024-55a9-4f09-a2bd-5049f74fb14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:47.800994 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:47.842434 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:47.848245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-ec303edf-c317-44cf-9297-50615f810298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da3fef73f98481d9880a3a4a66a452f', 'request_id': 'req-ec303edf-c317-44cf-9297-50615f810298'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:47.867031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-ec303edf-c317-44cf-9297-50615f810298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da3fef73f98481d9880a3a4a66a452f', 'request_id': 'req-ec303edf-c317-44cf-9297-50615f810298'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:47.882003 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-ec303edf-c317-44cf-9297-50615f810298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da3fef73f98481d9880a3a4a66a452f', 'request_id': 'req-ec303edf-c317-44cf-9297-50615f810298'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:47.949058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-ec303edf-c317-44cf-9297-50615f810298 admin admin] The token cache is being invalidate because project 9da3fef73f98481d9880a3a4a66a452f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:36:47.951392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-ec303edf-c317-44cf-9297-50615f810298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:47.956354 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-ec303edf-c317-44cf-9297-50615f810298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:47.968736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 922/1822] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:36:47 2022] DELETE /identity/v3/projects/9da3fef73f98481d9880a3a4a66a452f => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:36:47.973158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39346e6-0165-4868-961b-f01da9e7986b None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:47.979240 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39346e6-0165-4868-961b-f01da9e7986b None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:47.981141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39346e6-0165-4868-961b-f01da9e7986b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:48.003986 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf7024-55a9-4f09-a2bd-5049f74fb14e None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:48.082027 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-e39346e6-0165-4868-961b-f01da9e7986b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:48.088419 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e39346e6-0165-4868-961b-f01da9e7986b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:48.219829 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32a99f-6653-4e9c-87bc-4134179734a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:48.227000 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32a99f-6653-4e9c-87bc-4134179734a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:48.229321 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32a99f-6653-4e9c-87bc-4134179734a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:48.229764 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32a99f-6653-4e9c-87bc-4134179734a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:48.234231 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6f32a99f-6653-4e9c-87bc-4134179734a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:48.329259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 923/1823] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:48.334122 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39346e6-0165-4868-961b-f01da9e7986b None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:48.337421 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e39346e6-0165-4868-961b-f01da9e7986b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:48.515906 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32a99f-6653-4e9c-87bc-4134179734a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:48.521133 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32a99f-6653-4e9c-87bc-4134179734a3 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:48.538388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39346e6-0165-4868-961b-f01da9e7986b None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:48.548586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc1ece-6175-4dc2-bf85-0ced498adf67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:48.549222 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc1ece-6175-4dc2-bf85-0ced498adf67 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:48.549505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc1ece-6175-4dc2-bf85-0ced498adf67 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:48.549781 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc1ece-6175-4dc2-bf85-0ced498adf67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:48.562846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d8cc1ece-6175-4dc2-bf85-0ced498adf67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:48.566528 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 901/1824] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:48.570506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4e564-ff2e-4982-985c-6c67200dde04 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:48.571085 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4e564-ff2e-4982-985c-6c67200dde04 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:48.571555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4e564-ff2e-4982-985c-6c67200dde04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:48.614123 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc1ece-6175-4dc2-bf85-0ced498adf67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:48.620839 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc1ece-6175-4dc2-bf85-0ced498adf67 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:48.626085 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-9eb4e564-ff2e-4982-985c-6c67200dde04 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:48.627911 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-9eb4e564-ff2e-4982-985c-6c67200dde04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:48.650390 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 902/1825] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:48.655984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4e564-ff2e-4982-985c-6c67200dde04 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:48.661196 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 924/1826] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:48.687595 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4e564-ff2e-4982-985c-6c67200dde04 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:48.705057 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964dd68-5891-47db-a44f-5e1ffc9f753e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:48.713051 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964dd68-5891-47db-a44f-5e1ffc9f753e admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:48.713051 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964dd68-5891-47db-a44f-5e1ffc9f753e admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:48.713051 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964dd68-5891-47db-a44f-5e1ffc9f753e admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:48.714108 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964dd68-5891-47db-a44f-5e1ffc9f753e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:36:48.714485 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964dd68-5891-47db-a44f-5e1ffc9f753e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:48.716269 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964dd68-5891-47db-a44f-5e1ffc9f753e admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:48.744272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 903/1827] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:36:48.750405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc1ece-6175-4dc2-bf85-0ced498adf67 service nova] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:48.785308 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc1ece-6175-4dc2-bf85-0ced498adf67 service nova] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:48.803598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376363c-2bbe-48a5-997f-441fb4ac1370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:48.805661 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376363c-2bbe-48a5-997f-441fb4ac1370 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:48.806540 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376363c-2bbe-48a5-997f-441fb4ac1370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:48.807177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376363c-2bbe-48a5-997f-441fb4ac1370 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:48.808297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376363c-2bbe-48a5-997f-441fb4ac1370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:48.812555 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376363c-2bbe-48a5-997f-441fb4ac1370 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:48.889258 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 925/1828] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:48 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:48.891118 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc27c4-420e-4cf2-b899-a53bd0f3a8e1 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:48.891406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc27c4-420e-4cf2-b899-a53bd0f3a8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:48.891700 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc27c4-420e-4cf2-b899-a53bd0f3a8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:48.893080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376363c-2bbe-48a5-997f-441fb4ac1370 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:48.939544 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:48.972885 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-7bfc27c4-420e-4cf2-b899-a53bd0f3a8e1 None None] MFA Rules not processed for user `d6cf9f85df6b48e1a4ced8a647785b14`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:48.973782 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7bfc27c4-420e-4cf2-b899-a53bd0f3a8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:49.085005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376363c-2bbe-48a5-997f-441fb4ac1370 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:49.096126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:49.099841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7fefb-4171-4fcb-8a4a-ce6009644c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:49.101988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7fefb-4171-4fcb-8a4a-ce6009644c12 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:49.102423 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7fefb-4171-4fcb-8a4a-ce6009644c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:49.102864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7fefb-4171-4fcb-8a4a-ce6009644c12 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:49.107301 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7fefb-4171-4fcb-8a4a-ce6009644c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:49.115180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7fefb-4171-4fcb-8a4a-ce6009644c12 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:49.163097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 926/1829] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:48 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:49.166345 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f3700-172a-4c46-bf6f-c55538126d71 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:49.167045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f3700-172a-4c46-bf6f-c55538126d71 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:49.167526 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f3700-172a-4c46-bf6f-c55538126d71 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:49.169909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 927/1830] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 26 01:36:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:36:49.171010 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f3700-172a-4c46-bf6f-c55538126d71 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:49.175494 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 904/1831] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:48 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:36:49.179984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc27c4-420e-4cf2-b899-a53bd0f3a8e1 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:49.183087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7bfc27c4-420e-4cf2-b899-a53bd0f3a8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:49.188144 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f3700-172a-4c46-bf6f-c55538126d71 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:49.193535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152cb59-7446-460f-8f43-d1c68b533e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:49.195245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152cb59-7446-460f-8f43-d1c68b533e9f admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:49.195817 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152cb59-7446-460f-8f43-d1c68b533e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:49.196293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152cb59-7446-460f-8f43-d1c68b533e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:49.197147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152cb59-7446-460f-8f43-d1c68b533e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:49.199237 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152cb59-7446-460f-8f43-d1c68b533e9f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:49.214860 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 928/1832] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:49.218411 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152cb59-7446-460f-8f43-d1c68b533e9f admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:49.222618 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc27c4-420e-4cf2-b899-a53bd0f3a8e1 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:49.233900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152cb59-7446-460f-8f43-d1c68b533e9f admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:49.239528 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7e32b-e18e-4d6a-8417-7cfea0b59826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:49.241973 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaee48f-17fb-49c0-86fc-fbb45ed4450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:49.242240 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7e32b-e18e-4d6a-8417-7cfea0b59826 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:49.243289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaee48f-17fb-49c0-86fc-fbb45ed4450f admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:49.243779 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaee48f-17fb-49c0-86fc-fbb45ed4450f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:49.244295 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaee48f-17fb-49c0-86fc-fbb45ed4450f admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:49.244398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7e32b-e18e-4d6a-8417-7cfea0b59826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:49.244671 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7e32b-e18e-4d6a-8417-7cfea0b59826 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:49.245600 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaee48f-17fb-49c0-86fc-fbb45ed4450f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:49.246250 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7e32b-e18e-4d6a-8417-7cfea0b59826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:49.247905 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaee48f-17fb-49c0-86fc-fbb45ed4450f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:49.252707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7e32b-e18e-4d6a-8417-7cfea0b59826 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:49.267358 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 929/1833] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:49.270362 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60582738-67bd-4986-a2b1-1ef04da4eecd None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:49.270924 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60582738-67bd-4986-a2b1-1ef04da4eecd None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:49.271427 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60582738-67bd-4986-a2b1-1ef04da4eecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:49.314760 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-60582738-67bd-4986-a2b1-1ef04da4eecd None None] MFA Rules not processed for user `3d6eaeb6bced49afabc7bdaa5e7cecfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:49.317201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-60582738-67bd-4986-a2b1-1ef04da4eecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:49.355980 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 905/1834] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:49 2022] POST /identity/v3/projects => generated 405 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:36:49.358992 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7e32b-e18e-4d6a-8417-7cfea0b59826 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:49.457039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 930/1835] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 26 01:36:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:49.457978 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60582738-67bd-4986-a2b1-1ef04da4eecd None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:49.471383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60582738-67bd-4986-a2b1-1ef04da4eecd None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:49.530791 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7e32b-e18e-4d6a-8417-7cfea0b59826 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:49.541509 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4af7e-f3ca-4a1e-9bce-48cac4f68f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:49.542531 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4af7e-f3ca-4a1e-9bce-48cac4f68f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:49.542994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4af7e-f3ca-4a1e-9bce-48cac4f68f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:49.543379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4af7e-f3ca-4a1e-9bce-48cac4f68f97 admin admin] PATH_INFO: `/v3/projects/1d89ab15840f4821be220a1370e54aee/users/ec162489661342ed82e65f3271751957/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:49.568866 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4af7e-f3ca-4a1e-9bce-48cac4f68f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d89ab15840f4821be220a1370e54aee, user_id=ec162489661342ed82e65f3271751957, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:49.578463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4af7e-f3ca-4a1e-9bce-48cac4f68f97 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:49.619559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e4bbd-fd04-4652-990c-deb109589254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:49.623229 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e4bbd-fd04-4652-990c-deb109589254 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:49.623603 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e4bbd-fd04-4652-990c-deb109589254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:49.623736 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 906/1836] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:49 2022] PUT /identity/v3/projects/1d89ab15840f4821be220a1370e54aee/users/ec162489661342ed82e65f3271751957/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:49.623860 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e4bbd-fd04-4652-990c-deb109589254 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:49.624468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e4bbd-fd04-4652-990c-deb109589254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:49.629349 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e4bbd-fd04-4652-990c-deb109589254 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:49.632546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418ef11-84cd-4f29-bd87-6d4ba6e480e2 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:49.633423 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418ef11-84cd-4f29-bd87-6d4ba6e480e2 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:49.634931 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418ef11-84cd-4f29-bd87-6d4ba6e480e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:49.696139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 931/1837] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:49 2022] POST /identity/v3/users => generated 309 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:49.703700 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e4bbd-fd04-4652-990c-deb109589254 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:49.719011 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:49.733793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e4bbd-fd04-4652-990c-deb109589254 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:49.742287 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-1418ef11-84cd-4f29-bd87-6d4ba6e480e2 None None] MFA Rules not processed for user `ec162489661342ed82e65f3271751957`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:49.745883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1418ef11-84cd-4f29-bd87-6d4ba6e480e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:49.857035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1237e0-27a5-40e8-b253-a028a38343fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:49.860250 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1237e0-27a5-40e8-b253-a028a38343fe admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:49.875703 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1237e0-27a5-40e8-b253-a028a38343fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:49.881308 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1237e0-27a5-40e8-b253-a028a38343fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:49.884947 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1237e0-27a5-40e8-b253-a028a38343fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:49.890794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1237e0-27a5-40e8-b253-a028a38343fe admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:49.918258 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 932/1838] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:49.919371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1237e0-27a5-40e8-b253-a028a38343fe admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:49.953672 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 907/1839] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:49.958495 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418ef11-84cd-4f29-bd87-6d4ba6e480e2 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:50.012263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418ef11-84cd-4f29-bd87-6d4ba6e480e2 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:50.039440 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59313c-0f5e-4bdf-ba1d-f01c5a9b653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:50.040282 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59313c-0f5e-4bdf-ba1d-f01c5a9b653c admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:50.040557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59313c-0f5e-4bdf-ba1d-f01c5a9b653c admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:50.040837 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59313c-0f5e-4bdf-ba1d-f01c5a9b653c admin admin] PATH_INFO: `/v3/projects/2fca1cf1eee94f028e60ae855785c501/users/eb16a85e131f40ceb404ac8d48fa8422/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:50.115665 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1237e0-27a5-40e8-b253-a028a38343fe admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:50.130428 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d33a5-c6c2-4f9c-9b5a-633f772727db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:50.131278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d33a5-c6c2-4f9c-9b5a-633f772727db service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:50.141498 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59313c-0f5e-4bdf-ba1d-f01c5a9b653c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fca1cf1eee94f028e60ae855785c501, user_id=eb16a85e131f40ceb404ac8d48fa8422, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:50.145661 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d33a5-c6c2-4f9c-9b5a-633f772727db service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:50.149234 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d33a5-c6c2-4f9c-9b5a-633f772727db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:50.161868 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59313c-0f5e-4bdf-ba1d-f01c5a9b653c admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:50.183435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d33a5-c6c2-4f9c-9b5a-633f772727db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:50.190622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d33a5-c6c2-4f9c-9b5a-633f772727db service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:50.222126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 908/1840] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:49 2022] PUT /identity/v3/projects/2fca1cf1eee94f028e60ae855785c501/users/eb16a85e131f40ceb404ac8d48fa8422/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:50.223213 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59313c-0f5e-4bdf-ba1d-f01c5a9b653c admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:50.226685 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2f59313c-0f5e-4bdf-ba1d-f01c5a9b653c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:50.232850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 933/1841] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:50.237179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d33a5-c6c2-4f9c-9b5a-633f772727db service nova] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:50.278417 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d33a5-c6c2-4f9c-9b5a-633f772727db service nova] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:50.297781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:50.403216 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59313c-0f5e-4bdf-ba1d-f01c5a9b653c admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:50.412566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43739f6d-4306-40e7-9366-a5149964e8d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:50.414104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43739f6d-4306-40e7-9366-a5149964e8d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:50.414104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43739f6d-4306-40e7-9366-a5149964e8d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:50.414427 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43739f6d-4306-40e7-9366-a5149964e8d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:50.519692 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064d614-371c-4cdf-8357-f4f826eb7e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:50.520479 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064d614-371c-4cdf-8357-f4f826eb7e79 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:50.520865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064d614-371c-4cdf-8357-f4f826eb7e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:50.521244 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064d614-371c-4cdf-8357-f4f826eb7e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:50.521997 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064d614-371c-4cdf-8357-f4f826eb7e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:50.544034 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064d614-371c-4cdf-8357-f4f826eb7e79 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:50.583504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 934/1842] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:50.588422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064d614-371c-4cdf-8357-f4f826eb7e79 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:50.609185 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064d614-371c-4cdf-8357-f4f826eb7e79 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:50.626490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1e0a8-b4da-4f77-9958-821950a0c173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:50.627539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1e0a8-b4da-4f77-9958-821950a0c173 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:50.629342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1e0a8-b4da-4f77-9958-821950a0c173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:50.630320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1e0a8-b4da-4f77-9958-821950a0c173 admin admin] PATH_INFO: `/v3/projects/2fca1cf1eee94f028e60ae855785c501/users/eb16a85e131f40ceb404ac8d48fa8422/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:50.632638 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43739f6d-4306-40e7-9366-a5149964e8d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:50.639595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1e0a8-b4da-4f77-9958-821950a0c173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fca1cf1eee94f028e60ae855785c501, user_id=eb16a85e131f40ceb404ac8d48fa8422, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:50.643830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43739f6d-4306-40e7-9366-a5149964e8d3 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:50.647019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1e0a8-b4da-4f77-9958-821950a0c173 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:50.667281 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 909/1843] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:50.677363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 935/1844] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:50 2022] PUT /identity/v3/projects/2fca1cf1eee94f028e60ae855785c501/users/eb16a85e131f40ceb404ac8d48fa8422/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:51.468400 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43739f6d-4306-40e7-9366-a5149964e8d3 service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:51.469935 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-43739f6d-4306-40e7-9366-a5149964e8d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:51.505497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43739f6d-4306-40e7-9366-a5149964e8d3 service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:51.700645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39995e-a799-4044-bdd7-9446e933e894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:51.702121 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39995e-a799-4044-bdd7-9446e933e894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:51.702473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39995e-a799-4044-bdd7-9446e933e894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:51.702948 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39995e-a799-4044-bdd7-9446e933e894 admin admin] PATH_INFO: `/v3/projects/e24ca970af7a4177a464ef1ebce1618f` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:51.704445 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39995e-a799-4044-bdd7-9446e933e894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e24ca970af7a4177a464ef1ebce1618f)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:51.708087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39995e-a799-4044-bdd7-9446e933e894 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:51.839777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6a39995e-a799-4044-bdd7-9446e933e894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e24ca970af7a4177a464ef1ebce1618f', 'request_id': 'req-6a39995e-a799-4044-bdd7-9446e933e894'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:51.862132 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6a39995e-a799-4044-bdd7-9446e933e894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e24ca970af7a4177a464ef1ebce1618f', 'request_id': 'req-6a39995e-a799-4044-bdd7-9446e933e894'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:51.896303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6a39995e-a799-4044-bdd7-9446e933e894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e24ca970af7a4177a464ef1ebce1618f', 'request_id': 'req-6a39995e-a799-4044-bdd7-9446e933e894'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:51.962066 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6a39995e-a799-4044-bdd7-9446e933e894 admin admin] The token cache is being invalidate because project e24ca970af7a4177a464ef1ebce1618f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:36:51.963394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6a39995e-a799-4044-bdd7-9446e933e894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:51.968479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6a39995e-a799-4044-bdd7-9446e933e894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:51.976364 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 910/1845] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:36:51 2022] DELETE /identity/v3/projects/e24ca970af7a4177a464ef1ebce1618f => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:51.980687 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1e0a8-b4da-4f77-9958-821950a0c173 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:51.984047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c9f1e0a8-b4da-4f77-9958-821950a0c173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:52.025785 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1e0a8-b4da-4f77-9958-821950a0c173 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:52.039687 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:52.258122 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767251db-b8c1-4df8-bb31-2b512b47876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:52.258785 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767251db-b8c1-4df8-bb31-2b512b47876e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:52.259098 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767251db-b8c1-4df8-bb31-2b512b47876e admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:52.259380 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767251db-b8c1-4df8-bb31-2b512b47876e admin admin] PATH_INFO: `/v3/users/bcc455e7d21744abb95a5c8eb95e6c40` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:52.269079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767251db-b8c1-4df8-bb31-2b512b47876e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc455e7d21744abb95a5c8eb95e6c40)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:52.274556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767251db-b8c1-4df8-bb31-2b512b47876e admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:52.434175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-767251db-b8c1-4df8-bb31-2b512b47876e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc455e7d21744abb95a5c8eb95e6c40'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:52.437304 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-767251db-b8c1-4df8-bb31-2b512b47876e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc455e7d21744abb95a5c8eb95e6c40'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:52.438763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-767251db-b8c1-4df8-bb31-2b512b47876e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc455e7d21744abb95a5c8eb95e6c40'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:52.488519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-767251db-b8c1-4df8-bb31-2b512b47876e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc455e7d21744abb95a5c8eb95e6c40'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:52.512670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-767251db-b8c1-4df8-bb31-2b512b47876e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc455e7d21744abb95a5c8eb95e6c40'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:52.538483 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 936/1846] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:36:51 2022] DELETE /identity/v3/users/bcc455e7d21744abb95a5c8eb95e6c40 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:53.401845 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadba1e9-4d48-4883-bf97-6809395e535d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:53.402504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadba1e9-4d48-4883-bf97-6809395e535d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:53.402590 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadba1e9-4d48-4883-bf97-6809395e535d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:53.411199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:53.426234 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767251db-b8c1-4df8-bb31-2b512b47876e admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:53.428846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-767251db-b8c1-4df8-bb31-2b512b47876e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:53.440150 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-dadba1e9-4d48-4883-bf97-6809395e535d None None] MFA Rules not processed for user `eb16a85e131f40ceb404ac8d48fa8422`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:53.441377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-dadba1e9-4d48-4883-bf97-6809395e535d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:53.509525 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767251db-b8c1-4df8-bb31-2b512b47876e admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:53.520512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47148b-0d6b-4631-a6ec-7185a5f9e642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:53.521187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47148b-0d6b-4631-a6ec-7185a5f9e642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:53.521471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47148b-0d6b-4631-a6ec-7185a5f9e642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:53.521745 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47148b-0d6b-4631-a6ec-7185a5f9e642 admin admin] PATH_INFO: `/v3/projects/729bb15c3dd547f5a8a01928f874f624` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:53.525073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 911/1847] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:36:53.530477 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47148b-0d6b-4631-a6ec-7185a5f9e642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=729bb15c3dd547f5a8a01928f874f624)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:53.532433 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47148b-0d6b-4631-a6ec-7185a5f9e642 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:53.581907 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:53.603532 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-ad47148b-0d6b-4631-a6ec-7185a5f9e642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '729bb15c3dd547f5a8a01928f874f624', 'request_id': 'req-ad47148b-0d6b-4631-a6ec-7185a5f9e642'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:53.615575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-ad47148b-0d6b-4631-a6ec-7185a5f9e642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '729bb15c3dd547f5a8a01928f874f624', 'request_id': 'req-ad47148b-0d6b-4631-a6ec-7185a5f9e642'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:53.630094 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-ad47148b-0d6b-4631-a6ec-7185a5f9e642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '729bb15c3dd547f5a8a01928f874f624', 'request_id': 'req-ad47148b-0d6b-4631-a6ec-7185a5f9e642'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:53.648336 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-ad47148b-0d6b-4631-a6ec-7185a5f9e642 admin admin] The token cache is being invalidate because project 729bb15c3dd547f5a8a01928f874f624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:36:53.648627 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-ad47148b-0d6b-4631-a6ec-7185a5f9e642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:53.649293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-ad47148b-0d6b-4631-a6ec-7185a5f9e642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:53.651020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 937/1848] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:36:53 2022] DELETE /identity/v3/projects/729bb15c3dd547f5a8a01928f874f624 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:53.656178 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e5edb-47e0-4fac-afca-66d383144202 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:53.656557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e5edb-47e0-4fac-afca-66d383144202 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:53.656999 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e5edb-47e0-4fac-afca-66d383144202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:53.685166 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-503e5edb-47e0-4fac-afca-66d383144202 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:53.686579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-503e5edb-47e0-4fac-afca-66d383144202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:53.776018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 912/1849] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:53.783905 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2dba9-31ed-4702-b6b9-e1eb810133d4 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:53.784190 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2dba9-31ed-4702-b6b9-e1eb810133d4 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:53.784573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2dba9-31ed-4702-b6b9-e1eb810133d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:53.808006 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-d0d2dba9-31ed-4702-b6b9-e1eb810133d4 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:53.810174 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d0d2dba9-31ed-4702-b6b9-e1eb810133d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:53.824197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 938/1850] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:53.828447 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e5edb-47e0-4fac-afca-66d383144202 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:53.839857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e5edb-47e0-4fac-afca-66d383144202 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:53.849331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfd1ce-5c18-4408-81ff-64a72bed8f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:53.849958 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfd1ce-5c18-4408-81ff-64a72bed8f2b admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:53.851004 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfd1ce-5c18-4408-81ff-64a72bed8f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:53.851307 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfd1ce-5c18-4408-81ff-64a72bed8f2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:53.851972 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bfd1ce-5c18-4408-81ff-64a72bed8f2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:36:53.852285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bfd1ce-5c18-4408-81ff-64a72bed8f2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:53.853888 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bfd1ce-5c18-4408-81ff-64a72bed8f2b admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:53.866721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 913/1851] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:36:53.871152 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2dba9-31ed-4702-b6b9-e1eb810133d4 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:53.885471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2dba9-31ed-4702-b6b9-e1eb810133d4 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:53.892821 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875a19f-fc4f-475e-86ab-af970d3c0967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:53.893447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875a19f-fc4f-475e-86ab-af970d3c0967 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:53.893729 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875a19f-fc4f-475e-86ab-af970d3c0967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:53.894003 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875a19f-fc4f-475e-86ab-af970d3c0967 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:53.894661 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875a19f-fc4f-475e-86ab-af970d3c0967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:53.896651 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875a19f-fc4f-475e-86ab-af970d3c0967 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:53.946743 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 939/1852] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:53 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:53.948696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfd1ce-5c18-4408-81ff-64a72bed8f2b admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:53.962704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfd1ce-5c18-4408-81ff-64a72bed8f2b admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:54.049720 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514a732-bfca-4cfa-87d0-e2afe67595ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:54.050294 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514a732-bfca-4cfa-87d0-e2afe67595ed admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:54.050576 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514a732-bfca-4cfa-87d0-e2afe67595ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:54.050875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514a732-bfca-4cfa-87d0-e2afe67595ed admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:54.051600 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514a732-bfca-4cfa-87d0-e2afe67595ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:54.059011 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514a732-bfca-4cfa-87d0-e2afe67595ed admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:54.087011 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 914/1853] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:53 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:36:54.088794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875a19f-fc4f-475e-86ab-af970d3c0967 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:54.100502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875a19f-fc4f-475e-86ab-af970d3c0967 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:54.110135 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a360f-5f59-4ba4-904b-2ecbe17694d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:54.111108 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a360f-5f59-4ba4-904b-2ecbe17694d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:54.111615 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a360f-5f59-4ba4-904b-2ecbe17694d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:54.112252 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a360f-5f59-4ba4-904b-2ecbe17694d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:54.112956 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a360f-5f59-4ba4-904b-2ecbe17694d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:54.114945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a360f-5f59-4ba4-904b-2ecbe17694d0 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:54.133773 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 940/1854] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:36:54.137502 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514a732-bfca-4cfa-87d0-e2afe67595ed admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:54.148479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:54.154603 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514a732-bfca-4cfa-87d0-e2afe67595ed admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:54.170072 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf18ee-37b9-4227-b92e-01814acba5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:54.170929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf18ee-37b9-4227-b92e-01814acba5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:54.171234 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf18ee-37b9-4227-b92e-01814acba5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:54.171525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf18ee-37b9-4227-b92e-01814acba5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:54.179946 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf18ee-37b9-4227-b92e-01814acba5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:54.181978 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf18ee-37b9-4227-b92e-01814acba5e2 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:54.197228 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 915/1855] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:54.201578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a360f-5f59-4ba4-904b-2ecbe17694d0 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:54.219994 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a360f-5f59-4ba4-904b-2ecbe17694d0 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:54.225531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17472455-6fb1-424b-a092-1ff3c2995f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:54.226283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17472455-6fb1-424b-a092-1ff3c2995f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:54.226648 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17472455-6fb1-424b-a092-1ff3c2995f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:54.227024 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17472455-6fb1-424b-a092-1ff3c2995f84 admin admin] PATH_INFO: `/v3/projects/e2e415ea5b19456db404b0b11e28b940/users/5c7e5411884a4435928e76cde366076d/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:54.245793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17472455-6fb1-424b-a092-1ff3c2995f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e415ea5b19456db404b0b11e28b940, user_id=5c7e5411884a4435928e76cde366076d, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:54.248653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17472455-6fb1-424b-a092-1ff3c2995f84 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:54.270251 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 941/1856] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:54 2022] PUT /identity/v3/projects/e2e415ea5b19456db404b0b11e28b940/users/5c7e5411884a4435928e76cde366076d/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:36:54.271835 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54589c2a-44c8-46c5-add7-2b7a98812805 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:54.272832 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54589c2a-44c8-46c5-add7-2b7a98812805 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:54.273167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54589c2a-44c8-46c5-add7-2b7a98812805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:54.292999 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-54589c2a-44c8-46c5-add7-2b7a98812805 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:54.294209 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-54589c2a-44c8-46c5-add7-2b7a98812805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:54.362889 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 916/1857] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:54.370745 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17472455-6fb1-424b-a092-1ff3c2995f84 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:54.373967 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-17472455-6fb1-424b-a092-1ff3c2995f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:54.374103 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b4238-975d-4a3e-a903-ca5e6f4dde79 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:54.374701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b4238-975d-4a3e-a903-ca5e6f4dde79 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:54.374701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b4238-975d-4a3e-a903-ca5e6f4dde79 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:54.376250 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 917/1858] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 26 01:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:36:54.415655 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fb69b-e6ee-49f7-afd2-b70456878ad6 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:54.416197 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fb69b-e6ee-49f7-afd2-b70456878ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:54.416197 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fb69b-e6ee-49f7-afd2-b70456878ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:54.459234 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-f40fb69b-e6ee-49f7-afd2-b70456878ad6 None None] MFA Rules not processed for user `df7a1b839a6f4bdb9870217fa4d2527c`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:54.461063 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f40fb69b-e6ee-49f7-afd2-b70456878ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:54.480114 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17472455-6fb1-424b-a092-1ff3c2995f84 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:54.485350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3932bb0-9536-43fa-9a6e-24714935bc88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:54.486219 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3932bb0-9536-43fa-9a6e-24714935bc88 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:54.486855 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3932bb0-9536-43fa-9a6e-24714935bc88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:54.487797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3932bb0-9536-43fa-9a6e-24714935bc88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:54.520019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3932bb0-9536-43fa-9a6e-24714935bc88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:54.524582 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3932bb0-9536-43fa-9a6e-24714935bc88 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:54.547682 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 942/1859] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:54.606656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 918/1860] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 26 01:36:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:36:54.622666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace19bb8-8ad5-4a2b-b7c6-5b20f8024648 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:54.623060 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace19bb8-8ad5-4a2b-b7c6-5b20f8024648 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:54.623441 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace19bb8-8ad5-4a2b-b7c6-5b20f8024648 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:54.625324 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 943/1861] 10.222.0.26 () {54 vars in 961 bytes} [Mon Sep 26 01:36:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:36:54.633011 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d20edd-6246-466b-b961-7a309f8e5944 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:54.633530 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d20edd-6246-466b-b961-7a309f8e5944 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:54.633902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d20edd-6246-466b-b961-7a309f8e5944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:54.657348 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-d0d20edd-6246-466b-b961-7a309f8e5944 None None] MFA Rules not processed for user `df7a1b839a6f4bdb9870217fa4d2527c`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:54.659021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d0d20edd-6246-466b-b961-7a309f8e5944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:54.669902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 919/1862] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Sep 26 01:36:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:54.680023 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace19bb8-8ad5-4a2b-b7c6-5b20f8024648 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:54.702899 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace19bb8-8ad5-4a2b-b7c6-5b20f8024648 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:54.720328 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f611cf-78cf-4f89-bb86-3da679e29882 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7a1b839a6f4bdb9870217fa4d2527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:54.721754 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f611cf-78cf-4f89-bb86-3da679e29882 service placement] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:54.722177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f611cf-78cf-4f89-bb86-3da679e29882 service placement] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:54.722606 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f611cf-78cf-4f89-bb86-3da679e29882 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:54.734653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f611cf-78cf-4f89-bb86-3da679e29882 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:54.736940 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f611cf-78cf-4f89-bb86-3da679e29882 service placement] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:54.750289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 944/1863] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:55.817176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d20edd-6246-466b-b961-7a309f8e5944 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:55.820073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d0d20edd-6246-466b-b961-7a309f8e5944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:55.839221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d20edd-6246-466b-b961-7a309f8e5944 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:55.850079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc48fb1-4924-4aae-beb6-c8f68daf9f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:55.851204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc48fb1-4924-4aae-beb6-c8f68daf9f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:55.851490 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc48fb1-4924-4aae-beb6-c8f68daf9f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:55.851868 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc48fb1-4924-4aae-beb6-c8f68daf9f90 admin admin] PATH_INFO: `/v3/users/d6cf9f85df6b48e1a4ced8a647785b14` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:55.852992 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc48fb1-4924-4aae-beb6-c8f68daf9f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6cf9f85df6b48e1a4ced8a647785b14)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:55.854979 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc48fb1-4924-4aae-beb6-c8f68daf9f90 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:55.915967 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9dc48fb1-4924-4aae-beb6-c8f68daf9f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6cf9f85df6b48e1a4ced8a647785b14'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:55.917255 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9dc48fb1-4924-4aae-beb6-c8f68daf9f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6cf9f85df6b48e1a4ced8a647785b14'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:55.918102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9dc48fb1-4924-4aae-beb6-c8f68daf9f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6cf9f85df6b48e1a4ced8a647785b14'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:55.938936 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9dc48fb1-4924-4aae-beb6-c8f68daf9f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6cf9f85df6b48e1a4ced8a647785b14'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:55.952006 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9dc48fb1-4924-4aae-beb6-c8f68daf9f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6cf9f85df6b48e1a4ced8a647785b14'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:55.968497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:56.000410 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 920/1864] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:36:55 2022] DELETE /identity/v3/users/d6cf9f85df6b48e1a4ced8a647785b14 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:56.033679 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41305070-76d0-4eb8-a71a-ee7690ce63ec None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:56.034301 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41305070-76d0-4eb8-a71a-ee7690ce63ec None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:56.034650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41305070-76d0-4eb8-a71a-ee7690ce63ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:56.095012 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-41305070-76d0-4eb8-a71a-ee7690ce63ec None None] MFA Rules not processed for user `5c7e5411884a4435928e76cde366076d`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:56.097883 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-41305070-76d0-4eb8-a71a-ee7690ce63ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:56.172345 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:56.216046 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 945/1865] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:56.221324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc48fb1-4924-4aae-beb6-c8f68daf9f90 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:56.223365 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-9dc48fb1-4924-4aae-beb6-c8f68daf9f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:56.247327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41305070-76d0-4eb8-a71a-ee7690ce63ec None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:56.250701 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-41305070-76d0-4eb8-a71a-ee7690ce63ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:56.332073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc48fb1-4924-4aae-beb6-c8f68daf9f90 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:56.341453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3d5b2-ff03-4d55-96a1-37a0fbe8d818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:56.342087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3d5b2-ff03-4d55-96a1-37a0fbe8d818 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:56.342368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3d5b2-ff03-4d55-96a1-37a0fbe8d818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:56.342643 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3d5b2-ff03-4d55-96a1-37a0fbe8d818 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:56.343333 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3d5b2-ff03-4d55-96a1-37a0fbe8d818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:56.345235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3d5b2-ff03-4d55-96a1-37a0fbe8d818 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:56.387296 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 921/1866] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:56 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:36:56.391835 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3d5b2-ff03-4d55-96a1-37a0fbe8d818 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:56.403291 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41305070-76d0-4eb8-a71a-ee7690ce63ec None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:56.493117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3d5b2-ff03-4d55-96a1-37a0fbe8d818 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:56.493364 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f66937-087c-45b7-8d66-06227476abf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:56.494046 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f66937-087c-45b7-8d66-06227476abf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:56.494435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f66937-087c-45b7-8d66-06227476abf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:56.494811 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f66937-087c-45b7-8d66-06227476abf2 admin admin] PATH_INFO: `/v3/projects/89f0f562e02648159c811a3bd6078638` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:56.496101 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f66937-087c-45b7-8d66-06227476abf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f0f562e02648159c811a3bd6078638)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:56.498252 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f66937-087c-45b7-8d66-06227476abf2 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:56.499443 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b200e3-3793-45f1-b60b-42d2ec99e7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:56.500250 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b200e3-3793-45f1-b60b-42d2ec99e7c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:56.500702 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b200e3-3793-45f1-b60b-42d2ec99e7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:56.501132 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b200e3-3793-45f1-b60b-42d2ec99e7c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:56.501925 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b200e3-3793-45f1-b60b-42d2ec99e7c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:56.504215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b200e3-3793-45f1-b60b-42d2ec99e7c1 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:56.532436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 922/1867] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:56 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:56.533825 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b200e3-3793-45f1-b60b-42d2ec99e7c1 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:56.545841 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b200e3-3793-45f1-b60b-42d2ec99e7c1 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:56.555265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c1f66937-087c-45b7-8d66-06227476abf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f0f562e02648159c811a3bd6078638', 'request_id': 'req-c1f66937-087c-45b7-8d66-06227476abf2'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:56.562472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c1f66937-087c-45b7-8d66-06227476abf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f0f562e02648159c811a3bd6078638', 'request_id': 'req-c1f66937-087c-45b7-8d66-06227476abf2'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:56.569880 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c1f66937-087c-45b7-8d66-06227476abf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f0f562e02648159c811a3bd6078638', 'request_id': 'req-c1f66937-087c-45b7-8d66-06227476abf2'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:56.598952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c1f66937-087c-45b7-8d66-06227476abf2 admin admin] The token cache is being invalidate because project 89f0f562e02648159c811a3bd6078638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:36:56.599249 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c1f66937-087c-45b7-8d66-06227476abf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:56.599908 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c1f66937-087c-45b7-8d66-06227476abf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:56.602963 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 946/1868] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:36:56 2022] DELETE /identity/v3/projects/89f0f562e02648159c811a3bd6078638 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:36:56.606528 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f66937-087c-45b7-8d66-06227476abf2 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:56.608108 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c1f66937-087c-45b7-8d66-06227476abf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:56.626760 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:56.642810 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b274018-bd0a-4e72-bd13-f2f1482c53a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:56.643691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b274018-bd0a-4e72-bd13-f2f1482c53a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:56.644034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b274018-bd0a-4e72-bd13-f2f1482c53a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:56.644319 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b274018-bd0a-4e72-bd13-f2f1482c53a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:56.644964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b274018-bd0a-4e72-bd13-f2f1482c53a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:56.646566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b274018-bd0a-4e72-bd13-f2f1482c53a0 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:56.657908 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 923/1869] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:56.662341 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b274018-bd0a-4e72-bd13-f2f1482c53a0 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:56.665377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1b274018-bd0a-4e72-bd13-f2f1482c53a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:56.678589 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b274018-bd0a-4e72-bd13-f2f1482c53a0 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:56.683658 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39dfc0-7650-4bf0-8c74-e93ab8ba003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:56.684357 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39dfc0-7650-4bf0-8c74-e93ab8ba003f admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:56.684642 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39dfc0-7650-4bf0-8c74-e93ab8ba003f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:56.684922 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39dfc0-7650-4bf0-8c74-e93ab8ba003f admin admin] PATH_INFO: `/v3/projects/5c7119163dfb47edac2a304a207fd5e7/users/937cc20f7fbf42b29e50d39e80da37db/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:56.687344 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:56.696693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f66937-087c-45b7-8d66-06227476abf2 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:56.701872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637088e7-fe6a-4b84-a384-0bafbc477338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:56.702798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637088e7-fe6a-4b84-a384-0bafbc477338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:56.703347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637088e7-fe6a-4b84-a384-0bafbc477338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:56.703347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637088e7-fe6a-4b84-a384-0bafbc477338 admin admin] PATH_INFO: `/v3/users/eb16a85e131f40ceb404ac8d48fa8422` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:56.704499 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637088e7-fe6a-4b84-a384-0bafbc477338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb16a85e131f40ceb404ac8d48fa8422)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:56.706845 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637088e7-fe6a-4b84-a384-0bafbc477338 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:56.707028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39dfc0-7650-4bf0-8c74-e93ab8ba003f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7119163dfb47edac2a304a207fd5e7, user_id=937cc20f7fbf42b29e50d39e80da37db, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:56.710768 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39dfc0-7650-4bf0-8c74-e93ab8ba003f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:56.740997 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 924/1870] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:56 2022] PUT /identity/v3/projects/5c7119163dfb47edac2a304a207fd5e7/users/937cc20f7fbf42b29e50d39e80da37db/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:36:56.745758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39dfc0-7650-4bf0-8c74-e93ab8ba003f admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:56.775627 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-637088e7-fe6a-4b84-a384-0bafbc477338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb16a85e131f40ceb404ac8d48fa8422'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:56.776361 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-637088e7-fe6a-4b84-a384-0bafbc477338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb16a85e131f40ceb404ac8d48fa8422'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:56.777099 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-637088e7-fe6a-4b84-a384-0bafbc477338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb16a85e131f40ceb404ac8d48fa8422'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:56.791991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-637088e7-fe6a-4b84-a384-0bafbc477338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb16a85e131f40ceb404ac8d48fa8422'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:56.809252 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-637088e7-fe6a-4b84-a384-0bafbc477338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb16a85e131f40ceb404ac8d48fa8422'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:56.829785 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 947/1871] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:36:56 2022] DELETE /identity/v3/users/eb16a85e131f40ceb404ac8d48fa8422 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:36:56.832669 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39dfc0-7650-4bf0-8c74-e93ab8ba003f admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:56.910188 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b73de-d2a7-4cde-b4de-1b4c4fa5f52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:56.910815 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b73de-d2a7-4cde-b4de-1b4c4fa5f52b admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:56.911277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b73de-d2a7-4cde-b4de-1b4c4fa5f52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:56.911580 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b73de-d2a7-4cde-b4de-1b4c4fa5f52b admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:56.912335 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b73de-d2a7-4cde-b4de-1b4c4fa5f52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:56.914406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b73de-d2a7-4cde-b4de-1b4c4fa5f52b admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:56.926916 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 925/1872] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:56.930695 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637088e7-fe6a-4b84-a384-0bafbc477338 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:56.932838 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-637088e7-fe6a-4b84-a384-0bafbc477338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:56.949140 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637088e7-fe6a-4b84-a384-0bafbc477338 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:56.954264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3098a1-d8c4-4750-bd35-d30bf0996bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:56.954954 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3098a1-d8c4-4750-bd35-d30bf0996bba admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:56.955287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3098a1-d8c4-4750-bd35-d30bf0996bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:56.955565 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3098a1-d8c4-4750-bd35-d30bf0996bba admin admin] PATH_INFO: `/v3/projects/5c7119163dfb47edac2a304a207fd5e7/users/937cc20f7fbf42b29e50d39e80da37db/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:56.957960 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3098a1-d8c4-4750-bd35-d30bf0996bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7119163dfb47edac2a304a207fd5e7, user_id=937cc20f7fbf42b29e50d39e80da37db, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:56.972033 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3098a1-d8c4-4750-bd35-d30bf0996bba admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:56.998884 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 948/1873] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:56 2022] PUT /identity/v3/projects/5c7119163dfb47edac2a304a207fd5e7/users/937cc20f7fbf42b29e50d39e80da37db/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:57.052138 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b73de-d2a7-4cde-b4de-1b4c4fa5f52b admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:57.055173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-981b73de-d2a7-4cde-b4de-1b4c4fa5f52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:57.077307 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b73de-d2a7-4cde-b4de-1b4c4fa5f52b admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:57.145430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3098a1-d8c4-4750-bd35-d30bf0996bba admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:57.149289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-aa3098a1-d8c4-4750-bd35-d30bf0996bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:57.162008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee385ceb-2fe3-4a9b-8a09-bca8f46eb566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:57.163627 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee385ceb-2fe3-4a9b-8a09-bca8f46eb566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:57.163904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee385ceb-2fe3-4a9b-8a09-bca8f46eb566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:57.164161 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee385ceb-2fe3-4a9b-8a09-bca8f46eb566 admin admin] PATH_INFO: `/v3/projects/2fca1cf1eee94f028e60ae855785c501` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:57.165418 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee385ceb-2fe3-4a9b-8a09-bca8f46eb566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fca1cf1eee94f028e60ae855785c501)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:57.168372 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee385ceb-2fe3-4a9b-8a09-bca8f46eb566 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:57.208924 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:57.231820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-ee385ceb-2fe3-4a9b-8a09-bca8f46eb566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fca1cf1eee94f028e60ae855785c501', 'request_id': 'req-ee385ceb-2fe3-4a9b-8a09-bca8f46eb566'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:57.239130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-ee385ceb-2fe3-4a9b-8a09-bca8f46eb566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fca1cf1eee94f028e60ae855785c501', 'request_id': 'req-ee385ceb-2fe3-4a9b-8a09-bca8f46eb566'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:57.243728 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3098a1-d8c4-4750-bd35-d30bf0996bba admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:57.248926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-ee385ceb-2fe3-4a9b-8a09-bca8f46eb566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fca1cf1eee94f028e60ae855785c501', 'request_id': 'req-ee385ceb-2fe3-4a9b-8a09-bca8f46eb566'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:57.264654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-ee385ceb-2fe3-4a9b-8a09-bca8f46eb566 admin admin] The token cache is being invalidate because project 2fca1cf1eee94f028e60ae855785c501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:36:57.264956 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-ee385ceb-2fe3-4a9b-8a09-bca8f46eb566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:57.265605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-ee385ceb-2fe3-4a9b-8a09-bca8f46eb566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:57.267639 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 926/1874] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:36:57 2022] DELETE /identity/v3/projects/2fca1cf1eee94f028e60ae855785c501 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:57.273900 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2f109-8e75-4cdc-a05b-52ddcdbe2069 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:57.274343 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2f109-8e75-4cdc-a05b-52ddcdbe2069 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:57.274878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2f109-8e75-4cdc-a05b-52ddcdbe2069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:57.281349 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:57.299030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-90d2f109-8e75-4cdc-a05b-52ddcdbe2069 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:57.300488 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-90d2f109-8e75-4cdc-a05b-52ddcdbe2069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:57.330944 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f401ba-4404-4083-8238-df7ac9dee0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:57.331816 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f401ba-4404-4083-8238-df7ac9dee0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:57.332313 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f401ba-4404-4083-8238-df7ac9dee0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:57.332746 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f401ba-4404-4083-8238-df7ac9dee0d0 admin admin] PATH_INFO: `/v3/users/ec162489661342ed82e65f3271751957` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:57.349771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f401ba-4404-4083-8238-df7ac9dee0d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec162489661342ed82e65f3271751957)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:57.352027 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f401ba-4404-4083-8238-df7ac9dee0d0 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:57.424261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-d1f401ba-4404-4083-8238-df7ac9dee0d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec162489661342ed82e65f3271751957'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:57.425529 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-d1f401ba-4404-4083-8238-df7ac9dee0d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec162489661342ed82e65f3271751957'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:57.426121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-d1f401ba-4404-4083-8238-df7ac9dee0d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec162489661342ed82e65f3271751957'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:57.430237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 927/1875] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:36:57.434941 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1994a7-1dd8-4d4d-a8c0-254734f8c79c None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:57.435466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1994a7-1dd8-4d4d-a8c0-254734f8c79c None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:57.435778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1994a7-1dd8-4d4d-a8c0-254734f8c79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:57.445901 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-d1f401ba-4404-4083-8238-df7ac9dee0d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec162489661342ed82e65f3271751957'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:57.458718 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-1f1994a7-1dd8-4d4d-a8c0-254734f8c79c None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:57.460540 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1f1994a7-1dd8-4d4d-a8c0-254734f8c79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:57.472450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-d1f401ba-4404-4083-8238-df7ac9dee0d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec162489661342ed82e65f3271751957'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:57.477148 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 928/1876] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:57.481304 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1994a7-1dd8-4d4d-a8c0-254734f8c79c None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:57.495143 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 949/1877] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:36:57 2022] DELETE /identity/v3/users/ec162489661342ed82e65f3271751957 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:36:57.495366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1994a7-1dd8-4d4d-a8c0-254734f8c79c None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:57.496610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b93c0f-622c-46d1-a0f1-dbe101afb6b0 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:57.496899 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b93c0f-622c-46d1-a0f1-dbe101afb6b0 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:57.497176 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b93c0f-622c-46d1-a0f1-dbe101afb6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:57.522020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-b2b93c0f-622c-46d1-a0f1-dbe101afb6b0 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:57.523871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b2b93c0f-622c-46d1-a0f1-dbe101afb6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:57.560828 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b828863-588b-4857-9981-55a6d3308a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:57.561935 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b828863-588b-4857-9981-55a6d3308a8d admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:57.561935 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b828863-588b-4857-9981-55a6d3308a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:57.562254 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b828863-588b-4857-9981-55a6d3308a8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:57.563009 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b828863-588b-4857-9981-55a6d3308a8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:36:57.563406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b828863-588b-4857-9981-55a6d3308a8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:57.565067 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b828863-588b-4857-9981-55a6d3308a8d admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:57.584025 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 929/1878] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:36:57.585460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b828863-588b-4857-9981-55a6d3308a8d admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:57.601132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 950/1879] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:36:57.603778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b828863-588b-4857-9981-55a6d3308a8d admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:57.613369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6208fe-8631-46c7-b2a8-1f7fe18e7338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:57.614162 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6208fe-8631-46c7-b2a8-1f7fe18e7338 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:57.617353 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b93c0f-622c-46d1-a0f1-dbe101afb6b0 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:57.617980 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6208fe-8631-46c7-b2a8-1f7fe18e7338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:57.619311 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b2b93c0f-622c-46d1-a0f1-dbe101afb6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:57.620677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6208fe-8631-46c7-b2a8-1f7fe18e7338 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:57.621649 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6208fe-8631-46c7-b2a8-1f7fe18e7338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:57.628460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6208fe-8631-46c7-b2a8-1f7fe18e7338 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:57.692700 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 930/1880] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:57 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:36:57.698626 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6208fe-8631-46c7-b2a8-1f7fe18e7338 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:57.731884 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:57.732688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:57.760071 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b93c0f-622c-46d1-a0f1-dbe101afb6b0 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:57.792307 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6208fe-8631-46c7-b2a8-1f7fe18e7338 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:57.797405 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7452c26-3707-47f5-8b7a-07abd737931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:57.798127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7452c26-3707-47f5-8b7a-07abd737931f admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:57.798805 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7452c26-3707-47f5-8b7a-07abd737931f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:57.798805 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7452c26-3707-47f5-8b7a-07abd737931f admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:57.799801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7452c26-3707-47f5-8b7a-07abd737931f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:57.801761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7452c26-3707-47f5-8b7a-07abd737931f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:57.871152 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 931/1881] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:57 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:57.872149 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7452c26-3707-47f5-8b7a-07abd737931f admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:57.895076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7452c26-3707-47f5-8b7a-07abd737931f admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:57.905630 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b14d8-7235-4c88-ba10-b09f81a95895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:57.907737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b14d8-7235-4c88-ba10-b09f81a95895 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:57.908775 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b14d8-7235-4c88-ba10-b09f81a95895 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:57.909148 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b14d8-7235-4c88-ba10-b09f81a95895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:57.934246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f5be2-f7a6-4d32-adc8-b42b4a663655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:57.936037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f5be2-f7a6-4d32-adc8-b42b4a663655 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:57.936329 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f5be2-f7a6-4d32-adc8-b42b4a663655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:57.936610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f5be2-f7a6-4d32-adc8-b42b4a663655 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:57.937352 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f5be2-f7a6-4d32-adc8-b42b4a663655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:57.939300 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f5be2-f7a6-4d32-adc8-b42b4a663655 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:57.944652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b14d8-7235-4c88-ba10-b09f81a95895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:57.947343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b14d8-7235-4c88-ba10-b09f81a95895 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:57.956980 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 932/1882] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:57.962060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f5be2-f7a6-4d32-adc8-b42b4a663655 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:57.965296 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 951/1883] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:57.972778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f5be2-f7a6-4d32-adc8-b42b4a663655 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:57.978030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa13717-53bb-4ca4-bc1c-49e195c39801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:57.978637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa13717-53bb-4ca4-bc1c-49e195c39801 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:57.978944 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa13717-53bb-4ca4-bc1c-49e195c39801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:57.979326 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa13717-53bb-4ca4-bc1c-49e195c39801 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:57.979962 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa13717-53bb-4ca4-bc1c-49e195c39801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:57.981531 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa13717-53bb-4ca4-bc1c-49e195c39801 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:57.992666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 933/1884] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:57.996905 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b14d8-7235-4c88-ba10-b09f81a95895 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:58.008013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b14d8-7235-4c88-ba10-b09f81a95895 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:58.012705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb9c93-246b-476a-9d9a-433ecb7af2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:58.013357 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb9c93-246b-476a-9d9a-433ecb7af2d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:58.013642 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb9c93-246b-476a-9d9a-433ecb7af2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:58.013919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb9c93-246b-476a-9d9a-433ecb7af2d8 admin admin] PATH_INFO: `/v3/projects/436645a5384d43faab16f783b21642cb/users/89f0568366fe402fa1abe0d86fc635b8/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:58.030151 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb9c93-246b-476a-9d9a-433ecb7af2d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=436645a5384d43faab16f783b21642cb, user_id=89f0568366fe402fa1abe0d86fc635b8, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:58.032833 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb9c93-246b-476a-9d9a-433ecb7af2d8 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:58.046883 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 952/1885] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:57 2022] PUT /identity/v3/projects/436645a5384d43faab16f783b21642cb/users/89f0568366fe402fa1abe0d86fc635b8/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:58.058367 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e337a3d-9937-47e3-80ae-e72a89955d53 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:58.058783 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e337a3d-9937-47e3-80ae-e72a89955d53 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:58.059282 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e337a3d-9937-47e3-80ae-e72a89955d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:58.090885 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-7e337a3d-9937-47e3-80ae-e72a89955d53 None None] MFA Rules not processed for user `89f0568366fe402fa1abe0d86fc635b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:58.092185 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7e337a3d-9937-47e3-80ae-e72a89955d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:58.173743 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 934/1886] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:36:58.179425 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb9c93-246b-476a-9d9a-433ecb7af2d8 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:58.267246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1faaf-78a5-4d61-9a5c-d85e448bf053 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:58.267870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1faaf-78a5-4d61-9a5c-d85e448bf053 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:58.268355 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1faaf-78a5-4d61-9a5c-d85e448bf053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:58.308178 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb9c93-246b-476a-9d9a-433ecb7af2d8 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:58.315175 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-54d1faaf-78a5-4d61-9a5c-d85e448bf053 None None] MFA Rules not processed for user `937cc20f7fbf42b29e50d39e80da37db`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:58.316141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac936fa-98ca-490f-8a5b-a262b9e35be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:58.316726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-54d1faaf-78a5-4d61-9a5c-d85e448bf053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:58.318638 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac936fa-98ca-490f-8a5b-a262b9e35be5 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:58.319196 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac936fa-98ca-490f-8a5b-a262b9e35be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:58.330133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac936fa-98ca-490f-8a5b-a262b9e35be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:58.332387 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac936fa-98ca-490f-8a5b-a262b9e35be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:58.346638 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac936fa-98ca-490f-8a5b-a262b9e35be5 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:58.427049 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 953/1887] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:58 2022] POST /identity/v3/projects => generated 387 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:58.431175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac936fa-98ca-490f-8a5b-a262b9e35be5 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:58.524047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 935/1888] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:58.527714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de45831-e332-4093-9528-dc4c4a5209a4 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:58.528307 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de45831-e332-4093-9528-dc4c4a5209a4 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:58.528733 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de45831-e332-4093-9528-dc4c4a5209a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:58.552594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac936fa-98ca-490f-8a5b-a262b9e35be5 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:58.554498 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:58.569075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613625cf-6241-49b9-860f-615fe79f14bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:58.569799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613625cf-6241-49b9-860f-615fe79f14bf admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:58.570544 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613625cf-6241-49b9-860f-615fe79f14bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:58.570821 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613625cf-6241-49b9-860f-615fe79f14bf admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:58.571552 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613625cf-6241-49b9-860f-615fe79f14bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:58.574006 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613625cf-6241-49b9-860f-615fe79f14bf admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:58.581056 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-8de45831-e332-4093-9528-dc4c4a5209a4 None None] MFA Rules not processed for user `5c7e5411884a4435928e76cde366076d`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:58.582562 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8de45831-e332-4093-9528-dc4c4a5209a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:58.589842 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:58.608530 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 954/1889] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:58 2022] POST /identity/v3/users => generated 300 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:58.609784 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613625cf-6241-49b9-860f-615fe79f14bf admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:58.611841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-613625cf-6241-49b9-860f-615fe79f14bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:58.624872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613625cf-6241-49b9-860f-615fe79f14bf admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:58.634952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2db6f-f922-42c2-8595-71a9747fcb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:58.635596 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2db6f-f922-42c2-8595-71a9747fcb08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:58.635875 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2db6f-f922-42c2-8595-71a9747fcb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:58.636145 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2db6f-f922-42c2-8595-71a9747fcb08 admin admin] PATH_INFO: `/v3/projects/1d89ab15840f4821be220a1370e54aee` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:58.637442 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2db6f-f922-42c2-8595-71a9747fcb08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d89ab15840f4821be220a1370e54aee)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:58.639440 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2db6f-f922-42c2-8595-71a9747fcb08 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:58.672377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 936/1890] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:58.673315 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de45831-e332-4093-9528-dc4c4a5209a4 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:58.686510 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de45831-e332-4093-9528-dc4c4a5209a4 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:58.691804 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05966348-96a5-4c9b-8186-f84dee4c99a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:58.692545 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05966348-96a5-4c9b-8186-f84dee4c99a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:58.692859 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05966348-96a5-4c9b-8186-f84dee4c99a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:58.693136 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05966348-96a5-4c9b-8186-f84dee4c99a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:58.694404 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05966348-96a5-4c9b-8186-f84dee4c99a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:58.696221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05966348-96a5-4c9b-8186-f84dee4c99a9 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:58.707651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 937/1891] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:58.712804 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05966348-96a5-4c9b-8186-f84dee4c99a9 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:58.715295 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-dda2db6f-f922-42c2-8595-71a9747fcb08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d89ab15840f4821be220a1370e54aee', 'request_id': 'req-dda2db6f-f922-42c2-8595-71a9747fcb08'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:58.725972 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-dda2db6f-f922-42c2-8595-71a9747fcb08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d89ab15840f4821be220a1370e54aee', 'request_id': 'req-dda2db6f-f922-42c2-8595-71a9747fcb08'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:58.726758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05966348-96a5-4c9b-8186-f84dee4c99a9 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:58.732594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-dda2db6f-f922-42c2-8595-71a9747fcb08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d89ab15840f4821be220a1370e54aee', 'request_id': 'req-dda2db6f-f922-42c2-8595-71a9747fcb08'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:58.761299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-dda2db6f-f922-42c2-8595-71a9747fcb08 admin admin] The token cache is being invalidate because project 1d89ab15840f4821be220a1370e54aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:36:58.761709 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-dda2db6f-f922-42c2-8595-71a9747fcb08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:58.762482 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-dda2db6f-f922-42c2-8595-71a9747fcb08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:58.764316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 955/1892] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:36:58 2022] DELETE /identity/v3/projects/1d89ab15840f4821be220a1370e54aee => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:58.769023 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30effb-22d4-469b-ab6b-a4cca1c8af68 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:58.769552 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30effb-22d4-469b-ab6b-a4cca1c8af68 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:58.769933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30effb-22d4-469b-ab6b-a4cca1c8af68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:58.793248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-fe30effb-22d4-469b-ab6b-a4cca1c8af68 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:58.794852 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-fe30effb-22d4-469b-ab6b-a4cca1c8af68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:58.831954 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c951673-1a80-4cab-88c9-f77e3557debf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:58.832626 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c951673-1a80-4cab-88c9-f77e3557debf admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:58.832900 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c951673-1a80-4cab-88c9-f77e3557debf admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:58.833203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c951673-1a80-4cab-88c9-f77e3557debf admin admin] PATH_INFO: `/v3/projects/cb15e6efc6e0456fb5d1be5b7bd54d15/users/a793032c9bc048299ab54b832c7531b9/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:58.853048 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c951673-1a80-4cab-88c9-f77e3557debf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb15e6efc6e0456fb5d1be5b7bd54d15, user_id=a793032c9bc048299ab54b832c7531b9, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:58.855944 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c951673-1a80-4cab-88c9-f77e3557debf admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:58.871004 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 938/1893] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:58 2022] PUT /identity/v3/projects/cb15e6efc6e0456fb5d1be5b7bd54d15/users/a793032c9bc048299ab54b832c7531b9/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:58.871932 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c951673-1a80-4cab-88c9-f77e3557debf admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:58.874414 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7c951673-1a80-4cab-88c9-f77e3557debf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:58.883062 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 956/1894] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:58.884001 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30effb-22d4-469b-ab6b-a4cca1c8af68 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:58.885341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-fe30effb-22d4-469b-ab6b-a4cca1c8af68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:58.901468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30effb-22d4-469b-ab6b-a4cca1c8af68 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:58.971701 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e821712-37fa-4c2a-aed6-1aa785fabce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:58.972464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e821712-37fa-4c2a-aed6-1aa785fabce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:58.973056 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e821712-37fa-4c2a-aed6-1aa785fabce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:58.973522 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e821712-37fa-4c2a-aed6-1aa785fabce6 admin admin] PATH_INFO: `/v3/users/9976bf4001984799a4d53b581c4f5790` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:58.974794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e821712-37fa-4c2a-aed6-1aa785fabce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9976bf4001984799a4d53b581c4f5790)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:58.979568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e821712-37fa-4c2a-aed6-1aa785fabce6 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:58.983674 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c951673-1a80-4cab-88c9-f77e3557debf admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:59.004371 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbff080-6d73-4191-af3c-528e04377972 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:59.005321 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbff080-6d73-4191-af3c-528e04377972 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:59.005778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbff080-6d73-4191-af3c-528e04377972 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:59.006217 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbff080-6d73-4191-af3c-528e04377972 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:59.009493 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-9fbff080-6d73-4191-af3c-528e04377972 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:59.019973 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:59.035406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:59.057298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-0e821712-37fa-4c2a-aed6-1aa785fabce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9976bf4001984799a4d53b581c4f5790'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:59.058164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-0e821712-37fa-4c2a-aed6-1aa785fabce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9976bf4001984799a4d53b581c4f5790'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:59.058955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-0e821712-37fa-4c2a-aed6-1aa785fabce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9976bf4001984799a4d53b581c4f5790'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:59.072858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-0e821712-37fa-4c2a-aed6-1aa785fabce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9976bf4001984799a4d53b581c4f5790'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:59.079943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-0e821712-37fa-4c2a-aed6-1aa785fabce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9976bf4001984799a4d53b581c4f5790'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:36:59.090079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbff080-6d73-4191-af3c-528e04377972 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:59.091621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbff080-6d73-4191-af3c-528e04377972 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:59.094682 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 957/1895] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:36:58 2022] DELETE /identity/v3/users/9976bf4001984799a4d53b581c4f5790 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:59.095727 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e821712-37fa-4c2a-aed6-1aa785fabce6 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:59.097104 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0e821712-37fa-4c2a-aed6-1aa785fabce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:59.104324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 939/1896] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:59.105780 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306188f-fd48-40e6-b032-2d005adf0cf9 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:59.106208 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306188f-fd48-40e6-b032-2d005adf0cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:59.106681 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306188f-fd48-40e6-b032-2d005adf0cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:59.131291 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-8306188f-fd48-40e6-b032-2d005adf0cf9 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:59.132531 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8306188f-fd48-40e6-b032-2d005adf0cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:59.203954 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e821712-37fa-4c2a-aed6-1aa785fabce6 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:59.213255 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10654c4b-d18e-4aa9-9a6c-5310742757b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:59.213875 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10654c4b-d18e-4aa9-9a6c-5310742757b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:59.214203 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10654c4b-d18e-4aa9-9a6c-5310742757b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:59.214518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10654c4b-d18e-4aa9-9a6c-5310742757b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:59.215242 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10654c4b-d18e-4aa9-9a6c-5310742757b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:59.217516 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10654c4b-d18e-4aa9-9a6c-5310742757b7 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:59.228092 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 940/1897] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:59.229448 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446d891-a920-470f-8916-cefae5b993bb None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:59.229813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446d891-a920-470f-8916-cefae5b993bb None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:59.230139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446d891-a920-470f-8916-cefae5b993bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:59.230859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 958/1898] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:59.232721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10654c4b-d18e-4aa9-9a6c-5310742757b7 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:59.255551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10654c4b-d18e-4aa9-9a6c-5310742757b7 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:59.261282 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec2576-536e-4a08-aaac-32956f93b441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:59.262084 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec2576-536e-4a08-aaac-32956f93b441 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:59.262454 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec2576-536e-4a08-aaac-32956f93b441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:59.262799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec2576-536e-4a08-aaac-32956f93b441 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:59.263095 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2446d891-a920-470f-8916-cefae5b993bb None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:59.263673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec2576-536e-4a08-aaac-32956f93b441 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:36:59.264042 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec2576-536e-4a08-aaac-32956f93b441 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:59.265717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec2576-536e-4a08-aaac-32956f93b441 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:59.268762 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2446d891-a920-470f-8916-cefae5b993bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:59.281584 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 959/1899] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:36:59.282810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec2576-536e-4a08-aaac-32956f93b441 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:59.288164 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 941/1900] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:59.291924 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446d891-a920-470f-8916-cefae5b993bb None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:59.299722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446d891-a920-470f-8916-cefae5b993bb None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:59.306555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83050a4a-f0f5-4858-a4d2-0978f9bfe166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:59.307410 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83050a4a-f0f5-4858-a4d2-0978f9bfe166 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:59.307691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83050a4a-f0f5-4858-a4d2-0978f9bfe166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:59.307962 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83050a4a-f0f5-4858-a4d2-0978f9bfe166 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:59.308609 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83050a4a-f0f5-4858-a4d2-0978f9bfe166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:59.310534 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83050a4a-f0f5-4858-a4d2-0978f9bfe166 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:59.313407 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec2576-536e-4a08-aaac-32956f93b441 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:59.324952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9ef04-9621-4db4-944d-d23d7b35baf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:59.326013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9ef04-9621-4db4-944d-d23d7b35baf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:59.326606 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9ef04-9621-4db4-944d-d23d7b35baf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:59.327304 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9ef04-9621-4db4-944d-d23d7b35baf6 admin admin] PATH_INFO: `/v3/projects/cb15e6efc6e0456fb5d1be5b7bd54d15/users/a793032c9bc048299ab54b832c7531b9/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:59.329695 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9ef04-9621-4db4-944d-d23d7b35baf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb15e6efc6e0456fb5d1be5b7bd54d15, user_id=a793032c9bc048299ab54b832c7531b9, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:59.332873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9ef04-9621-4db4-944d-d23d7b35baf6 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:59.349515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 942/1901] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:36:59 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:59.350638 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83050a4a-f0f5-4858-a4d2-0978f9bfe166 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:59.352544 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-83050a4a-f0f5-4858-a4d2-0978f9bfe166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:59.356342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 960/1902] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:59 2022] PUT /identity/v3/projects/cb15e6efc6e0456fb5d1be5b7bd54d15/users/a793032c9bc048299ab54b832c7531b9/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:36:59.357282 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9ef04-9621-4db4-944d-d23d7b35baf6 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:59.441768 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83050a4a-f0f5-4858-a4d2-0978f9bfe166 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:59.450056 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad738f-3347-487e-9bf6-20f3cb27172a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:59.450759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad738f-3347-487e-9bf6-20f3cb27172a service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:59.451175 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad738f-3347-487e-9bf6-20f3cb27172a service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:59.451522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad738f-3347-487e-9bf6-20f3cb27172a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:59.461182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9ef04-9621-4db4-944d-d23d7b35baf6 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:59.474287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:59.517368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:59.545641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad738f-3347-487e-9bf6-20f3cb27172a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:59.548195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad738f-3347-487e-9bf6-20f3cb27172a service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:59.548707 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79110f43-fdb2-4b1b-872f-0518c825a763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:59.549385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79110f43-fdb2-4b1b-872f-0518c825a763 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:59.549675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79110f43-fdb2-4b1b-872f-0518c825a763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:59.549952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79110f43-fdb2-4b1b-872f-0518c825a763 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:59.551334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79110f43-fdb2-4b1b-872f-0518c825a763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:59.553490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79110f43-fdb2-4b1b-872f-0518c825a763 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:59.567044 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 943/1903] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:36:59.568470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab08d5-772c-4b9a-81bd-1a3c3c05767f None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:59.569421 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab08d5-772c-4b9a-81bd-1a3c3c05767f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:59.569887 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab08d5-772c-4b9a-81bd-1a3c3c05767f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:59.612951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 961/1904] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:36:59 2022] POST /identity/v3/users => generated 288 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:36:59.614547 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79110f43-fdb2-4b1b-872f-0518c825a763 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:59.629383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79110f43-fdb2-4b1b-872f-0518c825a763 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:59.633564 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-02ab08d5-772c-4b9a-81bd-1a3c3c05767f None None] MFA Rules not processed for user `a793032c9bc048299ab54b832c7531b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:59.635718 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-02ab08d5-772c-4b9a-81bd-1a3c3c05767f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:59.636088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6795e-3ec0-4599-932c-816c28d4728e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:59.636758 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6795e-3ec0-4599-932c-816c28d4728e admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:59.637108 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6795e-3ec0-4599-932c-816c28d4728e admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:59.637498 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6795e-3ec0-4599-932c-816c28d4728e admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:59.638203 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6795e-3ec0-4599-932c-816c28d4728e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:59.640565 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6795e-3ec0-4599-932c-816c28d4728e admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:59.658727 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 962/1905] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:59.662320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6795e-3ec0-4599-932c-816c28d4728e admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:59.681226 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6795e-3ec0-4599-932c-816c28d4728e admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:59.686815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ce390-f162-4a36-92f2-9b3ca6f1a8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:59.688452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ce390-f162-4a36-92f2-9b3ca6f1a8cf admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:59.689544 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ce390-f162-4a36-92f2-9b3ca6f1a8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:59.690181 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ce390-f162-4a36-92f2-9b3ca6f1a8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:59.691367 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ce390-f162-4a36-92f2-9b3ca6f1a8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:59.693114 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ce390-f162-4a36-92f2-9b3ca6f1a8cf admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:59.710587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 963/1906] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:36:59.714697 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ce390-f162-4a36-92f2-9b3ca6f1a8cf admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:59.729533 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ce390-f162-4a36-92f2-9b3ca6f1a8cf admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:59.735698 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cda6b-6664-482b-82d0-f4917288426c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:59.737517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cda6b-6664-482b-82d0-f4917288426c admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:59.737812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cda6b-6664-482b-82d0-f4917288426c admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:59.738735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cda6b-6664-482b-82d0-f4917288426c admin admin] PATH_INFO: `/v3/projects/f663fc34118b4e558043dee5be5e7676/users/2939066c6464457fa3c13f94154a793e/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:59.752826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 944/1907] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:59.762375 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab08d5-772c-4b9a-81bd-1a3c3c05767f None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:59.764136 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-02ab08d5-772c-4b9a-81bd-1a3c3c05767f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:59.766626 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566cda6b-6664-482b-82d0-f4917288426c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f663fc34118b4e558043dee5be5e7676, user_id=2939066c6464457fa3c13f94154a793e, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:36:59.769596 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566cda6b-6664-482b-82d0-f4917288426c admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:36:59.799230 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 964/1908] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:36:59 2022] PUT /identity/v3/projects/f663fc34118b4e558043dee5be5e7676/users/2939066c6464457fa3c13f94154a793e/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:36:59.810190 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297da815-00ac-47c1-b5eb-b4e856c11b72 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:59.811459 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297da815-00ac-47c1-b5eb-b4e856c11b72 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:59.811922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297da815-00ac-47c1-b5eb-b4e856c11b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:59.860274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-297da815-00ac-47c1-b5eb-b4e856c11b72 None None] MFA Rules not processed for user `2939066c6464457fa3c13f94154a793e`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:36:59.861799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-297da815-00ac-47c1-b5eb-b4e856c11b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:36:59.869032 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab08d5-772c-4b9a-81bd-1a3c3c05767f None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:36:59.958692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde22adb-1638-4dd4-8c10-8d5a3d1c5b09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:36:59.959937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde22adb-1638-4dd4-8c10-8d5a3d1c5b09 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:36:59.960548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde22adb-1638-4dd4-8c10-8d5a3d1c5b09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:36:59.960869 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde22adb-1638-4dd4-8c10-8d5a3d1c5b09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:36:59.976141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 965/1909] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:36:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:36:59.977155 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297da815-00ac-47c1-b5eb-b4e856c11b72 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:36:59.978485 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-297da815-00ac-47c1-b5eb-b4e856c11b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:00.071763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:00.083767 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:00.113079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297da815-00ac-47c1-b5eb-b4e856c11b72 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:00.113278 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde22adb-1638-4dd4-8c10-8d5a3d1c5b09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:00.116217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ee41c-05f4-418a-9f3a-27517dae13a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:00.117006 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ee41c-05f4-418a-9f3a-27517dae13a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:00.117575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ee41c-05f4-418a-9f3a-27517dae13a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:00.117861 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ee41c-05f4-418a-9f3a-27517dae13a5 admin admin] PATH_INFO: `/v3/projects/46fddd5a8d494eb59853be31f3041483` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:00.119043 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ee41c-05f4-418a-9f3a-27517dae13a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46fddd5a8d494eb59853be31f3041483)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:00.121652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ee41c-05f4-418a-9f3a-27517dae13a5 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:00.124605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde22adb-1638-4dd4-8c10-8d5a3d1c5b09 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:00.150400 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 945/1910] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:36:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:37:00.151604 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde22adb-1638-4dd4-8c10-8d5a3d1c5b09 service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:00.153330 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-fde22adb-1638-4dd4-8c10-8d5a3d1c5b09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:00.168292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde22adb-1638-4dd4-8c10-8d5a3d1c5b09 service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:00.173328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1979f2d-218c-41fb-9b9b-07ae7c5e80f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:00.173909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1979f2d-218c-41fb-9b9b-07ae7c5e80f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:00.174310 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1979f2d-218c-41fb-9b9b-07ae7c5e80f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:00.174592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1979f2d-218c-41fb-9b9b-07ae7c5e80f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:00.185516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1979f2d-218c-41fb-9b9b-07ae7c5e80f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:00.186978 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1979f2d-218c-41fb-9b9b-07ae7c5e80f3 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:00.213915 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 946/1911] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:00.214994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1979f2d-218c-41fb-9b9b-07ae7c5e80f3 service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:00.229944 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f73ee41c-05f4-418a-9f3a-27517dae13a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46fddd5a8d494eb59853be31f3041483', 'request_id': 'req-f73ee41c-05f4-418a-9f3a-27517dae13a5'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:00.240113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f73ee41c-05f4-418a-9f3a-27517dae13a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46fddd5a8d494eb59853be31f3041483', 'request_id': 'req-f73ee41c-05f4-418a-9f3a-27517dae13a5'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:00.244970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1979f2d-218c-41fb-9b9b-07ae7c5e80f3 service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:00.249249 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f73ee41c-05f4-418a-9f3a-27517dae13a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46fddd5a8d494eb59853be31f3041483', 'request_id': 'req-f73ee41c-05f4-418a-9f3a-27517dae13a5'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:00.269681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f73ee41c-05f4-418a-9f3a-27517dae13a5 admin admin] The token cache is being invalidate because project 46fddd5a8d494eb59853be31f3041483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:00.270127 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f73ee41c-05f4-418a-9f3a-27517dae13a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:00.270862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f73ee41c-05f4-418a-9f3a-27517dae13a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:00.277933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 966/1912] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:36:59 2022] DELETE /identity/v3/projects/46fddd5a8d494eb59853be31f3041483 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:00.279750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ee41c-05f4-418a-9f3a-27517dae13a5 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:00.281596 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f73ee41c-05f4-418a-9f3a-27517dae13a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:00.357546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e1610-22b9-4676-955f-32869a78a202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:00.358613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e1610-22b9-4676-955f-32869a78a202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:00.359287 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e1610-22b9-4676-955f-32869a78a202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:00.359874 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e1610-22b9-4676-955f-32869a78a202 admin admin] PATH_INFO: `/v3/users/89f0568366fe402fa1abe0d86fc635b8` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:00.361527 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e1610-22b9-4676-955f-32869a78a202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f0568366fe402fa1abe0d86fc635b8)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:00.367657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e1610-22b9-4676-955f-32869a78a202 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:00.407217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ee41c-05f4-418a-9f3a-27517dae13a5 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:00.417561 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6771b-961e-4b7d-bdae-6265c9e1518c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:00.418214 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6771b-961e-4b7d-bdae-6265c9e1518c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:00.418592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6771b-961e-4b7d-bdae-6265c9e1518c admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:00.418941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6771b-961e-4b7d-bdae-6265c9e1518c admin admin] PATH_INFO: `/v3/users/673e9d23317542f880fb8c2c1853e9b7` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:00.420264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6771b-961e-4b7d-bdae-6265c9e1518c admin admin] RBAC: Authorizing `identity:delete_user(user_id=673e9d23317542f880fb8c2c1853e9b7)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:00.423331 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6771b-961e-4b7d-bdae-6265c9e1518c admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:00.473360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-ca7e1610-22b9-4676-955f-32869a78a202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f0568366fe402fa1abe0d86fc635b8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:00.474012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-ca7e1610-22b9-4676-955f-32869a78a202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f0568366fe402fa1abe0d86fc635b8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:00.474638 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-ca7e1610-22b9-4676-955f-32869a78a202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f0568366fe402fa1abe0d86fc635b8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:00.498643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-afd6771b-961e-4b7d-bdae-6265c9e1518c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '673e9d23317542f880fb8c2c1853e9b7'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:00.500608 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-afd6771b-961e-4b7d-bdae-6265c9e1518c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '673e9d23317542f880fb8c2c1853e9b7'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:00.500932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-afd6771b-961e-4b7d-bdae-6265c9e1518c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '673e9d23317542f880fb8c2c1853e9b7'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:00.511158 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-ca7e1610-22b9-4676-955f-32869a78a202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f0568366fe402fa1abe0d86fc635b8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:00.521476 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-afd6771b-961e-4b7d-bdae-6265c9e1518c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '673e9d23317542f880fb8c2c1853e9b7'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:00.535231 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-afd6771b-961e-4b7d-bdae-6265c9e1518c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '673e9d23317542f880fb8c2c1853e9b7'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:00.540803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-ca7e1610-22b9-4676-955f-32869a78a202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f0568366fe402fa1abe0d86fc635b8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:00.554662 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:00.573715 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 967/1913] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:00 2022] DELETE /identity/v3/users/673e9d23317542f880fb8c2c1853e9b7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:00.603792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 947/1914] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:00 2022] DELETE /identity/v3/users/89f0568366fe402fa1abe0d86fc635b8 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:00.606077 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74951da0-ae37-4178-b505-c91af3916c9a None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:00.606676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74951da0-ae37-4178-b505-c91af3916c9a None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:00.607122 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74951da0-ae37-4178-b505-c91af3916c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:00.645069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-74951da0-ae37-4178-b505-c91af3916c9a None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:00.647989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-74951da0-ae37-4178-b505-c91af3916c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:00.828291 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 968/1915] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:00.841286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e1610-22b9-4676-955f-32869a78a202 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:00.843398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ca7e1610-22b9-4676-955f-32869a78a202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:00.951821 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:00.977916 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e1610-22b9-4676-955f-32869a78a202 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:00.981809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1a444-332e-4342-87fe-a87825d5e46e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:00.982486 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1a444-332e-4342-87fe-a87825d5e46e service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:00.982770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1a444-332e-4342-87fe-a87825d5e46e service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:00.983073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1a444-332e-4342-87fe-a87825d5e46e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:00.993307 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1a444-332e-4342-87fe-a87825d5e46e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:00.994775 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1a444-332e-4342-87fe-a87825d5e46e service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:01.004793 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 948/1916] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:01.154080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74951da0-ae37-4178-b505-c91af3916c9a None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:01.155560 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-74951da0-ae37-4178-b505-c91af3916c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:01.172465 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74951da0-ae37-4178-b505-c91af3916c9a None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:01.183160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00127a0e-2040-4b2a-9e24-7e4295b960b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:01.183792 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00127a0e-2040-4b2a-9e24-7e4295b960b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:01.184072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00127a0e-2040-4b2a-9e24-7e4295b960b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:01.184343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00127a0e-2040-4b2a-9e24-7e4295b960b8 admin admin] PATH_INFO: `/v3/projects/53c9ebd6985f4f86994e84e4dff880aa` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:01.185482 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00127a0e-2040-4b2a-9e24-7e4295b960b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53c9ebd6985f4f86994e84e4dff880aa)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:01.187546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00127a0e-2040-4b2a-9e24-7e4295b960b8 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:01.238820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-00127a0e-2040-4b2a-9e24-7e4295b960b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53c9ebd6985f4f86994e84e4dff880aa', 'request_id': 'req-00127a0e-2040-4b2a-9e24-7e4295b960b8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:01.246801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-00127a0e-2040-4b2a-9e24-7e4295b960b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53c9ebd6985f4f86994e84e4dff880aa', 'request_id': 'req-00127a0e-2040-4b2a-9e24-7e4295b960b8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:01.254021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-00127a0e-2040-4b2a-9e24-7e4295b960b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53c9ebd6985f4f86994e84e4dff880aa', 'request_id': 'req-00127a0e-2040-4b2a-9e24-7e4295b960b8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:01.269604 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-00127a0e-2040-4b2a-9e24-7e4295b960b8 admin admin] The token cache is being invalidate because project 53c9ebd6985f4f86994e84e4dff880aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:01.269895 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-00127a0e-2040-4b2a-9e24-7e4295b960b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:01.270549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-00127a0e-2040-4b2a-9e24-7e4295b960b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:01.276296 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 969/1917] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:01 2022] DELETE /identity/v3/projects/53c9ebd6985f4f86994e84e4dff880aa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:01.278859 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0b1d0-4b6b-40fe-9a76-77e6fa064b32 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:01.279410 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0b1d0-4b6b-40fe-9a76-77e6fa064b32 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:01.279926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0b1d0-4b6b-40fe-9a76-77e6fa064b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:01.304536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2fa0b1d0-4b6b-40fe-9a76-77e6fa064b32 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:01.305761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2fa0b1d0-4b6b-40fe-9a76-77e6fa064b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:01.423658 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 949/1918] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:01.432217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5a113-337b-46d2-966c-c401250f343f None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:01.432534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5a113-337b-46d2-966c-c401250f343f None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:01.433076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5a113-337b-46d2-966c-c401250f343f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:01.440827 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0b1d0-4b6b-40fe-9a76-77e6fa064b32 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:01.448226 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2fa0b1d0-4b6b-40fe-9a76-77e6fa064b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:01.470547 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0b1d0-4b6b-40fe-9a76-77e6fa064b32 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:01.476779 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c29f8-22da-4350-9afd-6266aae06811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:01.477423 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c29f8-22da-4350-9afd-6266aae06811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:01.477757 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c29f8-22da-4350-9afd-6266aae06811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:01.478036 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c29f8-22da-4350-9afd-6266aae06811 admin admin] PATH_INFO: `/v3/projects/436645a5384d43faab16f783b21642cb` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:01.479406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c29f8-22da-4350-9afd-6266aae06811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=436645a5384d43faab16f783b21642cb)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:01.480611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-48c5a113-337b-46d2-966c-c401250f343f None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:01.481602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c29f8-22da-4350-9afd-6266aae06811 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:01.481854 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-48c5a113-337b-46d2-966c-c401250f343f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:01.494727 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 970/1919] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:37:01.495609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5a113-337b-46d2-966c-c401250f343f None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:01.505324 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5a113-337b-46d2-966c-c401250f343f None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:01.513077 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a1f58-b865-4bb3-8760-41f6ab0a4ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:01.513784 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a1f58-b865-4bb3-8760-41f6ab0a4ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:01.514035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a1f58-b865-4bb3-8760-41f6ab0a4ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:01.514352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a1f58-b865-4bb3-8760-41f6ab0a4ca7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:01.515272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a1f58-b865-4bb3-8760-41f6ab0a4ca7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:37:01.515633 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a1f58-b865-4bb3-8760-41f6ab0a4ca7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:01.517225 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a1f58-b865-4bb3-8760-41f6ab0a4ca7 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:01.532022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 971/1920] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:37:01.536895 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a1f58-b865-4bb3-8760-41f6ab0a4ca7 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:01.548285 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a1f58-b865-4bb3-8760-41f6ab0a4ca7 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:01.560846 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bd6c29f8-22da-4350-9afd-6266aae06811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436645a5384d43faab16f783b21642cb', 'request_id': 'req-bd6c29f8-22da-4350-9afd-6266aae06811'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:01.578786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bd6c29f8-22da-4350-9afd-6266aae06811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436645a5384d43faab16f783b21642cb', 'request_id': 'req-bd6c29f8-22da-4350-9afd-6266aae06811'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:01.589455 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bd6c29f8-22da-4350-9afd-6266aae06811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436645a5384d43faab16f783b21642cb', 'request_id': 'req-bd6c29f8-22da-4350-9afd-6266aae06811'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:01.619268 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bd6c29f8-22da-4350-9afd-6266aae06811 admin admin] The token cache is being invalidate because project 436645a5384d43faab16f783b21642cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:01.619268 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bd6c29f8-22da-4350-9afd-6266aae06811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:01.623856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bd6c29f8-22da-4350-9afd-6266aae06811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:01.625475 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 950/1921] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:01 2022] DELETE /identity/v3/projects/436645a5384d43faab16f783b21642cb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:01.631010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c29f8-22da-4350-9afd-6266aae06811 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:01.636741 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-bd6c29f8-22da-4350-9afd-6266aae06811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:01.638588 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a2f68-6114-4c3c-b1d3-8009ea1aaf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:01.639497 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a2f68-6114-4c3c-b1d3-8009ea1aaf0c admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:01.639887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a2f68-6114-4c3c-b1d3-8009ea1aaf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:01.640265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a2f68-6114-4c3c-b1d3-8009ea1aaf0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:01.641228 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a2f68-6114-4c3c-b1d3-8009ea1aaf0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:01.643940 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a2f68-6114-4c3c-b1d3-8009ea1aaf0c admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:01.651401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:01.665265 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c29f8-22da-4350-9afd-6266aae06811 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:01.674557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c44e44-a1d9-4fbd-bb84-12055432385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:01.675093 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c44e44-a1d9-4fbd-bb84-12055432385a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:01.675375 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c44e44-a1d9-4fbd-bb84-12055432385a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:01.675665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c44e44-a1d9-4fbd-bb84-12055432385a admin admin] PATH_INFO: `/v3/users/a793032c9bc048299ab54b832c7531b9` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:01.677009 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c44e44-a1d9-4fbd-bb84-12055432385a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a793032c9bc048299ab54b832c7531b9)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:01.685931 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c44e44-a1d9-4fbd-bb84-12055432385a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:01.690170 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 972/1922] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:01 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:01.702980 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a2f68-6114-4c3c-b1d3-8009ea1aaf0c admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:01.702980 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-603a2f68-6114-4c3c-b1d3-8009ea1aaf0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:01.747887 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-32c44e44-a1d9-4fbd-bb84-12055432385a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a793032c9bc048299ab54b832c7531b9'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:01.748493 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-32c44e44-a1d9-4fbd-bb84-12055432385a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a793032c9bc048299ab54b832c7531b9'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:01.749123 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-32c44e44-a1d9-4fbd-bb84-12055432385a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a793032c9bc048299ab54b832c7531b9'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:01.758320 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:01.763661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-32c44e44-a1d9-4fbd-bb84-12055432385a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a793032c9bc048299ab54b832c7531b9'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:01.772110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-32c44e44-a1d9-4fbd-bb84-12055432385a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a793032c9bc048299ab54b832c7531b9'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:01.786900 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 951/1923] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:01 2022] DELETE /identity/v3/users/a793032c9bc048299ab54b832c7531b9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:01.789199 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a2f68-6114-4c3c-b1d3-8009ea1aaf0c admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:01.851954 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776d0da-eebf-4340-937f-58ba2b82e77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:01.852565 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776d0da-eebf-4340-937f-58ba2b82e77d admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:01.852844 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776d0da-eebf-4340-937f-58ba2b82e77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:01.853136 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776d0da-eebf-4340-937f-58ba2b82e77d admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:01.853799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776d0da-eebf-4340-937f-58ba2b82e77d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:01.855891 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776d0da-eebf-4340-937f-58ba2b82e77d admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:01.886343 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c44e44-a1d9-4fbd-bb84-12055432385a admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:01.887213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 973/1924] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:01 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:01.888474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-32c44e44-a1d9-4fbd-bb84-12055432385a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:01.905928 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c44e44-a1d9-4fbd-bb84-12055432385a admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:01.916674 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4dd24-369b-480e-8eeb-aa25e55f254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:01.917480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4dd24-369b-480e-8eeb-aa25e55f254e admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:01.917903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4dd24-369b-480e-8eeb-aa25e55f254e admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:01.918309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4dd24-369b-480e-8eeb-aa25e55f254e admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:01.919223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4dd24-369b-480e-8eeb-aa25e55f254e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:01.920954 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4dd24-369b-480e-8eeb-aa25e55f254e admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:01.938395 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 952/1925] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:01.943031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776d0da-eebf-4340-937f-58ba2b82e77d admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:01.957143 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776d0da-eebf-4340-937f-58ba2b82e77d admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:01.963571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4dd24-369b-480e-8eeb-aa25e55f254e admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:01.965608 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-05c4dd24-369b-480e-8eeb-aa25e55f254e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:01.966078 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35e6a2-729b-461c-973f-8fe5e5d5aba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:01.966812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35e6a2-729b-461c-973f-8fe5e5d5aba2 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:01.967215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35e6a2-729b-461c-973f-8fe5e5d5aba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:01.967587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35e6a2-729b-461c-973f-8fe5e5d5aba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:01.968685 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35e6a2-729b-461c-973f-8fe5e5d5aba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:01.970468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35e6a2-729b-461c-973f-8fe5e5d5aba2 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:01.984370 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 974/1926] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:37:01.988298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35e6a2-729b-461c-973f-8fe5e5d5aba2 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:01.988837 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4dd24-369b-480e-8eeb-aa25e55f254e admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:01.994893 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43cd7c-69d4-43f2-8750-5773d2f9c026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:01.995555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43cd7c-69d4-43f2-8750-5773d2f9c026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:01.995956 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43cd7c-69d4-43f2-8750-5773d2f9c026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:01.996236 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43cd7c-69d4-43f2-8750-5773d2f9c026 admin admin] PATH_INFO: `/v3/users/8bd4e77e6c2f4847a8ed1fc8779aca7e` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:01.998395 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43cd7c-69d4-43f2-8750-5773d2f9c026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd4e77e6c2f4847a8ed1fc8779aca7e)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:02.000544 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43cd7c-69d4-43f2-8750-5773d2f9c026 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:02.002135 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35e6a2-729b-461c-973f-8fe5e5d5aba2 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:02.008313 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6f8bd-02c7-44a9-b8bc-ba0be8ca45dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:02.009219 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6f8bd-02c7-44a9-b8bc-ba0be8ca45dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:02.009595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6f8bd-02c7-44a9-b8bc-ba0be8ca45dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:02.009985 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6f8bd-02c7-44a9-b8bc-ba0be8ca45dc admin admin] PATH_INFO: `/v3/projects/177f34b8a42f4e9cb4a18e4ff00669d2/users/f5da61e8b515416e813176379918f476/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:02.031996 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6f8bd-02c7-44a9-b8bc-ba0be8ca45dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=177f34b8a42f4e9cb4a18e4ff00669d2, user_id=f5da61e8b515416e813176379918f476, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:02.036000 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6f8bd-02c7-44a9-b8bc-ba0be8ca45dc admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:02.057938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 975/1927] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:01 2022] PUT /identity/v3/projects/177f34b8a42f4e9cb4a18e4ff00669d2/users/f5da61e8b515416e813176379918f476/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:02.070355 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8f43cd7c-69d4-43f2-8750-5773d2f9c026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd4e77e6c2f4847a8ed1fc8779aca7e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:02.071164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b85a7-239d-4b30-acd5-6f98402e601c None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:02.071492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b85a7-239d-4b30-acd5-6f98402e601c None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:02.071772 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b85a7-239d-4b30-acd5-6f98402e601c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:02.072891 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8f43cd7c-69d4-43f2-8750-5773d2f9c026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd4e77e6c2f4847a8ed1fc8779aca7e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:02.073932 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8f43cd7c-69d4-43f2-8750-5773d2f9c026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd4e77e6c2f4847a8ed1fc8779aca7e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:02.092317 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8f43cd7c-69d4-43f2-8750-5773d2f9c026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd4e77e6c2f4847a8ed1fc8779aca7e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:02.107629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8f43cd7c-69d4-43f2-8750-5773d2f9c026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd4e77e6c2f4847a8ed1fc8779aca7e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:02.121710 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-344b85a7-239d-4b30-acd5-6f98402e601c None None] MFA Rules not processed for user `f5da61e8b515416e813176379918f476`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:02.122972 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-344b85a7-239d-4b30-acd5-6f98402e601c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:02.141899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 953/1928] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:01 2022] DELETE /identity/v3/users/8bd4e77e6c2f4847a8ed1fc8779aca7e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:37:02.141899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43cd7c-69d4-43f2-8750-5773d2f9c026 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:02.142654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8f43cd7c-69d4-43f2-8750-5773d2f9c026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:02.182657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:02.217067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 976/1929] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:02.218315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a164d-94a9-4b55-bd54-3a91dbabcfc1 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:02.218605 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a164d-94a9-4b55-bd54-3a91dbabcfc1 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:02.218913 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a164d-94a9-4b55-bd54-3a91dbabcfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:02.224360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43cd7c-69d4-43f2-8750-5773d2f9c026 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:02.229556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933d74b-ac18-4576-b84d-325809d7ce28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:02.230817 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933d74b-ac18-4576-b84d-325809d7ce28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:02.231121 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933d74b-ac18-4576-b84d-325809d7ce28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:02.231393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933d74b-ac18-4576-b84d-325809d7ce28 admin admin] PATH_INFO: `/v3/projects/cb15e6efc6e0456fb5d1be5b7bd54d15` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:02.232513 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933d74b-ac18-4576-b84d-325809d7ce28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb15e6efc6e0456fb5d1be5b7bd54d15)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:02.234413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933d74b-ac18-4576-b84d-325809d7ce28 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:02.239579 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-0c3a164d-94a9-4b55-bd54-3a91dbabcfc1 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:02.240827 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0c3a164d-94a9-4b55-bd54-3a91dbabcfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:02.249190 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 977/1930] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:02.249887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a164d-94a9-4b55-bd54-3a91dbabcfc1 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:02.251484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0c3a164d-94a9-4b55-bd54-3a91dbabcfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:02.264077 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a164d-94a9-4b55-bd54-3a91dbabcfc1 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:02.269205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada051aa-d8a4-4698-a38c-0c324aaaa333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:02.269807 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada051aa-d8a4-4698-a38c-0c324aaaa333 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:02.270090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada051aa-d8a4-4698-a38c-0c324aaaa333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:02.270363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada051aa-d8a4-4698-a38c-0c324aaaa333 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:02.271040 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada051aa-d8a4-4698-a38c-0c324aaaa333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:02.273835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada051aa-d8a4-4698-a38c-0c324aaaa333 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:02.277987 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:02.286097 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7933d74b-ac18-4576-b84d-325809d7ce28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb15e6efc6e0456fb5d1be5b7bd54d15', 'request_id': 'req-7933d74b-ac18-4576-b84d-325809d7ce28'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:02.293677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7933d74b-ac18-4576-b84d-325809d7ce28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb15e6efc6e0456fb5d1be5b7bd54d15', 'request_id': 'req-7933d74b-ac18-4576-b84d-325809d7ce28'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:02.300007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7933d74b-ac18-4576-b84d-325809d7ce28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb15e6efc6e0456fb5d1be5b7bd54d15', 'request_id': 'req-7933d74b-ac18-4576-b84d-325809d7ce28'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:02.304338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 978/1931] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:02 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:02.305330 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada051aa-d8a4-4698-a38c-0c324aaaa333 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:02.306942 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-ada051aa-d8a4-4698-a38c-0c324aaaa333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:02.315221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7933d74b-ac18-4576-b84d-325809d7ce28 admin admin] The token cache is being invalidate because project cb15e6efc6e0456fb5d1be5b7bd54d15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:02.315514 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7933d74b-ac18-4576-b84d-325809d7ce28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:02.316155 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7933d74b-ac18-4576-b84d-325809d7ce28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:02.317864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 954/1932] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:02 2022] DELETE /identity/v3/projects/cb15e6efc6e0456fb5d1be5b7bd54d15 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:02.318383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933d74b-ac18-4576-b84d-325809d7ce28 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:02.320070 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7933d74b-ac18-4576-b84d-325809d7ce28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:02.368166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada051aa-d8a4-4698-a38c-0c324aaaa333 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:02.372282 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31520081-1ab9-444c-87e1-c4a398f70de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:02.372896 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31520081-1ab9-444c-87e1-c4a398f70de1 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:02.373230 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31520081-1ab9-444c-87e1-c4a398f70de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:02.373499 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31520081-1ab9-444c-87e1-c4a398f70de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:02.375396 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-31520081-1ab9-444c-87e1-c4a398f70de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:02.405866 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933d74b-ac18-4576-b84d-325809d7ce28 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:02.449483 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31520081-1ab9-444c-87e1-c4a398f70de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:02.451558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31520081-1ab9-444c-87e1-c4a398f70de1 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:02.464451 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 979/1933] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:02.473594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2efdaa-c259-4a49-8689-148df139b4ae None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:02.473954 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2efdaa-c259-4a49-8689-148df139b4ae None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:02.474297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2efdaa-c259-4a49-8689-148df139b4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:02.492723 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37be561-2eac-42b7-81ca-4cebb57269d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:02.493917 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37be561-2eac-42b7-81ca-4cebb57269d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:02.494298 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37be561-2eac-42b7-81ca-4cebb57269d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:02.494744 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37be561-2eac-42b7-81ca-4cebb57269d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:02.495530 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37be561-2eac-42b7-81ca-4cebb57269d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:02.497760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37be561-2eac-42b7-81ca-4cebb57269d2 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:02.504581 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-cb2efdaa-c259-4a49-8689-148df139b4ae None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:02.506307 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-cb2efdaa-c259-4a49-8689-148df139b4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:02.531822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 980/1934] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:02.532343 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 955/1935] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:02 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:02.541993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da85636-4a72-41d9-81db-9fef4e6faf91 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:02.542277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da85636-4a72-41d9-81db-9fef4e6faf91 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:02.542611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da85636-4a72-41d9-81db-9fef4e6faf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:02.544170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37be561-2eac-42b7-81ca-4cebb57269d2 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:02.561130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37be561-2eac-42b7-81ca-4cebb57269d2 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:02.566672 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b52cb-e4a0-449b-9a40-783d7e5f30c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:02.567323 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b52cb-e4a0-449b-9a40-783d7e5f30c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:02.567658 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b52cb-e4a0-449b-9a40-783d7e5f30c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:02.567873 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b52cb-e4a0-449b-9a40-783d7e5f30c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:02.568496 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b52cb-e4a0-449b-9a40-783d7e5f30c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:02.570113 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b52cb-e4a0-449b-9a40-783d7e5f30c1 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:02.587146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 956/1936] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:02.591208 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b52cb-e4a0-449b-9a40-783d7e5f30c1 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:02.598346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-0da85636-4a72-41d9-81db-9fef4e6faf91 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:02.599786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0da85636-4a72-41d9-81db-9fef4e6faf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:02.601570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b52cb-e4a0-449b-9a40-783d7e5f30c1 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:02.607158 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57f2f8-098c-42f3-9573-0c75b15d3d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:02.607766 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57f2f8-098c-42f3-9573-0c75b15d3d22 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:02.608092 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57f2f8-098c-42f3-9573-0c75b15d3d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:02.608367 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57f2f8-098c-42f3-9573-0c75b15d3d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:02.609058 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57f2f8-098c-42f3-9573-0c75b15d3d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:02.609822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 981/1937] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:02.610741 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57f2f8-098c-42f3-9573-0c75b15d3d22 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:02.613756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da85636-4a72-41d9-81db-9fef4e6faf91 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:02.623982 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 957/1938] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:37:02.625133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da85636-4a72-41d9-81db-9fef4e6faf91 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:02.629725 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57f2f8-098c-42f3-9573-0c75b15d3d22 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:02.640976 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57f2f8-098c-42f3-9573-0c75b15d3d22 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:02.649243 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9614c-3fcc-4923-adf1-5f7c9a0328fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:02.649926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9614c-3fcc-4923-adf1-5f7c9a0328fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:02.650214 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9614c-3fcc-4923-adf1-5f7c9a0328fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:02.650549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a6d9f-d120-4e52-bab6-faee59417e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:02.651177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a6d9f-d120-4e52-bab6-faee59417e9d admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:02.651603 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a6d9f-d120-4e52-bab6-faee59417e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:02.651747 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a6d9f-d120-4e52-bab6-faee59417e9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:02.652402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a6d9f-d120-4e52-bab6-faee59417e9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:37:02.652730 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9614c-3fcc-4923-adf1-5f7c9a0328fa admin admin] PATH_INFO: `/v3/projects/ccdcfd89db11419784d27bad26f04a80/users/f918860d6ce647a8842465614bff203c/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:02.653659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a6d9f-d120-4e52-bab6-faee59417e9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:02.655495 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a6d9f-d120-4e52-bab6-faee59417e9d admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:02.685341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 982/1939] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:37:02.690689 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a6d9f-d120-4e52-bab6-faee59417e9d admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:02.691722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9614c-3fcc-4923-adf1-5f7c9a0328fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccdcfd89db11419784d27bad26f04a80, user_id=f918860d6ce647a8842465614bff203c, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:02.702959 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9614c-3fcc-4923-adf1-5f7c9a0328fa admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:02.714523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a6d9f-d120-4e52-bab6-faee59417e9d admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:02.725627 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2502ed-74d0-4898-a9b5-c6d6c2fdb778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:02.726467 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2502ed-74d0-4898-a9b5-c6d6c2fdb778 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:02.729190 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 958/1940] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:02 2022] PUT /identity/v3/projects/ccdcfd89db11419784d27bad26f04a80/users/f918860d6ce647a8842465614bff203c/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:02.739888 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2502ed-74d0-4898-a9b5-c6d6c2fdb778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:02.740234 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2502ed-74d0-4898-a9b5-c6d6c2fdb778 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:02.740632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b344f2-2f36-4f78-810d-24c0d0e7dfa8 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:02.741673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2502ed-74d0-4898-a9b5-c6d6c2fdb778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:02.741988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b344f2-2f36-4f78-810d-24c0d0e7dfa8 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:02.743654 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2502ed-74d0-4898-a9b5-c6d6c2fdb778 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:02.746558 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b344f2-2f36-4f78-810d-24c0d0e7dfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:02.800056 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 983/1941] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:02 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:02.805540 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2502ed-74d0-4898-a9b5-c6d6c2fdb778 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:02.808652 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-79b344f2-2f36-4f78-810d-24c0d0e7dfa8 None None] MFA Rules not processed for user `f918860d6ce647a8842465614bff203c`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:02.810465 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-79b344f2-2f36-4f78-810d-24c0d0e7dfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:02.816300 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:02.818111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:02.898345 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2502ed-74d0-4898-a9b5-c6d6c2fdb778 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:02.908743 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 959/1942] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:37:02.913086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d2886-399f-4926-acb3-8b43a9f39adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:02.913086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d2886-399f-4926-acb3-8b43a9f39adc admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:02.913086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d2886-399f-4926-acb3-8b43a9f39adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:02.913086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d2886-399f-4926-acb3-8b43a9f39adc admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:02.913461 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d2886-399f-4926-acb3-8b43a9f39adc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:02.913556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b344f2-2f36-4f78-810d-24c0d0e7dfa8 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:02.917399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d2886-399f-4926-acb3-8b43a9f39adc admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:02.930047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b344f2-2f36-4f78-810d-24c0d0e7dfa8 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:02.936708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423fd73-4953-4f97-b3f9-015e15bc647d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:02.937653 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423fd73-4953-4f97-b3f9-015e15bc647d admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:02.938038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423fd73-4953-4f97-b3f9-015e15bc647d admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:02.938337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423fd73-4953-4f97-b3f9-015e15bc647d admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:02.939365 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423fd73-4953-4f97-b3f9-015e15bc647d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:02.941947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423fd73-4953-4f97-b3f9-015e15bc647d admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:02.953676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 984/1943] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:02 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:37:02.957541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d2886-399f-4926-acb3-8b43a9f39adc admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:02.999068 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d2886-399f-4926-acb3-8b43a9f39adc admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:03.004372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02be6c7-c1d7-4448-a3ed-e11d58ac27a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:03.005153 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02be6c7-c1d7-4448-a3ed-e11d58ac27a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:03.005611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02be6c7-c1d7-4448-a3ed-e11d58ac27a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:03.006035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02be6c7-c1d7-4448-a3ed-e11d58ac27a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:03.007248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02be6c7-c1d7-4448-a3ed-e11d58ac27a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:03.011404 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02be6c7-c1d7-4448-a3ed-e11d58ac27a8 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:03.013990 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 960/1944] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:02 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:03.016139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423fd73-4953-4f97-b3f9-015e15bc647d admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:03.042732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 985/1945] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:03.043963 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02be6c7-c1d7-4448-a3ed-e11d58ac27a8 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:03.077501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02be6c7-c1d7-4448-a3ed-e11d58ac27a8 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:03.148335 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423fd73-4953-4f97-b3f9-015e15bc647d admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:03.162870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980e936-9292-4688-b5ca-6e7781525880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:03.162870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980e936-9292-4688-b5ca-6e7781525880 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:03.162870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980e936-9292-4688-b5ca-6e7781525880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:03.162870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980e936-9292-4688-b5ca-6e7781525880 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:03.163379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980e936-9292-4688-b5ca-6e7781525880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:03.163379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980e936-9292-4688-b5ca-6e7781525880 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:03.185106 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc8d95-19ec-400e-a738-5da8c487ad7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:03.185726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc8d95-19ec-400e-a738-5da8c487ad7b admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:03.186005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc8d95-19ec-400e-a738-5da8c487ad7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:03.186283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc8d95-19ec-400e-a738-5da8c487ad7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:03.187165 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc8d95-19ec-400e-a738-5da8c487ad7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:03.188993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc8d95-19ec-400e-a738-5da8c487ad7b admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:03.199133 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 961/1946] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:03 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:03.200545 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b44a7-93d1-44a2-94b7-aa3e95cad582 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:03.200935 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b44a7-93d1-44a2-94b7-aa3e95cad582 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:03.201318 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b44a7-93d1-44a2-94b7-aa3e95cad582 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:03.201947 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 986/1947] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:03.203014 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc8d95-19ec-400e-a738-5da8c487ad7b admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:03.204140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 962/1948] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 26 01:37:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:37:03.206185 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0bfc8d95-19ec-400e-a738-5da8c487ad7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:03.211048 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b44a7-93d1-44a2-94b7-aa3e95cad582 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:03.220787 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc8d95-19ec-400e-a738-5da8c487ad7b admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:03.224654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b44a7-93d1-44a2-94b7-aa3e95cad582 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:03.226974 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d7bb2-2f00-477b-9d4d-74f2407b9c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:03.228017 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d7bb2-2f00-477b-9d4d-74f2407b9c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:03.228443 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d7bb2-2f00-477b-9d4d-74f2407b9c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:03.228921 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d7bb2-2f00-477b-9d4d-74f2407b9c10 admin admin] PATH_INFO: `/v3/projects/a35adfa02a064f32b9500f00f0c32cea` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:03.230586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d7bb2-2f00-477b-9d4d-74f2407b9c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a35adfa02a064f32b9500f00f0c32cea)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:03.233645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948a3bf-15b2-4b7a-85ea-7768e085c8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:03.234707 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d7bb2-2f00-477b-9d4d-74f2407b9c10 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:03.236082 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948a3bf-15b2-4b7a-85ea-7768e085c8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:03.236362 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948a3bf-15b2-4b7a-85ea-7768e085c8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:03.236628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948a3bf-15b2-4b7a-85ea-7768e085c8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:03.237263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948a3bf-15b2-4b7a-85ea-7768e085c8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:03.238850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948a3bf-15b2-4b7a-85ea-7768e085c8a8 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:03.250200 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 963/1949] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:03.250792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948a3bf-15b2-4b7a-85ea-7768e085c8a8 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:03.261476 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948a3bf-15b2-4b7a-85ea-7768e085c8a8 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:03.268860 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539d5db-9e72-4211-84ef-9aa173aa7f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:03.269509 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539d5db-9e72-4211-84ef-9aa173aa7f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:03.269785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539d5db-9e72-4211-84ef-9aa173aa7f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:03.270059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539d5db-9e72-4211-84ef-9aa173aa7f8c admin admin] PATH_INFO: `/v3/projects/1be28b1870e440dda54879de17aa065b/users/d8b3fb3fa70143d7b85cdfeb86f0b7b8/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:03.289628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539d5db-9e72-4211-84ef-9aa173aa7f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be28b1870e440dda54879de17aa065b, user_id=d8b3fb3fa70143d7b85cdfeb86f0b7b8, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:03.293011 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539d5db-9e72-4211-84ef-9aa173aa7f8c admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:03.307670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-fe1d7bb2-2f00-477b-9d4d-74f2407b9c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a35adfa02a064f32b9500f00f0c32cea', 'request_id': 'req-fe1d7bb2-2f00-477b-9d4d-74f2407b9c10'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:03.308192 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 964/1950] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:03 2022] PUT /identity/v3/projects/1be28b1870e440dda54879de17aa065b/users/d8b3fb3fa70143d7b85cdfeb86f0b7b8/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:03.308985 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacdbf4-f972-41fc-baa0-dee27712a0ca None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:03.309328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacdbf4-f972-41fc-baa0-dee27712a0ca None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:03.309542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacdbf4-f972-41fc-baa0-dee27712a0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:03.326277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-fe1d7bb2-2f00-477b-9d4d-74f2407b9c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a35adfa02a064f32b9500f00f0c32cea', 'request_id': 'req-fe1d7bb2-2f00-477b-9d4d-74f2407b9c10'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:03.334099 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-fe1d7bb2-2f00-477b-9d4d-74f2407b9c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a35adfa02a064f32b9500f00f0c32cea', 'request_id': 'req-fe1d7bb2-2f00-477b-9d4d-74f2407b9c10'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:03.338417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-faacdbf4-f972-41fc-baa0-dee27712a0ca None None] MFA Rules not processed for user `3d6eaeb6bced49afabc7bdaa5e7cecfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:03.339687 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-faacdbf4-f972-41fc-baa0-dee27712a0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:03.351184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-fe1d7bb2-2f00-477b-9d4d-74f2407b9c10 admin admin] The token cache is being invalidate because project a35adfa02a064f32b9500f00f0c32cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:03.351549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-fe1d7bb2-2f00-477b-9d4d-74f2407b9c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:03.352364 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-fe1d7bb2-2f00-477b-9d4d-74f2407b9c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:03.354689 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 987/1951] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:03 2022] DELETE /identity/v3/projects/a35adfa02a064f32b9500f00f0c32cea => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:03.356232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d7bb2-2f00-477b-9d4d-74f2407b9c10 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:03.357871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-fe1d7bb2-2f00-477b-9d4d-74f2407b9c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:03.375281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:03.398397 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:03.442320 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 965/1952] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 26 01:37:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:03.444174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1a728-b55c-4929-b3ed-f189e70eb1ed None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:03.444551 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1a728-b55c-4929-b3ed-f189e70eb1ed None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:03.444825 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1a728-b55c-4929-b3ed-f189e70eb1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:03.456205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d7bb2-2f00-477b-9d4d-74f2407b9c10 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:03.480621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-c0a1a728-b55c-4929-b3ed-f189e70eb1ed None None] MFA Rules not processed for user `d8b3fb3fa70143d7b85cdfeb86f0b7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:03.482686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c0a1a728-b55c-4929-b3ed-f189e70eb1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:03.517597 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2081-fa57-439b-84d5-5ce9582b343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:03.518176 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2081-fa57-439b-84d5-5ce9582b343f admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:03.518457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2081-fa57-439b-84d5-5ce9582b343f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:03.518733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2081-fa57-439b-84d5-5ce9582b343f admin admin] PATH_INFO: `/v3/projects/85220da3b96e4c6e8c8166c46bfc5d8d/users/c04673fe93224ac3ab35e0de5b2d777f/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:03.537943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b2081-fa57-439b-84d5-5ce9582b343f admin admin] RBAC: Authorizing `identity:create_grant(project_id=85220da3b96e4c6e8c8166c46bfc5d8d, user_id=c04673fe93224ac3ab35e0de5b2d777f, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:03.542092 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b2081-fa57-439b-84d5-5ce9582b343f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:03.562102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 966/1953] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:03.562102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1a728-b55c-4929-b3ed-f189e70eb1ed None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:03.562102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c0a1a728-b55c-4929-b3ed-f189e70eb1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:03.568832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 988/1954] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:03 2022] PUT /identity/v3/projects/85220da3b96e4c6e8c8166c46bfc5d8d/users/c04673fe93224ac3ab35e0de5b2d777f/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:03.570292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2081-fa57-439b-84d5-5ce9582b343f admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:03.572317 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-609b2081-fa57-439b-84d5-5ce9582b343f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:03.581838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1a728-b55c-4929-b3ed-f189e70eb1ed None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:03.643444 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de7d72-bf24-485d-8301-c48acf59485b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:03.644217 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de7d72-bf24-485d-8301-c48acf59485b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:03.644622 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de7d72-bf24-485d-8301-c48acf59485b admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:03.644902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de7d72-bf24-485d-8301-c48acf59485b admin admin] PATH_INFO: `/v3/users/b4ed7088cf7f405eaac21c05d512a759` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:03.646160 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de7d72-bf24-485d-8301-c48acf59485b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ed7088cf7f405eaac21c05d512a759)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:03.648675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de7d72-bf24-485d-8301-c48acf59485b admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:03.657697 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2081-fa57-439b-84d5-5ce9582b343f admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:03.664347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80737704-94cb-43d7-afc4-b29501e7db46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:03.664962 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737704-94cb-43d7-afc4-b29501e7db46 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:03.665250 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737704-94cb-43d7-afc4-b29501e7db46 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:03.665530 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737704-94cb-43d7-afc4-b29501e7db46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:03.675985 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80737704-94cb-43d7-afc4-b29501e7db46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:03.677575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80737704-94cb-43d7-afc4-b29501e7db46 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:03.690182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 989/1955] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:03.691085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80737704-94cb-43d7-afc4-b29501e7db46 service nova] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:03.692395 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-80737704-94cb-43d7-afc4-b29501e7db46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:03.709110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80737704-94cb-43d7-afc4-b29501e7db46 service nova] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:03.712735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-53de7d72-bf24-485d-8301-c48acf59485b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ed7088cf7f405eaac21c05d512a759'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:03.713490 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-53de7d72-bf24-485d-8301-c48acf59485b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ed7088cf7f405eaac21c05d512a759'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:03.714169 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-53de7d72-bf24-485d-8301-c48acf59485b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ed7088cf7f405eaac21c05d512a759'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:03.715876 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319fac3-22d4-4ceb-aefa-2ca32b63816b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:03.716698 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319fac3-22d4-4ceb-aefa-2ca32b63816b admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:03.717055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319fac3-22d4-4ceb-aefa-2ca32b63816b admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:03.717403 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319fac3-22d4-4ceb-aefa-2ca32b63816b admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:03.718116 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319fac3-22d4-4ceb-aefa-2ca32b63816b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:03.720349 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319fac3-22d4-4ceb-aefa-2ca32b63816b admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:03.728668 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:03.730184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-53de7d72-bf24-485d-8301-c48acf59485b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ed7088cf7f405eaac21c05d512a759'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:03.739475 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-53de7d72-bf24-485d-8301-c48acf59485b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ed7088cf7f405eaac21c05d512a759'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:03.757583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 967/1956] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:03 2022] DELETE /identity/v3/users/b4ed7088cf7f405eaac21c05d512a759 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:03.757583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de7d72-bf24-485d-8301-c48acf59485b admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:03.757583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-53de7d72-bf24-485d-8301-c48acf59485b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:03.762096 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:03.775353 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 990/1957] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:03 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:03.776262 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319fac3-22d4-4ceb-aefa-2ca32b63816b admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:03.779233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-1319fac3-22d4-4ceb-aefa-2ca32b63816b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:03.843360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de7d72-bf24-485d-8301-c48acf59485b admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:03.862291 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319fac3-22d4-4ceb-aefa-2ca32b63816b admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:03.868045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7e64a-1176-4cc5-b499-00e5341f489f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:03.868652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7e64a-1176-4cc5-b499-00e5341f489f admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:03.868930 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7e64a-1176-4cc5-b499-00e5341f489f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:03.869201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7e64a-1176-4cc5-b499-00e5341f489f admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:03.869833 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7e64a-1176-4cc5-b499-00e5341f489f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:03.871830 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7e64a-1176-4cc5-b499-00e5341f489f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:03.900894 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 991/1958] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:03 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:03.903370 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7e64a-1176-4cc5-b499-00e5341f489f admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:03.913276 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58cf06-5cbf-49af-8310-532856d7897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:03.914176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58cf06-5cbf-49af-8310-532856d7897d admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:03.914453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58cf06-5cbf-49af-8310-532856d7897d admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:03.914722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58cf06-5cbf-49af-8310-532856d7897d admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:03.915396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58cf06-5cbf-49af-8310-532856d7897d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:03.916451 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7e64a-1176-4cc5-b499-00e5341f489f admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:03.917383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58cf06-5cbf-49af-8310-532856d7897d admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:03.921687 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181489c5-d168-4e19-8831-f855e2c5dceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:03.922291 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181489c5-d168-4e19-8831-f855e2c5dceb admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:03.923039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181489c5-d168-4e19-8831-f855e2c5dceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:03.923636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181489c5-d168-4e19-8831-f855e2c5dceb admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:03.923959 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181489c5-d168-4e19-8831-f855e2c5dceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:03.925733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181489c5-d168-4e19-8831-f855e2c5dceb admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:03.931255 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 968/1959] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:03.934927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58cf06-5cbf-49af-8310-532856d7897d admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:03.944390 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 992/1960] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:37:03.945654 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181489c5-d168-4e19-8831-f855e2c5dceb admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:03.951648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58cf06-5cbf-49af-8310-532856d7897d admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:03.957028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181489c5-d168-4e19-8831-f855e2c5dceb admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:03.958852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a088c-5fe8-4fac-9437-1cdf7078ed7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:03.959801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a088c-5fe8-4fac-9437-1cdf7078ed7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:03.960206 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a088c-5fe8-4fac-9437-1cdf7078ed7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:03.960455 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a088c-5fe8-4fac-9437-1cdf7078ed7f admin admin] PATH_INFO: `/v3/projects/85220da3b96e4c6e8c8166c46bfc5d8d/users/c04673fe93224ac3ab35e0de5b2d777f/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:03.962474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a088c-5fe8-4fac-9437-1cdf7078ed7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=85220da3b96e4c6e8c8166c46bfc5d8d, user_id=c04673fe93224ac3ab35e0de5b2d777f, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:03.962943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b0419-7c59-4cfe-b5dc-7928d0bbc2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:03.964051 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b0419-7c59-4cfe-b5dc-7928d0bbc2fa admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:03.964051 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b0419-7c59-4cfe-b5dc-7928d0bbc2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:03.964244 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b0419-7c59-4cfe-b5dc-7928d0bbc2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:03.964876 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b0419-7c59-4cfe-b5dc-7928d0bbc2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:03.965592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a088c-5fe8-4fac-9437-1cdf7078ed7f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:03.966752 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b0419-7c59-4cfe-b5dc-7928d0bbc2fa admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:03.977540 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 969/1961] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:03 2022] PUT /identity/v3/projects/85220da3b96e4c6e8c8166c46bfc5d8d/users/c04673fe93224ac3ab35e0de5b2d777f/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:37:03.980584 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 993/1962] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:03.984870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a088c-5fe8-4fac-9437-1cdf7078ed7f admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:03.987863 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ce597-73a9-405e-b9f0-3003ff1fa302 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:03.988156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ce597-73a9-405e-b9f0-3003ff1fa302 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:03.988626 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ce597-73a9-405e-b9f0-3003ff1fa302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:04.022326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-419ce597-73a9-405e-b9f0-3003ff1fa302 None None] MFA Rules not processed for user `c04673fe93224ac3ab35e0de5b2d777f`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:04.023927 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-419ce597-73a9-405e-b9f0-3003ff1fa302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:04.067825 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a088c-5fe8-4fac-9437-1cdf7078ed7f admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:04.073653 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9a405-7690-4c3d-8ed0-c0e2d9dc9ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:04.074337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9a405-7690-4c3d-8ed0-c0e2d9dc9ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:04.074723 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9a405-7690-4c3d-8ed0-c0e2d9dc9ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:04.075086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9a405-7690-4c3d-8ed0-c0e2d9dc9ffd admin admin] PATH_INFO: `/v3/projects/128c5880f9154dc2b4aa708ec392cf93/users/fd5ba20b9be74383bf8c82f055b3e1ca/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:04.092656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9a405-7690-4c3d-8ed0-c0e2d9dc9ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=128c5880f9154dc2b4aa708ec392cf93, user_id=fd5ba20b9be74383bf8c82f055b3e1ca, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:04.096742 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9a405-7690-4c3d-8ed0-c0e2d9dc9ffd admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:04.098915 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:04.121715 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 970/1963] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:03 2022] PUT /identity/v3/projects/128c5880f9154dc2b4aa708ec392cf93/users/fd5ba20b9be74383bf8c82f055b3e1ca/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:37:04.122550 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9a405-7690-4c3d-8ed0-c0e2d9dc9ffd admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:04.124374 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-32e9a405-7690-4c3d-8ed0-c0e2d9dc9ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:04.148138 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 994/1964] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:37:04.154097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216478c-3c95-4806-934a-ecc7956bb0cb None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:04.154331 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216478c-3c95-4806-934a-ecc7956bb0cb None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:04.154637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216478c-3c95-4806-934a-ecc7956bb0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:04.188404 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-8216478c-3c95-4806-934a-ecc7956bb0cb None None] MFA Rules not processed for user `fd5ba20b9be74383bf8c82f055b3e1ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:04.189631 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-8216478c-3c95-4806-934a-ecc7956bb0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:04.218751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9a405-7690-4c3d-8ed0-c0e2d9dc9ffd admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:04.226968 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb14bc2-3e87-448e-be76-8bc2f0160a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:04.227622 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb14bc2-3e87-448e-be76-8bc2f0160a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:04.227902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb14bc2-3e87-448e-be76-8bc2f0160a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:04.228180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb14bc2-3e87-448e-be76-8bc2f0160a7b admin admin] PATH_INFO: `/v3/projects/5fafb45a6c9147a0accceaa92415d96c` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:04.229345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb14bc2-3e87-448e-be76-8bc2f0160a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fafb45a6c9147a0accceaa92415d96c)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:04.231296 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb14bc2-3e87-448e-be76-8bc2f0160a7b admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:04.261136 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:04.296075 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-efb14bc2-3e87-448e-be76-8bc2f0160a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fafb45a6c9147a0accceaa92415d96c', 'request_id': 'req-efb14bc2-3e87-448e-be76-8bc2f0160a7b'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:04.298977 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 995/1965] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:04.299912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216478c-3c95-4806-934a-ecc7956bb0cb None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:04.301397 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-8216478c-3c95-4806-934a-ecc7956bb0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:04.303388 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-efb14bc2-3e87-448e-be76-8bc2f0160a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fafb45a6c9147a0accceaa92415d96c', 'request_id': 'req-efb14bc2-3e87-448e-be76-8bc2f0160a7b'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:04.310253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-efb14bc2-3e87-448e-be76-8bc2f0160a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fafb45a6c9147a0accceaa92415d96c', 'request_id': 'req-efb14bc2-3e87-448e-be76-8bc2f0160a7b'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:04.327188 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-efb14bc2-3e87-448e-be76-8bc2f0160a7b admin admin] The token cache is being invalidate because project 5fafb45a6c9147a0accceaa92415d96c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:04.327487 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-efb14bc2-3e87-448e-be76-8bc2f0160a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:04.328164 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-efb14bc2-3e87-448e-be76-8bc2f0160a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:04.332895 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 971/1966] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:04 2022] DELETE /identity/v3/projects/5fafb45a6c9147a0accceaa92415d96c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:04.332895 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb14bc2-3e87-448e-be76-8bc2f0160a7b admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:04.335049 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-efb14bc2-3e87-448e-be76-8bc2f0160a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:04.373103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216478c-3c95-4806-934a-ecc7956bb0cb None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:04.407064 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb14bc2-3e87-448e-be76-8bc2f0160a7b admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:04.411755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c5f4f-9a7b-4219-8300-4798c36e4e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:04.412358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c5f4f-9a7b-4219-8300-4798c36e4e3b admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:04.412843 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c5f4f-9a7b-4219-8300-4798c36e4e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:04.413112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c5f4f-9a7b-4219-8300-4798c36e4e3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:04.413739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c5f4f-9a7b-4219-8300-4798c36e4e3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:04.415700 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c5f4f-9a7b-4219-8300-4798c36e4e3b admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:04.444375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb1c32-b9ba-48a1-ae20-d02db37d6b27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:04.445226 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb1c32-b9ba-48a1-ae20-d02db37d6b27 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:04.445414 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb1c32-b9ba-48a1-ae20-d02db37d6b27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:04.445686 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb1c32-b9ba-48a1-ae20-d02db37d6b27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:04.448032 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-fafb1c32-b9ba-48a1-ae20-d02db37d6b27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:04.451058 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 972/1967] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:04 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:04.452556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2762e-d353-4b76-87ae-76ca9aff5fb3 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:04.452848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2762e-d353-4b76-87ae-76ca9aff5fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:04.453182 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2762e-d353-4b76-87ae-76ca9aff5fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:04.476995 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-25d2762e-d353-4b76-87ae-76ca9aff5fb3 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:04.478210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-25d2762e-d353-4b76-87ae-76ca9aff5fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:04.483616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:04.535118 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb1c32-b9ba-48a1-ae20-d02db37d6b27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:04.537334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb1c32-b9ba-48a1-ae20-d02db37d6b27 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:04.555438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 996/1968] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:04 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:04.556263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb1c32-b9ba-48a1-ae20-d02db37d6b27 service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:04.567903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb1c32-b9ba-48a1-ae20-d02db37d6b27 service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:04.576291 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 973/1969] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:04.578219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174f029-1652-46c3-a8c9-ce5a9cdffaca None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:04.578579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174f029-1652-46c3-a8c9-ce5a9cdffaca None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:04.578874 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174f029-1652-46c3-a8c9-ce5a9cdffaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:04.582048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc40c7-bd27-4dde-8431-24c3cfd1f5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:04.582688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc40c7-bd27-4dde-8431-24c3cfd1f5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:04.583000 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc40c7-bd27-4dde-8431-24c3cfd1f5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:04.583903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc40c7-bd27-4dde-8431-24c3cfd1f5c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:04.584216 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc40c7-bd27-4dde-8431-24c3cfd1f5c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:04.587949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc40c7-bd27-4dde-8431-24c3cfd1f5c6 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:04.615390 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-b174f029-1652-46c3-a8c9-ce5a9cdffaca None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:04.618177 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b174f029-1652-46c3-a8c9-ce5a9cdffaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:04.629621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 974/1970] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:37:04.633720 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174f029-1652-46c3-a8c9-ce5a9cdffaca None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:04.653475 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 997/1971] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:04 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:04.655646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc40c7-bd27-4dde-8431-24c3cfd1f5c6 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:04.657923 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174f029-1652-46c3-a8c9-ce5a9cdffaca None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:04.668047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f14c7-596f-4ef7-bdc3-b4926a87ebf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:04.669167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f14c7-596f-4ef7-bdc3-b4926a87ebf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:04.669665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f14c7-596f-4ef7-bdc3-b4926a87ebf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:04.670059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f14c7-596f-4ef7-bdc3-b4926a87ebf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:04.670632 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc40c7-bd27-4dde-8431-24c3cfd1f5c6 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:04.672337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f14c7-596f-4ef7-bdc3-b4926a87ebf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:37:04.672810 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f14c7-596f-4ef7-bdc3-b4926a87ebf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:04.674513 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f14c7-596f-4ef7-bdc3-b4926a87ebf2 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:04.675885 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163366a-299e-4101-abbe-a6c3662496fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:04.676621 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163366a-299e-4101-abbe-a6c3662496fb admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:04.676909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163366a-299e-4101-abbe-a6c3662496fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:04.677315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163366a-299e-4101-abbe-a6c3662496fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:04.677962 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163366a-299e-4101-abbe-a6c3662496fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:04.680505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163366a-299e-4101-abbe-a6c3662496fb admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:04.687400 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 975/1972] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:37:04.691436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f14c7-596f-4ef7-bdc3-b4926a87ebf2 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:04.694672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 998/1973] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:04.699505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163366a-299e-4101-abbe-a6c3662496fb admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:04.707540 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f14c7-596f-4ef7-bdc3-b4926a87ebf2 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:04.714401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163366a-299e-4101-abbe-a6c3662496fb admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:04.714557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5163b59-a271-4ae6-9db6-3a2d9ee6532e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:04.715210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5163b59-a271-4ae6-9db6-3a2d9ee6532e admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:04.715661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5163b59-a271-4ae6-9db6-3a2d9ee6532e admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:04.716023 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5163b59-a271-4ae6-9db6-3a2d9ee6532e admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:04.716720 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5163b59-a271-4ae6-9db6-3a2d9ee6532e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:04.719169 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5163b59-a271-4ae6-9db6-3a2d9ee6532e admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:04.720468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67f803-ed20-48d7-8bfe-3d9a32c70a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:04.721178 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67f803-ed20-48d7-8bfe-3d9a32c70a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:04.721466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67f803-ed20-48d7-8bfe-3d9a32c70a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:04.721745 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67f803-ed20-48d7-8bfe-3d9a32c70a40 admin admin] PATH_INFO: `/v3/projects/3173379b606649a4bd21a6b105c8f631/users/6509924761fc4a2eb1379a714f94fc56/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:04.767148 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 976/1974] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:04 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:04.771197 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5163b59-a271-4ae6-9db6-3a2d9ee6532e admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:04.781127 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67f803-ed20-48d7-8bfe-3d9a32c70a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3173379b606649a4bd21a6b105c8f631, user_id=6509924761fc4a2eb1379a714f94fc56, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:04.787235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67f803-ed20-48d7-8bfe-3d9a32c70a40 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:04.799369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:04.825137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 999/1975] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:04 2022] PUT /identity/v3/projects/3173379b606649a4bd21a6b105c8f631/users/6509924761fc4a2eb1379a714f94fc56/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:04.828666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67f803-ed20-48d7-8bfe-3d9a32c70a40 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:04.872057 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5163b59-a271-4ae6-9db6-3a2d9ee6532e admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:04.988221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c57d9-a8c2-4f1e-bd62-f86849eb6f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:04.990860 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c57d9-a8c2-4f1e-bd62-f86849eb6f0d admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:04.991384 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c57d9-a8c2-4f1e-bd62-f86849eb6f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:04.993163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c57d9-a8c2-4f1e-bd62-f86849eb6f0d admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:04.996854 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c57d9-a8c2-4f1e-bd62-f86849eb6f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:05.001310 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c57d9-a8c2-4f1e-bd62-f86849eb6f0d admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:05.002156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67f803-ed20-48d7-8bfe-3d9a32c70a40 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:05.013018 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765b62d-8d7f-428b-b289-9b702da4e703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:05.014051 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765b62d-8d7f-428b-b289-9b702da4e703 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:05.014865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765b62d-8d7f-428b-b289-9b702da4e703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:05.015289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765b62d-8d7f-428b-b289-9b702da4e703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:05.015953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765b62d-8d7f-428b-b289-9b702da4e703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:05.017723 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765b62d-8d7f-428b-b289-9b702da4e703 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:05.046959 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1000/1976] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:05.048070 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765b62d-8d7f-428b-b289-9b702da4e703 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:05.083829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765b62d-8d7f-428b-b289-9b702da4e703 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:05.086575 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 977/1977] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:04 2022] POST /identity/v3/users => generated 294 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:37:05.091277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c57d9-a8c2-4f1e-bd62-f86849eb6f0d admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:05.106700 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6b6d1-2034-4489-9f94-4908794ba99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:05.108209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6b6d1-2034-4489-9f94-4908794ba99a admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:05.111068 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6b6d1-2034-4489-9f94-4908794ba99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:05.112662 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6b6d1-2034-4489-9f94-4908794ba99a admin admin] PATH_INFO: `/v3/projects/3173379b606649a4bd21a6b105c8f631/users/6509924761fc4a2eb1379a714f94fc56/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:05.113793 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:05.129831 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6b6d1-2034-4489-9f94-4908794ba99a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3173379b606649a4bd21a6b105c8f631, user_id=6509924761fc4a2eb1379a714f94fc56, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:05.136093 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c57d9-a8c2-4f1e-bd62-f86849eb6f0d admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:05.137703 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6b6d1-2034-4489-9f94-4908794ba99a admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:05.150608 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a181f3-1acc-4cdd-b9b1-32971dffd18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:05.153610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a181f3-1acc-4cdd-b9b1-32971dffd18e admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:05.153900 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a181f3-1acc-4cdd-b9b1-32971dffd18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:05.154170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a181f3-1acc-4cdd-b9b1-32971dffd18e admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:05.157709 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a181f3-1acc-4cdd-b9b1-32971dffd18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:05.164691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a181f3-1acc-4cdd-b9b1-32971dffd18e admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:05.168716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1001/1978] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:05 2022] PUT /identity/v3/projects/3173379b606649a4bd21a6b105c8f631/users/6509924761fc4a2eb1379a714f94fc56/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:05.183990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfb41b-5da7-4030-abfc-1f0d91fe6abf None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:05.184264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfb41b-5da7-4030-abfc-1f0d91fe6abf None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:05.184563 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfb41b-5da7-4030-abfc-1f0d91fe6abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:05.199352 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 978/1979] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:05.205661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a181f3-1acc-4cdd-b9b1-32971dffd18e admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:05.228917 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a181f3-1acc-4cdd-b9b1-32971dffd18e admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:05.255601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-58bfb41b-5da7-4030-abfc-1f0d91fe6abf None None] MFA Rules not processed for user `6509924761fc4a2eb1379a714f94fc56`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:05.257769 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-58bfb41b-5da7-4030-abfc-1f0d91fe6abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:05.364183 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8f5c7-8cf8-403f-9277-79413870de2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:05.366916 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8f5c7-8cf8-403f-9277-79413870de2b admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:05.368122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8f5c7-8cf8-403f-9277-79413870de2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:05.368585 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8f5c7-8cf8-403f-9277-79413870de2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:05.370602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8f5c7-8cf8-403f-9277-79413870de2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:05.373938 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8f5c7-8cf8-403f-9277-79413870de2b admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:05.401096 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 979/1980] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:05.407128 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8f5c7-8cf8-403f-9277-79413870de2b admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:05.432507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1002/1981] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:05.443091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfb41b-5da7-4030-abfc-1f0d91fe6abf None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:05.446352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-58bfb41b-5da7-4030-abfc-1f0d91fe6abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:05.454268 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8f5c7-8cf8-403f-9277-79413870de2b admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:05.492510 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ae945-fca0-4c32-b418-97d8dee0d563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:05.499393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ae945-fca0-4c32-b418-97d8dee0d563 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:05.502728 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ae945-fca0-4c32-b418-97d8dee0d563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:05.503150 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ae945-fca0-4c32-b418-97d8dee0d563 admin admin] PATH_INFO: `/v3/projects/38181e2af3dd45d89e28699a3cee65af/users/e9093df2675f4b1288ce099ce110bb31/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:05.544164 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ae945-fca0-4c32-b418-97d8dee0d563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38181e2af3dd45d89e28699a3cee65af, user_id=e9093df2675f4b1288ce099ce110bb31, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:05.573397 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ae945-fca0-4c32-b418-97d8dee0d563 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:05.605295 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfb41b-5da7-4030-abfc-1f0d91fe6abf None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:05.609379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 980/1982] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:05 2022] PUT /identity/v3/projects/38181e2af3dd45d89e28699a3cee65af/users/e9093df2675f4b1288ce099ce110bb31/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:05.622389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c990b-b5d8-42c8-896a-e30730975337 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:05.622774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c990b-b5d8-42c8-896a-e30730975337 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:05.623143 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c990b-b5d8-42c8-896a-e30730975337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:05.687526 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:05.728803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-554c990b-b5d8-42c8-896a-e30730975337 None None] MFA Rules not processed for user `e9093df2675f4b1288ce099ce110bb31`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:05.730270 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-554c990b-b5d8-42c8-896a-e30730975337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:05.850564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591d409-ec78-42e7-bc57-4a772ecc2e33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:05.852946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591d409-ec78-42e7-bc57-4a772ecc2e33 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:05.853232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591d409-ec78-42e7-bc57-4a772ecc2e33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:05.853747 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591d409-ec78-42e7-bc57-4a772ecc2e33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:05.944697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 981/1983] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:05.944697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c990b-b5d8-42c8-896a-e30730975337 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:05.944697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-554c990b-b5d8-42c8-896a-e30730975337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:05.959500 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c990b-b5d8-42c8-896a-e30730975337 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:05.963948 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c6def-c697-4822-88a9-b336f3a62a29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:05.964632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c6def-c697-4822-88a9-b336f3a62a29 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:05.964981 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c6def-c697-4822-88a9-b336f3a62a29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:05.965318 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c6def-c697-4822-88a9-b336f3a62a29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:05.966670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591d409-ec78-42e7-bc57-4a772ecc2e33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:05.967353 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-fa5c6def-c697-4822-88a9-b336f3a62a29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:05.968201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591d409-ec78-42e7-bc57-4a772ecc2e33 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:05.979164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1003/1984] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:37:05.980035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591d409-ec78-42e7-bc57-4a772ecc2e33 service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:06.046014 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:06.062869 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c6def-c697-4822-88a9-b336f3a62a29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:06.066182 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c6def-c697-4822-88a9-b336f3a62a29 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:06.074725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591d409-ec78-42e7-bc57-4a772ecc2e33 service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:06.080895 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a291d8-583e-4233-aadb-1a91bce087eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:06.081650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a291d8-583e-4233-aadb-1a91bce087eb admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:06.081942 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a291d8-583e-4233-aadb-1a91bce087eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:06.082206 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a291d8-583e-4233-aadb-1a91bce087eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:06.083070 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a291d8-583e-4233-aadb-1a91bce087eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:06.087973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 982/1985] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:06.088428 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a291d8-583e-4233-aadb-1a91bce087eb admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:06.100428 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c6def-c697-4822-88a9-b336f3a62a29 service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:06.111896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c6def-c697-4822-88a9-b336f3a62a29 service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:06.118252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac24ee-c578-4eb2-bb03-e4d79e198c07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:06.119243 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac24ee-c578-4eb2-bb03-e4d79e198c07 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:06.119711 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac24ee-c578-4eb2-bb03-e4d79e198c07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:06.120126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac24ee-c578-4eb2-bb03-e4d79e198c07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:06.122129 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3bac24ee-c578-4eb2-bb03-e4d79e198c07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:06.131025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1004/1986] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:05 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:06.133209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a291d8-583e-4233-aadb-1a91bce087eb admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:06.196386 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac24ee-c578-4eb2-bb03-e4d79e198c07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:06.198197 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac24ee-c578-4eb2-bb03-e4d79e198c07 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:06.200745 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:06.206182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a291d8-583e-4233-aadb-1a91bce087eb admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:06.208968 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 983/1987] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:06.212166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04964d-e3e9-4730-8fa2-c4d00cf98b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:06.213001 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04964d-e3e9-4730-8fa2-c4d00cf98b4b admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:06.213775 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04964d-e3e9-4730-8fa2-c4d00cf98b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:06.214001 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04964d-e3e9-4730-8fa2-c4d00cf98b4b admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:06.214659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04964d-e3e9-4730-8fa2-c4d00cf98b4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:06.216791 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04964d-e3e9-4730-8fa2-c4d00cf98b4b admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:06.245029 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1005/1988] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:06 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:06.249762 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac24ee-c578-4eb2-bb03-e4d79e198c07 service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:06.262405 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac24ee-c578-4eb2-bb03-e4d79e198c07 service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:06.267106 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ffbea-d5ad-4c35-9542-dd42344045df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:06.267690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ffbea-d5ad-4c35-9542-dd42344045df admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:06.267951 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ffbea-d5ad-4c35-9542-dd42344045df admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:06.268543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ffbea-d5ad-4c35-9542-dd42344045df admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:06.268850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ffbea-d5ad-4c35-9542-dd42344045df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:06.270447 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ffbea-d5ad-4c35-9542-dd42344045df admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:06.284113 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 984/1989] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:37:06.289369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04964d-e3e9-4730-8fa2-c4d00cf98b4b admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:06.301044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04964d-e3e9-4730-8fa2-c4d00cf98b4b admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:06.306970 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d35b1-b8ec-4968-8290-efd47b4714fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:06.307700 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d35b1-b8ec-4968-8290-efd47b4714fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:06.308037 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d35b1-b8ec-4968-8290-efd47b4714fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:06.308417 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d35b1-b8ec-4968-8290-efd47b4714fc admin admin] PATH_INFO: `/v3/projects/c44ec62db4b94346a295e37c09688cd0/users/3be084820fec43dd87933f8c5eb7afdd/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:06.326506 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d35b1-b8ec-4968-8290-efd47b4714fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44ec62db4b94346a295e37c09688cd0, user_id=3be084820fec43dd87933f8c5eb7afdd, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:06.329434 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d35b1-b8ec-4968-8290-efd47b4714fc admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:06.343072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1006/1990] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:06 2022] PUT /identity/v3/projects/c44ec62db4b94346a295e37c09688cd0/users/3be084820fec43dd87933f8c5eb7afdd/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:06.347207 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ffbea-d5ad-4c35-9542-dd42344045df admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:06.362492 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ffbea-d5ad-4c35-9542-dd42344045df admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:06.451105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3a99a-6d53-4e36-9764-af310887959a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:06.451935 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3a99a-6d53-4e36-9764-af310887959a admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:06.452283 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3a99a-6d53-4e36-9764-af310887959a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:06.452677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3a99a-6d53-4e36-9764-af310887959a admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:06.454062 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3a99a-6d53-4e36-9764-af310887959a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:06.456089 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3a99a-6d53-4e36-9764-af310887959a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:06.474588 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 985/1991] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:06.479723 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d35b1-b8ec-4968-8290-efd47b4714fc admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:06.497581 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d35b1-b8ec-4968-8290-efd47b4714fc admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:06.510278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571aa786-9099-4798-9849-8b04a125b82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:06.511962 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571aa786-9099-4798-9849-8b04a125b82a admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:06.513791 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571aa786-9099-4798-9849-8b04a125b82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:06.514165 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571aa786-9099-4798-9849-8b04a125b82a admin admin] PATH_INFO: `/v3/projects/c44ec62db4b94346a295e37c09688cd0/users/3be084820fec43dd87933f8c5eb7afdd/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:06.518499 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571aa786-9099-4798-9849-8b04a125b82a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44ec62db4b94346a295e37c09688cd0, user_id=3be084820fec43dd87933f8c5eb7afdd, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:06.524937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571aa786-9099-4798-9849-8b04a125b82a admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:06.578101 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1007/1992] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:06 2022] PUT /identity/v3/projects/c44ec62db4b94346a295e37c09688cd0/users/3be084820fec43dd87933f8c5eb7afdd/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:06.579211 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a75cf1-f37b-4498-ace3-ed6e609e8bcc None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:06.579504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a75cf1-f37b-4498-ace3-ed6e609e8bcc None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:06.579786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a75cf1-f37b-4498-ace3-ed6e609e8bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:06.677135 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-d4a75cf1-f37b-4498-ace3-ed6e609e8bcc None None] MFA Rules not processed for user `3be084820fec43dd87933f8c5eb7afdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:06.679348 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d4a75cf1-f37b-4498-ace3-ed6e609e8bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:06.893665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 986/1993] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:37:06.908157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571aa786-9099-4798-9849-8b04a125b82a admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:07.080778 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571aa786-9099-4798-9849-8b04a125b82a admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:07.091650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d88f3a-3f7a-40ef-bfaa-652ee4a0edeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:07.092276 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d88f3a-3f7a-40ef-bfaa-652ee4a0edeb service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:07.095129 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d88f3a-3f7a-40ef-bfaa-652ee4a0edeb service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:07.095413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d88f3a-3f7a-40ef-bfaa-652ee4a0edeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:07.120097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d88f3a-3f7a-40ef-bfaa-652ee4a0edeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:07.139162 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d88f3a-3f7a-40ef-bfaa-652ee4a0edeb service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:07.161423 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1008/1994] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:07.322813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a75cf1-f37b-4498-ace3-ed6e609e8bcc None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:07.328069 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:07.427947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a75cf1-f37b-4498-ace3-ed6e609e8bcc None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:07.433740 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5df09-ce44-4dd1-8781-b4b86ec29728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:07.434453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5df09-ce44-4dd1-8781-b4b86ec29728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:07.434734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5df09-ce44-4dd1-8781-b4b86ec29728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:07.435064 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5df09-ce44-4dd1-8781-b4b86ec29728 admin admin] PATH_INFO: `/v3/users/e9093df2675f4b1288ce099ce110bb31` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:07.436264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5df09-ce44-4dd1-8781-b4b86ec29728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9093df2675f4b1288ce099ce110bb31)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:07.438219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5df09-ce44-4dd1-8781-b4b86ec29728 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:07.488162 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-61a5df09-ce44-4dd1-8781-b4b86ec29728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9093df2675f4b1288ce099ce110bb31'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:07.488876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-61a5df09-ce44-4dd1-8781-b4b86ec29728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9093df2675f4b1288ce099ce110bb31'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:07.489511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-61a5df09-ce44-4dd1-8781-b4b86ec29728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9093df2675f4b1288ce099ce110bb31'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:07.503915 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-61a5df09-ce44-4dd1-8781-b4b86ec29728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9093df2675f4b1288ce099ce110bb31'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:07.511298 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-61a5df09-ce44-4dd1-8781-b4b86ec29728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9093df2675f4b1288ce099ce110bb31'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:07.526808 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 987/1995] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:07 2022] DELETE /identity/v3/users/e9093df2675f4b1288ce099ce110bb31 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:07.531189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb7375-05a2-4df9-a31c-5c23d2f31cd0 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:07.531656 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb7375-05a2-4df9-a31c-5c23d2f31cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:07.532101 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb7375-05a2-4df9-a31c-5c23d2f31cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:07.552586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-5fbb7375-05a2-4df9-a31c-5c23d2f31cd0 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:07.554703 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-5fbb7375-05a2-4df9-a31c-5c23d2f31cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:07.631042 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1009/1996] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:07.641513 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5df09-ce44-4dd1-8781-b4b86ec29728 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:07.643250 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-61a5df09-ce44-4dd1-8781-b4b86ec29728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:07.709785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5df09-ce44-4dd1-8781-b4b86ec29728 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:07.714066 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7749d-dfd7-4662-84e0-3dfdb6f69859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:07.714799 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7749d-dfd7-4662-84e0-3dfdb6f69859 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:07.715241 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7749d-dfd7-4662-84e0-3dfdb6f69859 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:07.715763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7749d-dfd7-4662-84e0-3dfdb6f69859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:07.728238 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7749d-dfd7-4662-84e0-3dfdb6f69859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:07.729918 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7749d-dfd7-4662-84e0-3dfdb6f69859 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:07.743111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 988/1997] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:08.341918 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb7375-05a2-4df9-a31c-5c23d2f31cd0 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:08.343731 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-5fbb7375-05a2-4df9-a31c-5c23d2f31cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:08.381638 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb7375-05a2-4df9-a31c-5c23d2f31cd0 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:08.387800 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5936a91-9b0c-4c20-b7a3-751f6dcc7a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:08.389762 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5936a91-9b0c-4c20-b7a3-751f6dcc7a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:08.390944 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5936a91-9b0c-4c20-b7a3-751f6dcc7a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:08.391133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5936a91-9b0c-4c20-b7a3-751f6dcc7a89 admin admin] PATH_INFO: `/v3/projects/38181e2af3dd45d89e28699a3cee65af` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:08.394876 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5936a91-9b0c-4c20-b7a3-751f6dcc7a89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38181e2af3dd45d89e28699a3cee65af)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:08.394876 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5936a91-9b0c-4c20-b7a3-751f6dcc7a89 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:08.496692 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:08.500874 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-e5936a91-9b0c-4c20-b7a3-751f6dcc7a89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38181e2af3dd45d89e28699a3cee65af', 'request_id': 'req-e5936a91-9b0c-4c20-b7a3-751f6dcc7a89'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:08.516681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-e5936a91-9b0c-4c20-b7a3-751f6dcc7a89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38181e2af3dd45d89e28699a3cee65af', 'request_id': 'req-e5936a91-9b0c-4c20-b7a3-751f6dcc7a89'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:08.543903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-e5936a91-9b0c-4c20-b7a3-751f6dcc7a89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38181e2af3dd45d89e28699a3cee65af', 'request_id': 'req-e5936a91-9b0c-4c20-b7a3-751f6dcc7a89'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:08.582424 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-e5936a91-9b0c-4c20-b7a3-751f6dcc7a89 admin admin] The token cache is being invalidate because project 38181e2af3dd45d89e28699a3cee65af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:08.582773 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-e5936a91-9b0c-4c20-b7a3-751f6dcc7a89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:08.583626 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-e5936a91-9b0c-4c20-b7a3-751f6dcc7a89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:08.588869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1010/1998] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:08 2022] DELETE /identity/v3/projects/38181e2af3dd45d89e28699a3cee65af => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:08.592798 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7749d-dfd7-4662-84e0-3dfdb6f69859 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:08.606352 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7749d-dfd7-4662-84e0-3dfdb6f69859 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:08.632416 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:08.712442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25592bc-81a2-4090-a0ef-b934d5fdda3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:08.713222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25592bc-81a2-4090-a0ef-b934d5fdda3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:08.713724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25592bc-81a2-4090-a0ef-b934d5fdda3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:08.714076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25592bc-81a2-4090-a0ef-b934d5fdda3b admin admin] PATH_INFO: `/v3/users/3be084820fec43dd87933f8c5eb7afdd` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:08.716656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25592bc-81a2-4090-a0ef-b934d5fdda3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3be084820fec43dd87933f8c5eb7afdd)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:08.718676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25592bc-81a2-4090-a0ef-b934d5fdda3b admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:08.837525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c25592bc-81a2-4090-a0ef-b934d5fdda3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3be084820fec43dd87933f8c5eb7afdd'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:08.840178 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c25592bc-81a2-4090-a0ef-b934d5fdda3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3be084820fec43dd87933f8c5eb7afdd'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:08.840898 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c25592bc-81a2-4090-a0ef-b934d5fdda3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3be084820fec43dd87933f8c5eb7afdd'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:08.871942 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c25592bc-81a2-4090-a0ef-b934d5fdda3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3be084820fec43dd87933f8c5eb7afdd'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:08.882611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c25592bc-81a2-4090-a0ef-b934d5fdda3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3be084820fec43dd87933f8c5eb7afdd'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:08.919424 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 989/1999] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:08 2022] DELETE /identity/v3/users/3be084820fec43dd87933f8c5eb7afdd => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:09.268579 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5936a91-9b0c-4c20-b7a3-751f6dcc7a89 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:09.270128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e5936a91-9b0c-4c20-b7a3-751f6dcc7a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:09.295442 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5936a91-9b0c-4c20-b7a3-751f6dcc7a89 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:09.401858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fc1ff-0a49-428d-a5f1-ae4c5d33031b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:09.402744 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fc1ff-0a49-428d-a5f1-ae4c5d33031b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:09.404025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fc1ff-0a49-428d-a5f1-ae4c5d33031b admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:09.404523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fc1ff-0a49-428d-a5f1-ae4c5d33031b admin admin] PATH_INFO: `/v3/projects/c44ec62db4b94346a295e37c09688cd0` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:09.405995 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fc1ff-0a49-428d-a5f1-ae4c5d33031b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c44ec62db4b94346a295e37c09688cd0)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:09.408388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fc1ff-0a49-428d-a5f1-ae4c5d33031b admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:09.504340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-245fc1ff-0a49-428d-a5f1-ae4c5d33031b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44ec62db4b94346a295e37c09688cd0', 'request_id': 'req-245fc1ff-0a49-428d-a5f1-ae4c5d33031b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:09.514901 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-245fc1ff-0a49-428d-a5f1-ae4c5d33031b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44ec62db4b94346a295e37c09688cd0', 'request_id': 'req-245fc1ff-0a49-428d-a5f1-ae4c5d33031b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:09.521254 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-245fc1ff-0a49-428d-a5f1-ae4c5d33031b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44ec62db4b94346a295e37c09688cd0', 'request_id': 'req-245fc1ff-0a49-428d-a5f1-ae4c5d33031b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:09.551027 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-245fc1ff-0a49-428d-a5f1-ae4c5d33031b admin admin] The token cache is being invalidate because project c44ec62db4b94346a295e37c09688cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:09.551027 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-245fc1ff-0a49-428d-a5f1-ae4c5d33031b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:09.551027 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-245fc1ff-0a49-428d-a5f1-ae4c5d33031b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:09.551027 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1011/2000] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:09 2022] DELETE /identity/v3/projects/c44ec62db4b94346a295e37c09688cd0 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:09.562420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae50ca-e155-43b8-b8e5-31b6cfe8183b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:09.562420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae50ca-e155-43b8-b8e5-31b6cfe8183b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:09.562420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae50ca-e155-43b8-b8e5-31b6cfe8183b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:09.585982 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-90ae50ca-e155-43b8-b8e5-31b6cfe8183b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:09.587379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-90ae50ca-e155-43b8-b8e5-31b6cfe8183b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:09.672095 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 990/2001] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:09.682418 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b72ba-6140-4bec-a838-4d0b0956ea49 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:09.682713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b72ba-6140-4bec-a838-4d0b0956ea49 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:09.683026 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b72ba-6140-4bec-a838-4d0b0956ea49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:09.705608 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-666b72ba-6140-4bec-a838-4d0b0956ea49 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:09.707441 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-666b72ba-6140-4bec-a838-4d0b0956ea49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:09.720447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1012/2002] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:09.724634 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae50ca-e155-43b8-b8e5-31b6cfe8183b None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:09.744439 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae50ca-e155-43b8-b8e5-31b6cfe8183b None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:09.754158 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3feb05-8011-4104-9232-fac2ec3d3b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:09.754765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3feb05-8011-4104-9232-fac2ec3d3b39 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:09.755084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3feb05-8011-4104-9232-fac2ec3d3b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:09.755362 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3feb05-8011-4104-9232-fac2ec3d3b39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:09.756006 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3feb05-8011-4104-9232-fac2ec3d3b39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:37:09.756918 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3feb05-8011-4104-9232-fac2ec3d3b39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:09.758510 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3feb05-8011-4104-9232-fac2ec3d3b39 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:09.770346 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 991/2003] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:37:09.774727 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b72ba-6140-4bec-a838-4d0b0956ea49 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:09.785506 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b72ba-6140-4bec-a838-4d0b0956ea49 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:09.791650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf2b1a-41f4-4d00-a47d-e67a9f95bc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:09.793165 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf2b1a-41f4-4d00-a47d-e67a9f95bc0e admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:09.793596 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf2b1a-41f4-4d00-a47d-e67a9f95bc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:09.794043 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf2b1a-41f4-4d00-a47d-e67a9f95bc0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:09.794858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf2b1a-41f4-4d00-a47d-e67a9f95bc0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:09.797069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf2b1a-41f4-4d00-a47d-e67a9f95bc0e admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:09.832055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1013/2004] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:09 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:37:09.833209 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3feb05-8011-4104-9232-fac2ec3d3b39 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:09.844582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3feb05-8011-4104-9232-fac2ec3d3b39 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:09.885861 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:09.941413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b993f8c-2762-467d-8827-c44d095178bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:09.942134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b993f8c-2762-467d-8827-c44d095178bd admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:09.942420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b993f8c-2762-467d-8827-c44d095178bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:09.942715 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b993f8c-2762-467d-8827-c44d095178bd admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:09.943451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b993f8c-2762-467d-8827-c44d095178bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:09.946521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b993f8c-2762-467d-8827-c44d095178bd admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:10.016075 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 992/2005] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:09 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:10.020279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf2b1a-41f4-4d00-a47d-e67a9f95bc0e admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:10.036968 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf2b1a-41f4-4d00-a47d-e67a9f95bc0e admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:10.045221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b993f8c-2762-467d-8827-c44d095178bd admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:10.047078 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1b993f8c-2762-467d-8827-c44d095178bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:10.063218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bfcb8-039b-4521-84cf-c7983c4a1c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:10.063858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bfcb8-039b-4521-84cf-c7983c4a1c1a admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:10.064140 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bfcb8-039b-4521-84cf-c7983c4a1c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:10.064431 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bfcb8-039b-4521-84cf-c7983c4a1c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:10.065088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bfcb8-039b-4521-84cf-c7983c4a1c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:10.066820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bfcb8-039b-4521-84cf-c7983c4a1c1a admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:10.069687 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b993f8c-2762-467d-8827-c44d095178bd admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:10.077706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8b020-0d5c-4cf8-97bc-f47585c370fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:10.078533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8b020-0d5c-4cf8-97bc-f47585c370fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:10.079971 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8b020-0d5c-4cf8-97bc-f47585c370fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:10.080636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8b020-0d5c-4cf8-97bc-f47585c370fe admin admin] PATH_INFO: `/v3/users/d8b3fb3fa70143d7b85cdfeb86f0b7b8` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:10.082450 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8b020-0d5c-4cf8-97bc-f47585c370fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8b3fb3fa70143d7b85cdfeb86f0b7b8)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:10.088806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1014/2006] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:10.091312 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8b020-0d5c-4cf8-97bc-f47585c370fe admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:10.094145 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bfcb8-039b-4521-84cf-c7983c4a1c1a admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:10.121596 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bfcb8-039b-4521-84cf-c7983c4a1c1a admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:10.135076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113448fb-d103-424e-a403-e3f94a3492c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:10.135952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113448fb-d103-424e-a403-e3f94a3492c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:10.136380 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113448fb-d103-424e-a403-e3f94a3492c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:10.136798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113448fb-d103-424e-a403-e3f94a3492c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:10.138069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113448fb-d103-424e-a403-e3f94a3492c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:10.140098 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113448fb-d103-424e-a403-e3f94a3492c0 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:10.157743 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1015/2007] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:10.164234 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113448fb-d103-424e-a403-e3f94a3492c0 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:10.182026 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113448fb-d103-424e-a403-e3f94a3492c0 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:10.200496 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368fa9f-0883-4cbe-9bc9-650967a6fa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:10.201555 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368fa9f-0883-4cbe-9bc9-650967a6fa24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:10.202058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368fa9f-0883-4cbe-9bc9-650967a6fa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:10.203280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368fa9f-0883-4cbe-9bc9-650967a6fa24 admin admin] PATH_INFO: `/v3/projects/fa46dbd5bc944170a3affbf094c63e94/users/743a2a0883ba4c60b3af827f995ab70a/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:10.208199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6fd8b020-0d5c-4cf8-97bc-f47585c370fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8b3fb3fa70143d7b85cdfeb86f0b7b8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:10.208895 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6fd8b020-0d5c-4cf8-97bc-f47585c370fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8b3fb3fa70143d7b85cdfeb86f0b7b8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:10.210200 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6fd8b020-0d5c-4cf8-97bc-f47585c370fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8b3fb3fa70143d7b85cdfeb86f0b7b8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:10.226157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:10.232007 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368fa9f-0883-4cbe-9bc9-650967a6fa24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa46dbd5bc944170a3affbf094c63e94, user_id=743a2a0883ba4c60b3af827f995ab70a, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:10.233786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6fd8b020-0d5c-4cf8-97bc-f47585c370fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8b3fb3fa70143d7b85cdfeb86f0b7b8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:10.236534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368fa9f-0883-4cbe-9bc9-650967a6fa24 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:10.251055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6fd8b020-0d5c-4cf8-97bc-f47585c370fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8b3fb3fa70143d7b85cdfeb86f0b7b8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:10.263919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1016/2008] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:10 2022] PUT /identity/v3/projects/fa46dbd5bc944170a3affbf094c63e94/users/743a2a0883ba4c60b3af827f995ab70a/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:10.275020 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 993/2009] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:10 2022] DELETE /identity/v3/users/d8b3fb3fa70143d7b85cdfeb86f0b7b8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:10.278776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fb02d-90f8-47ab-b502-d4a82c9ceae0 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:10.279100 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fb02d-90f8-47ab-b502-d4a82c9ceae0 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:10.279371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fb02d-90f8-47ab-b502-d4a82c9ceae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:10.284133 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe19407-42a8-4ba8-ada8-49d2b772b485 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:10.284413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe19407-42a8-4ba8-ada8-49d2b772b485 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:10.284682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe19407-42a8-4ba8-ada8-49d2b772b485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:10.313506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-6fe19407-42a8-4ba8-ada8-49d2b772b485 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:10.315128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-1b2fb02d-90f8-47ab-b502-d4a82c9ceae0 None None] MFA Rules not processed for user `743a2a0883ba4c60b3af827f995ab70a`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:10.315583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6fe19407-42a8-4ba8-ada8-49d2b772b485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:10.318005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-1b2fb02d-90f8-47ab-b502-d4a82c9ceae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:10.399683 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1017/2010] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:10.399881 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 994/2011] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:10.399978 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fb02d-90f8-47ab-b502-d4a82c9ceae0 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:10.405841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-1b2fb02d-90f8-47ab-b502-d4a82c9ceae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:10.407621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe19407-42a8-4ba8-ada8-49d2b772b485 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:10.409154 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6fe19407-42a8-4ba8-ada8-49d2b772b485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:10.422859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fb02d-90f8-47ab-b502-d4a82c9ceae0 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:10.427541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd6157-d72c-47dc-96ad-679f3ca65bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:10.428701 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd6157-d72c-47dc-96ad-679f3ca65bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:10.428974 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd6157-d72c-47dc-96ad-679f3ca65bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:10.429251 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd6157-d72c-47dc-96ad-679f3ca65bf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:10.429879 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd6157-d72c-47dc-96ad-679f3ca65bf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:10.432034 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd6157-d72c-47dc-96ad-679f3ca65bf5 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:10.452151 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:10.468075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1018/2012] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:10 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:10.471883 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd6157-d72c-47dc-96ad-679f3ca65bf5 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:10.485113 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe19407-42a8-4ba8-ada8-49d2b772b485 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:10.540327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274094d-db97-4520-af93-6a80d1c8e3cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:10.540863 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274094d-db97-4520-af93-6a80d1c8e3cd service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:10.541202 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274094d-db97-4520-af93-6a80d1c8e3cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:10.541480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274094d-db97-4520-af93-6a80d1c8e3cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:10.544751 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd6157-d72c-47dc-96ad-679f3ca65bf5 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:10.549390 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c78ac4-8787-48eb-b4ab-1644666de435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:10.549908 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c78ac4-8787-48eb-b4ab-1644666de435 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:10.550255 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c78ac4-8787-48eb-b4ab-1644666de435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:10.550592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c78ac4-8787-48eb-b4ab-1644666de435 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:10.551340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c78ac4-8787-48eb-b4ab-1644666de435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:10.553500 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274094d-db97-4520-af93-6a80d1c8e3cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:10.554213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c78ac4-8787-48eb-b4ab-1644666de435 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:10.556313 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274094d-db97-4520-af93-6a80d1c8e3cd service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:10.569953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 995/2013] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:37:10.580196 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1019/2014] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:10 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:10.593617 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274094d-db97-4520-af93-6a80d1c8e3cd service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:10.604226 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274094d-db97-4520-af93-6a80d1c8e3cd service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:10.608982 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dcc29-4421-4fa3-b733-54faebcd8168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:10.610340 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dcc29-4421-4fa3-b733-54faebcd8168 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:10.611236 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dcc29-4421-4fa3-b733-54faebcd8168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:10.611236 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dcc29-4421-4fa3-b733-54faebcd8168 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:10.611813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07dcc29-4421-4fa3-b733-54faebcd8168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:10.613753 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07dcc29-4421-4fa3-b733-54faebcd8168 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:10.629409 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 996/2015] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:10.633853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c78ac4-8787-48eb-b4ab-1644666de435 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:10.647575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c78ac4-8787-48eb-b4ab-1644666de435 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:10.654910 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85759c55-31de-4469-abee-ff1506094845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:10.656063 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85759c55-31de-4469-abee-ff1506094845 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:10.656518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85759c55-31de-4469-abee-ff1506094845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:10.656916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85759c55-31de-4469-abee-ff1506094845 admin admin] PATH_INFO: `/v3/projects/4a32ec0848d24147be836317db4bca5b/users/3f557206929142c3b2da56329bd6817f/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:10.684869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85759c55-31de-4469-abee-ff1506094845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a32ec0848d24147be836317db4bca5b, user_id=3f557206929142c3b2da56329bd6817f, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:10.689196 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85759c55-31de-4469-abee-ff1506094845 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:10.737642 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1020/2016] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:10 2022] PUT /identity/v3/projects/4a32ec0848d24147be836317db4bca5b/users/3f557206929142c3b2da56329bd6817f/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:10.744172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dcc29-4421-4fa3-b733-54faebcd8168 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:10.761711 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dcc29-4421-4fa3-b733-54faebcd8168 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:10.940785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56836a45-819d-4a77-9f4a-5d114614044d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:10.942196 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56836a45-819d-4a77-9f4a-5d114614044d admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:10.942370 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56836a45-819d-4a77-9f4a-5d114614044d admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:10.942714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56836a45-819d-4a77-9f4a-5d114614044d admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:10.956092 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56836a45-819d-4a77-9f4a-5d114614044d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:10.957593 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56836a45-819d-4a77-9f4a-5d114614044d admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:10.981040 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85759c55-31de-4469-abee-ff1506094845 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:10.984929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 997/2017] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:11.002914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85759c55-31de-4469-abee-ff1506094845 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:11.012399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d27c21-814f-45e4-994f-b0a71bcd2823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:11.013080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d27c21-814f-45e4-994f-b0a71bcd2823 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:11.013359 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d27c21-814f-45e4-994f-b0a71bcd2823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:11.013637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d27c21-814f-45e4-994f-b0a71bcd2823 admin admin] PATH_INFO: `/v3/projects/4a32ec0848d24147be836317db4bca5b/users/3f557206929142c3b2da56329bd6817f/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:11.016877 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d27c21-814f-45e4-994f-b0a71bcd2823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a32ec0848d24147be836317db4bca5b, user_id=3f557206929142c3b2da56329bd6817f, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:11.021001 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d27c21-814f-45e4-994f-b0a71bcd2823 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:11.046944 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1021/2018] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:10 2022] PUT /identity/v3/projects/4a32ec0848d24147be836317db4bca5b/users/3f557206929142c3b2da56329bd6817f/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:11.049453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3737a-874a-4427-b79a-29f279e9e723 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:11.049840 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3737a-874a-4427-b79a-29f279e9e723 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:11.050274 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3737a-874a-4427-b79a-29f279e9e723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:11.109364 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-1bb3737a-874a-4427-b79a-29f279e9e723 None None] MFA Rules not processed for user `3f557206929142c3b2da56329bd6817f`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:11.110365 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d27c21-814f-45e4-994f-b0a71bcd2823 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:11.110481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1bb3737a-874a-4427-b79a-29f279e9e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:11.112184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-01d27c21-814f-45e4-994f-b0a71bcd2823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:11.125242 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:11.190297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d27c21-814f-45e4-994f-b0a71bcd2823 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:11.194673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc9f1b-bbd9-4b99-98b2-8d085a376cc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:11.195449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc9f1b-bbd9-4b99-98b2-8d085a376cc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:11.195729 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc9f1b-bbd9-4b99-98b2-8d085a376cc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:11.196003 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc9f1b-bbd9-4b99-98b2-8d085a376cc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:11.199613 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4abc9f1b-bbd9-4b99-98b2-8d085a376cc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:11.210484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 998/2019] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:11.281800 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc9f1b-bbd9-4b99-98b2-8d085a376cc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:11.283464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc9f1b-bbd9-4b99-98b2-8d085a376cc5 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:11.302765 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1022/2020] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:37:11.324782 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3737a-874a-4427-b79a-29f279e9e723 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:11.327627 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1bb3737a-874a-4427-b79a-29f279e9e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:11.335071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:11.425616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3737a-874a-4427-b79a-29f279e9e723 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:11.433613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249ae0e-d454-493a-9571-0a21eb2de184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:11.434255 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249ae0e-d454-493a-9571-0a21eb2de184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:11.435026 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249ae0e-d454-493a-9571-0a21eb2de184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:11.435262 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249ae0e-d454-493a-9571-0a21eb2de184 admin admin] PATH_INFO: `/v3/projects/1be28b1870e440dda54879de17aa065b` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:11.436950 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249ae0e-d454-493a-9571-0a21eb2de184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be28b1870e440dda54879de17aa065b)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:11.439785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249ae0e-d454-493a-9571-0a21eb2de184 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:11.497387 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f249ae0e-d454-493a-9571-0a21eb2de184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be28b1870e440dda54879de17aa065b', 'request_id': 'req-f249ae0e-d454-493a-9571-0a21eb2de184'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:11.503530 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f249ae0e-d454-493a-9571-0a21eb2de184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be28b1870e440dda54879de17aa065b', 'request_id': 'req-f249ae0e-d454-493a-9571-0a21eb2de184'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:11.511033 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f249ae0e-d454-493a-9571-0a21eb2de184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be28b1870e440dda54879de17aa065b', 'request_id': 'req-f249ae0e-d454-493a-9571-0a21eb2de184'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:11.527813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f249ae0e-d454-493a-9571-0a21eb2de184 admin admin] The token cache is being invalidate because project 1be28b1870e440dda54879de17aa065b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:11.528156 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f249ae0e-d454-493a-9571-0a21eb2de184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:11.528732 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f249ae0e-d454-493a-9571-0a21eb2de184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:11.531003 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 999/2021] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:11 2022] DELETE /identity/v3/projects/1be28b1870e440dda54879de17aa065b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:11.534276 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc9f1b-bbd9-4b99-98b2-8d085a376cc5 service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:11.547727 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc9f1b-bbd9-4b99-98b2-8d085a376cc5 service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:11.624418 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40816698-0402-4687-b0bc-0b3e24d0e88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:11.626138 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40816698-0402-4687-b0bc-0b3e24d0e88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:11.626510 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40816698-0402-4687-b0bc-0b3e24d0e88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:11.626793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40816698-0402-4687-b0bc-0b3e24d0e88d admin admin] PATH_INFO: `/v3/users/fd5ba20b9be74383bf8c82f055b3e1ca` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:11.629183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40816698-0402-4687-b0bc-0b3e24d0e88d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd5ba20b9be74383bf8c82f055b3e1ca)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:11.636265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40816698-0402-4687-b0bc-0b3e24d0e88d admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:11.729788 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-40816698-0402-4687-b0bc-0b3e24d0e88d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd5ba20b9be74383bf8c82f055b3e1ca'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:11.731652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-40816698-0402-4687-b0bc-0b3e24d0e88d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd5ba20b9be74383bf8c82f055b3e1ca'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:11.732485 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-40816698-0402-4687-b0bc-0b3e24d0e88d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd5ba20b9be74383bf8c82f055b3e1ca'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:11.754503 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-40816698-0402-4687-b0bc-0b3e24d0e88d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd5ba20b9be74383bf8c82f055b3e1ca'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:11.756512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:11.776806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-40816698-0402-4687-b0bc-0b3e24d0e88d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd5ba20b9be74383bf8c82f055b3e1ca'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:11.803960 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1023/2022] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:11 2022] DELETE /identity/v3/users/fd5ba20b9be74383bf8c82f055b3e1ca => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:12.133816 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249ae0e-d454-493a-9571-0a21eb2de184 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:12.135804 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f249ae0e-d454-493a-9571-0a21eb2de184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:12.159937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249ae0e-d454-493a-9571-0a21eb2de184 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:12.259018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef257ea-b1f0-49f6-ab79-544ca8784b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:12.259018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef257ea-b1f0-49f6-ab79-544ca8784b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:12.259018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef257ea-b1f0-49f6-ab79-544ca8784b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:12.259018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef257ea-b1f0-49f6-ab79-544ca8784b7f admin admin] PATH_INFO: `/v3/projects/128c5880f9154dc2b4aa708ec392cf93` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:12.259437 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef257ea-b1f0-49f6-ab79-544ca8784b7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=128c5880f9154dc2b4aa708ec392cf93)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:12.259437 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef257ea-b1f0-49f6-ab79-544ca8784b7f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:12.305533 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:12.319698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-eef257ea-b1f0-49f6-ab79-544ca8784b7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '128c5880f9154dc2b4aa708ec392cf93', 'request_id': 'req-eef257ea-b1f0-49f6-ab79-544ca8784b7f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:12.331563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-eef257ea-b1f0-49f6-ab79-544ca8784b7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '128c5880f9154dc2b4aa708ec392cf93', 'request_id': 'req-eef257ea-b1f0-49f6-ab79-544ca8784b7f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:12.340749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-eef257ea-b1f0-49f6-ab79-544ca8784b7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '128c5880f9154dc2b4aa708ec392cf93', 'request_id': 'req-eef257ea-b1f0-49f6-ab79-544ca8784b7f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:12.357146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-eef257ea-b1f0-49f6-ab79-544ca8784b7f admin admin] The token cache is being invalidate because project 128c5880f9154dc2b4aa708ec392cf93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:12.358015 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-eef257ea-b1f0-49f6-ab79-544ca8784b7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:12.358911 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-eef257ea-b1f0-49f6-ab79-544ca8784b7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:12.361419 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1000/2023] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:12 2022] DELETE /identity/v3/projects/128c5880f9154dc2b4aa708ec392cf93 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:12.366076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40816698-0402-4687-b0bc-0b3e24d0e88d admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:12.368271 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-40816698-0402-4687-b0bc-0b3e24d0e88d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:12.383829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40816698-0402-4687-b0bc-0b3e24d0e88d admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:12.471614 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf49e6d-2437-4c5c-9e23-f4ee15c90753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:12.471940 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf49e6d-2437-4c5c-9e23-f4ee15c90753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:12.472232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf49e6d-2437-4c5c-9e23-f4ee15c90753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:12.472505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf49e6d-2437-4c5c-9e23-f4ee15c90753 admin admin] PATH_INFO: `/v3/users/6509924761fc4a2eb1379a714f94fc56` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:12.473933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf49e6d-2437-4c5c-9e23-f4ee15c90753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6509924761fc4a2eb1379a714f94fc56)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:12.476759 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf49e6d-2437-4c5c-9e23-f4ee15c90753 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:12.533205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8cf49e6d-2437-4c5c-9e23-f4ee15c90753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6509924761fc4a2eb1379a714f94fc56'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:12.533973 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8cf49e6d-2437-4c5c-9e23-f4ee15c90753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6509924761fc4a2eb1379a714f94fc56'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:12.534647 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8cf49e6d-2437-4c5c-9e23-f4ee15c90753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6509924761fc4a2eb1379a714f94fc56'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:12.549287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8cf49e6d-2437-4c5c-9e23-f4ee15c90753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6509924761fc4a2eb1379a714f94fc56'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:12.558465 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8cf49e6d-2437-4c5c-9e23-f4ee15c90753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6509924761fc4a2eb1379a714f94fc56'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:12.571718 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1024/2024] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:12 2022] DELETE /identity/v3/users/6509924761fc4a2eb1379a714f94fc56 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:13.317473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef257ea-b1f0-49f6-ab79-544ca8784b7f admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:13.320151 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-eef257ea-b1f0-49f6-ab79-544ca8784b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:13.369294 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef257ea-b1f0-49f6-ab79-544ca8784b7f admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:13.538752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449b4ed-d353-4ccf-8a79-ee84babc106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:13.546667 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449b4ed-d353-4ccf-8a79-ee84babc106a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:13.557281 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449b4ed-d353-4ccf-8a79-ee84babc106a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:13.557776 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449b4ed-d353-4ccf-8a79-ee84babc106a admin admin] PATH_INFO: `/v3/projects/3173379b606649a4bd21a6b105c8f631` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:13.580422 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449b4ed-d353-4ccf-8a79-ee84babc106a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3173379b606649a4bd21a6b105c8f631)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:13.592676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449b4ed-d353-4ccf-8a79-ee84babc106a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:13.683518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf49e6d-2437-4c5c-9e23-f4ee15c90753 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:13.687089 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-8cf49e6d-2437-4c5c-9e23-f4ee15c90753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:13.699177 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0449b4ed-d353-4ccf-8a79-ee84babc106a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3173379b606649a4bd21a6b105c8f631', 'request_id': 'req-0449b4ed-d353-4ccf-8a79-ee84babc106a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:13.706560 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0449b4ed-d353-4ccf-8a79-ee84babc106a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3173379b606649a4bd21a6b105c8f631', 'request_id': 'req-0449b4ed-d353-4ccf-8a79-ee84babc106a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:13.723544 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf49e6d-2437-4c5c-9e23-f4ee15c90753 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:13.728969 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0449b4ed-d353-4ccf-8a79-ee84babc106a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3173379b606649a4bd21a6b105c8f631', 'request_id': 'req-0449b4ed-d353-4ccf-8a79-ee84babc106a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:13.748247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0449b4ed-d353-4ccf-8a79-ee84babc106a admin admin] The token cache is being invalidate because project 3173379b606649a4bd21a6b105c8f631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:13.749681 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0449b4ed-d353-4ccf-8a79-ee84babc106a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:13.751248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0449b4ed-d353-4ccf-8a79-ee84babc106a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:13.756814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1001/2025] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:13 2022] DELETE /identity/v3/projects/3173379b606649a4bd21a6b105c8f631 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:13.767775 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f293f-03a2-40dd-a2df-9dbaf3d34402 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:13.768342 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f293f-03a2-40dd-a2df-9dbaf3d34402 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:13.768880 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f293f-03a2-40dd-a2df-9dbaf3d34402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:13.799722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-d85f293f-03a2-40dd-a2df-9dbaf3d34402 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:13.802254 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d85f293f-03a2-40dd-a2df-9dbaf3d34402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:13.884771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bdb91-01ad-4bd9-acbf-b439a5472b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:13.885333 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bdb91-01ad-4bd9-acbf-b439a5472b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:13.885609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bdb91-01ad-4bd9-acbf-b439a5472b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:13.885879 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bdb91-01ad-4bd9-acbf-b439a5472b14 admin admin] PATH_INFO: `/v3/users/2939066c6464457fa3c13f94154a793e` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:13.887071 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bdb91-01ad-4bd9-acbf-b439a5472b14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2939066c6464457fa3c13f94154a793e)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:13.888977 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bdb91-01ad-4bd9-acbf-b439a5472b14 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:13.893124 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:13.914601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:13.938226 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1002/2026] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:13.945163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c1783-4b27-4f8c-a8b4-6ec38f7a9452 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:13.945466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c1783-4b27-4f8c-a8b4-6ec38f7a9452 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:13.945707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c1783-4b27-4f8c-a8b4-6ec38f7a9452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:14.017270 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-d15c1783-4b27-4f8c-a8b4-6ec38f7a9452 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:14.018761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d15c1783-4b27-4f8c-a8b4-6ec38f7a9452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:14.020427 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-fd9bdb91-01ad-4bd9-acbf-b439a5472b14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2939066c6464457fa3c13f94154a793e'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:14.021383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-fd9bdb91-01ad-4bd9-acbf-b439a5472b14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2939066c6464457fa3c13f94154a793e'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:14.022791 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-fd9bdb91-01ad-4bd9-acbf-b439a5472b14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2939066c6464457fa3c13f94154a793e'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:14.047835 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1003/2027] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:14.053834 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c1783-4b27-4f8c-a8b4-6ec38f7a9452 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:14.073034 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-fd9bdb91-01ad-4bd9-acbf-b439a5472b14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2939066c6464457fa3c13f94154a793e'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:14.079687 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c1783-4b27-4f8c-a8b4-6ec38f7a9452 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:14.094066 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35efc4-9f5f-4daf-b050-8a800112527b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:14.094931 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35efc4-9f5f-4daf-b050-8a800112527b admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:14.095374 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35efc4-9f5f-4daf-b050-8a800112527b admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:14.095905 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35efc4-9f5f-4daf-b050-8a800112527b admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:14.096910 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35efc4-9f5f-4daf-b050-8a800112527b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:37:14.097115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-fd9bdb91-01ad-4bd9-acbf-b439a5472b14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2939066c6464457fa3c13f94154a793e'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:14.097460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35efc4-9f5f-4daf-b050-8a800112527b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:14.099556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35efc4-9f5f-4daf-b050-8a800112527b admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:14.122502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1025/2028] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:13 2022] DELETE /identity/v3/users/2939066c6464457fa3c13f94154a793e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:37:14.138601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2eaaa-cea7-4286-a07e-a172f5c5a921 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:14.141327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2eaaa-cea7-4286-a07e-a172f5c5a921 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:14.144418 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2eaaa-cea7-4286-a07e-a172f5c5a921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:14.152967 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1004/2029] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:37:14.155203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35efc4-9f5f-4daf-b050-8a800112527b admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:14.188774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35efc4-9f5f-4daf-b050-8a800112527b admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:14.196346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-30c2eaaa-cea7-4286-a07e-a172f5c5a921 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:14.198000 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-30c2eaaa-cea7-4286-a07e-a172f5c5a921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:14.320909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f2954-616e-405c-9f61-bd54ccf9e53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:14.322407 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f2954-616e-405c-9f61-bd54ccf9e53f admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:14.323290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f2954-616e-405c-9f61-bd54ccf9e53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:14.323661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f2954-616e-405c-9f61-bd54ccf9e53f admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:14.324417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f2954-616e-405c-9f61-bd54ccf9e53f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:14.328573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f2954-616e-405c-9f61-bd54ccf9e53f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:14.377919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1026/2030] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:14.378866 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1005/2031] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:14 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:14.379684 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f2954-616e-405c-9f61-bd54ccf9e53f admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:14.384872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b29f2954-616e-405c-9f61-bd54ccf9e53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:14.386215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2eaaa-cea7-4286-a07e-a172f5c5a921 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:14.388625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-30c2eaaa-cea7-4286-a07e-a172f5c5a921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:14.419757 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2eaaa-cea7-4286-a07e-a172f5c5a921 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:14.505853 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f2954-616e-405c-9f61-bd54ccf9e53f admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:14.517910 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffcf43-79d9-4b21-988a-781cbb1067aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:14.518925 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffcf43-79d9-4b21-988a-781cbb1067aa service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:14.519387 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffcf43-79d9-4b21-988a-781cbb1067aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:14.519893 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffcf43-79d9-4b21-988a-781cbb1067aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:14.522535 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8fffcf43-79d9-4b21-988a-781cbb1067aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:14.527622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ae3f0-d995-435b-8b3a-37e31738da27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:14.528356 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae3f0-d995-435b-8b3a-37e31738da27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:14.528638 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae3f0-d995-435b-8b3a-37e31738da27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:14.528909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae3f0-d995-435b-8b3a-37e31738da27 admin admin] PATH_INFO: `/v3/users/f5da61e8b515416e813176379918f476` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:14.530073 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ae3f0-d995-435b-8b3a-37e31738da27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5da61e8b515416e813176379918f476)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:14.532132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ae3f0-d995-435b-8b3a-37e31738da27 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:14.582918 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:14.624557 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-457ae3f0-d995-435b-8b3a-37e31738da27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5da61e8b515416e813176379918f476'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:14.625548 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-457ae3f0-d995-435b-8b3a-37e31738da27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5da61e8b515416e813176379918f476'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:14.626186 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-457ae3f0-d995-435b-8b3a-37e31738da27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5da61e8b515416e813176379918f476'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:14.641351 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffcf43-79d9-4b21-988a-781cbb1067aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:14.641760 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-457ae3f0-d995-435b-8b3a-37e31738da27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5da61e8b515416e813176379918f476'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:14.643109 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffcf43-79d9-4b21-988a-781cbb1067aa service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:14.648881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-457ae3f0-d995-435b-8b3a-37e31738da27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5da61e8b515416e813176379918f476'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:14.654631 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1006/2032] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:14.655587 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffcf43-79d9-4b21-988a-781cbb1067aa service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:14.670500 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffcf43-79d9-4b21-988a-781cbb1067aa service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:14.673234 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1027/2033] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:14 2022] DELETE /identity/v3/users/f5da61e8b515416e813176379918f476 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:14.674086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ae3f0-d995-435b-8b3a-37e31738da27 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:14.675725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-457ae3f0-d995-435b-8b3a-37e31738da27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:14.680998 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:14.751451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd050be7-83e1-4777-9c28-9ed0c002d76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:14.752460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd050be7-83e1-4777-9c28-9ed0c002d76d admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:14.752936 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd050be7-83e1-4777-9c28-9ed0c002d76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:14.753407 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd050be7-83e1-4777-9c28-9ed0c002d76d admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:14.754516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd050be7-83e1-4777-9c28-9ed0c002d76d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:14.758323 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd050be7-83e1-4777-9c28-9ed0c002d76d admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:14.785875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1007/2034] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:14 2022] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:14.785875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae7657-9d6a-4554-8073-caf35fdfe490 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:14.785875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae7657-9d6a-4554-8073-caf35fdfe490 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:14.785875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae7657-9d6a-4554-8073-caf35fdfe490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:14.792517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ae3f0-d995-435b-8b3a-37e31738da27 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:14.796730 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d20c5-e621-401a-9602-54fa00ad5e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:14.797463 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d20c5-e621-401a-9602-54fa00ad5e4f service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:14.797850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d20c5-e621-401a-9602-54fa00ad5e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:14.798198 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d20c5-e621-401a-9602-54fa00ad5e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:14.801028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-ff1d20c5-e621-401a-9602-54fa00ad5e4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:14.806950 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-b1ae7657-9d6a-4554-8073-caf35fdfe490 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:14.808338 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b1ae7657-9d6a-4554-8073-caf35fdfe490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:14.815894 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d20c5-e621-401a-9602-54fa00ad5e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:14.817766 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d20c5-e621-401a-9602-54fa00ad5e4f service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:14.822158 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1008/2035] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:14.822158 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae7657-9d6a-4554-8073-caf35fdfe490 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:14.824131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b1ae7657-9d6a-4554-8073-caf35fdfe490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:14.838923 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae7657-9d6a-4554-8073-caf35fdfe490 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:14.847111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1028/2036] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:14.847708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e8246-954b-486b-b1fd-4bd4ffeb4b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:14.848446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e8246-954b-486b-b1fd-4bd4ffeb4b7c admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:14.848774 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d20c5-e621-401a-9602-54fa00ad5e4f service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:14.849044 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e8246-954b-486b-b1fd-4bd4ffeb4b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:14.849513 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e8246-954b-486b-b1fd-4bd4ffeb4b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:14.851068 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e8246-954b-486b-b1fd-4bd4ffeb4b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:14.851755 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-ff1d20c5-e621-401a-9602-54fa00ad5e4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:14.853400 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e8246-954b-486b-b1fd-4bd4ffeb4b7c admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:14.871036 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1009/2037] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:14.875151 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e8246-954b-486b-b1fd-4bd4ffeb4b7c admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:14.875781 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d20c5-e621-401a-9602-54fa00ad5e4f service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:14.880725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e0b0a-c57b-4cc1-b654-9b276ea31dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:14.882134 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e0b0a-c57b-4cc1-b654-9b276ea31dab service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:14.882571 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e0b0a-c57b-4cc1-b654-9b276ea31dab service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:14.883021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e0b0a-c57b-4cc1-b654-9b276ea31dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:14.893962 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e8246-954b-486b-b1fd-4bd4ffeb4b7c admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:14.900341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e0b0a-c57b-4cc1-b654-9b276ea31dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:14.901782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e0b0a-c57b-4cc1-b654-9b276ea31dab service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:14.903002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111ff24-c93d-40e0-bb72-f4ce7383a58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:14.903715 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111ff24-c93d-40e0-bb72-f4ce7383a58d admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:14.904264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111ff24-c93d-40e0-bb72-f4ce7383a58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:14.905060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111ff24-c93d-40e0-bb72-f4ce7383a58d admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:14.905929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111ff24-c93d-40e0-bb72-f4ce7383a58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:14.908100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111ff24-c93d-40e0-bb72-f4ce7383a58d admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:14.923145 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1029/2038] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:14.925761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1010/2039] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:37:14.940331 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e0b0a-c57b-4cc1-b654-9b276ea31dab service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:14.953043 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e0b0a-c57b-4cc1-b654-9b276ea31dab service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:14.960074 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f08f89-7247-4947-b07b-88e2d552c797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:14.960963 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f08f89-7247-4947-b07b-88e2d552c797 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:14.961237 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f08f89-7247-4947-b07b-88e2d552c797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:14.961516 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f08f89-7247-4947-b07b-88e2d552c797 admin admin] PATH_INFO: `/v3/projects/6770f77843ad4899bd1c0e0cc6aa6f69/users/1da94fcdcc20486dbe438acdfaebf5d5/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:14.987771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f08f89-7247-4947-b07b-88e2d552c797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6770f77843ad4899bd1c0e0cc6aa6f69, user_id=1da94fcdcc20486dbe438acdfaebf5d5, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:14.991802 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f08f89-7247-4947-b07b-88e2d552c797 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:15.020257 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1030/2040] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:14 2022] PUT /identity/v3/projects/6770f77843ad4899bd1c0e0cc6aa6f69/users/1da94fcdcc20486dbe438acdfaebf5d5/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:15.033623 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb09fc-b054-4afc-a7a4-7694540e1a5e None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:15.035571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb09fc-b054-4afc-a7a4-7694540e1a5e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:15.035876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb09fc-b054-4afc-a7a4-7694540e1a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:15.080781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-5ceb09fc-b054-4afc-a7a4-7694540e1a5e None None] MFA Rules not processed for user `1da94fcdcc20486dbe438acdfaebf5d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:15.082787 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5ceb09fc-b054-4afc-a7a4-7694540e1a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:15.196000 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f08f89-7247-4947-b07b-88e2d552c797 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:15.200256 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b0f08f89-7247-4947-b07b-88e2d552c797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:15.239402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1011/2041] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:15.244105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb09fc-b054-4afc-a7a4-7694540e1a5e None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:15.310376 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f08f89-7247-4947-b07b-88e2d552c797 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:15.319284 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a9c43-e3a2-4db7-b9d1-04277cd58804 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f557206929142c3b2da56329bd6817f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a32ec0848d24147be836317db4bca5b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:15.320252 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a9c43-e3a2-4db7-b9d1-04277cd58804 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:15.320576 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a9c43-e3a2-4db7-b9d1-04277cd58804 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:15.321094 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a9c43-e3a2-4db7-b9d1-04277cd58804 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:15.322924 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a9c43-e3a2-4db7-b9d1-04277cd58804 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:37:15.323282 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a9c43-e3a2-4db7-b9d1-04277cd58804 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:15.325259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a9c43-e3a2-4db7-b9d1-04277cd58804 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:15.340722 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:15.347993 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb09fc-b054-4afc-a7a4-7694540e1a5e None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:15.355302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824db039-a421-4313-8e2c-2827a67c6062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:15.356024 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824db039-a421-4313-8e2c-2827a67c6062 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:15.356329 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824db039-a421-4313-8e2c-2827a67c6062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:15.357133 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824db039-a421-4313-8e2c-2827a67c6062 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:15.359432 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824db039-a421-4313-8e2c-2827a67c6062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:15.361586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1031/2042] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:37:15.362783 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824db039-a421-4313-8e2c-2827a67c6062 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:15.363078 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a9c43-e3a2-4db7-b9d1-04277cd58804 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:15.372276 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:15.401215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a9c43-e3a2-4db7-b9d1-04277cd58804 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:15.423084 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a4d4f-c975-425b-a536-eb203e5affc3 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f557206929142c3b2da56329bd6817f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a32ec0848d24147be836317db4bca5b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:15.423903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a4d4f-c975-425b-a536-eb203e5affc3 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:15.424077 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a4d4f-c975-425b-a536-eb203e5affc3 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:15.424592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a4d4f-c975-425b-a536-eb203e5affc3 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:15.425241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a4d4f-c975-425b-a536-eb203e5affc3 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:15.427329 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a4d4f-c975-425b-a536-eb203e5affc3 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:15.430231 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1012/2043] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:15 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:37:15.431957 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824db039-a421-4313-8e2c-2827a67c6062 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:15.434315 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-824db039-a421-4313-8e2c-2827a67c6062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:15.472019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1032/2044] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:15 2022] POST /identity/v3/projects => generated 353 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:15.472915 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a4d4f-c975-425b-a536-eb203e5affc3 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:15.517280 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824db039-a421-4313-8e2c-2827a67c6062 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:15.560314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a4d4f-c975-425b-a536-eb203e5affc3 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:15.565392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252916e-5cfe-4608-ba1e-37e2843aa06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:15.566076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252916e-5cfe-4608-ba1e-37e2843aa06a admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:15.566363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252916e-5cfe-4608-ba1e-37e2843aa06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:15.566643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252916e-5cfe-4608-ba1e-37e2843aa06a admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:15.567334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252916e-5cfe-4608-ba1e-37e2843aa06a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:15.569697 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252916e-5cfe-4608-ba1e-37e2843aa06a admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:15.578580 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c90a5-b59b-44e8-be64-1b94a3090bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:15.579262 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c90a5-b59b-44e8-be64-1b94a3090bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:15.579582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c90a5-b59b-44e8-be64-1b94a3090bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:15.579861 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c90a5-b59b-44e8-be64-1b94a3090bcf admin admin] PATH_INFO: `/v3/projects/f663fc34118b4e558043dee5be5e7676` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:15.581003 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c90a5-b59b-44e8-be64-1b94a3090bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f663fc34118b4e558043dee5be5e7676)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:15.583182 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c90a5-b59b-44e8-be64-1b94a3090bcf admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:15.596192 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1033/2045] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:15 2022] POST /identity/v3/users => generated 297 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:15.599976 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252916e-5cfe-4608-ba1e-37e2843aa06a admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:15.647651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-1e3c90a5-b59b-44e8-be64-1b94a3090bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f663fc34118b4e558043dee5be5e7676', 'request_id': 'req-1e3c90a5-b59b-44e8-be64-1b94a3090bcf'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:15.655310 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-1e3c90a5-b59b-44e8-be64-1b94a3090bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f663fc34118b4e558043dee5be5e7676', 'request_id': 'req-1e3c90a5-b59b-44e8-be64-1b94a3090bcf'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:15.662351 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-1e3c90a5-b59b-44e8-be64-1b94a3090bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f663fc34118b4e558043dee5be5e7676', 'request_id': 'req-1e3c90a5-b59b-44e8-be64-1b94a3090bcf'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:15.674699 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252916e-5cfe-4608-ba1e-37e2843aa06a admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:15.680397 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-1e3c90a5-b59b-44e8-be64-1b94a3090bcf admin admin] The token cache is being invalidate because project f663fc34118b4e558043dee5be5e7676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:15.680765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-1e3c90a5-b59b-44e8-be64-1b94a3090bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:15.681602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-1e3c90a5-b59b-44e8-be64-1b94a3090bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:15.687651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1013/2046] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:15 2022] DELETE /identity/v3/projects/f663fc34118b4e558043dee5be5e7676 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:15.687651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c90a5-b59b-44e8-be64-1b94a3090bcf admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:15.688968 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1e3c90a5-b59b-44e8-be64-1b94a3090bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:15.717762 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:15.752335 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae791ac2-2a22-4095-a9cf-f9a4c67e6940 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f557206929142c3b2da56329bd6817f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a32ec0848d24147be836317db4bca5b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:15.766926 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae791ac2-2a22-4095-a9cf-f9a4c67e6940 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:15.766926 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae791ac2-2a22-4095-a9cf-f9a4c67e6940 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:15.766926 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae791ac2-2a22-4095-a9cf-f9a4c67e6940 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:15.766926 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae791ac2-2a22-4095-a9cf-f9a4c67e6940 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:37:15.766926 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae791ac2-2a22-4095-a9cf-f9a4c67e6940 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:15.767423 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae791ac2-2a22-4095-a9cf-f9a4c67e6940 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:15.774402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1034/2047] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:37:15.775618 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae791ac2-2a22-4095-a9cf-f9a4c67e6940 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:15.778199 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-ae791ac2-2a22-4095-a9cf-f9a4c67e6940 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:15.782713 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c90a5-b59b-44e8-be64-1b94a3090bcf admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:15.787475 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b2afc-3466-4e9d-a989-5afa3d5b011d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:15.788163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b2afc-3466-4e9d-a989-5afa3d5b011d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:15.788494 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b2afc-3466-4e9d-a989-5afa3d5b011d admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:15.788767 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b2afc-3466-4e9d-a989-5afa3d5b011d admin admin] PATH_INFO: `/v3/projects/177f34b8a42f4e9cb4a18e4ff00669d2` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:15.789916 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b2afc-3466-4e9d-a989-5afa3d5b011d admin admin] RBAC: Authorizing `identity:delete_project(project_id=177f34b8a42f4e9cb4a18e4ff00669d2)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:15.792051 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b2afc-3466-4e9d-a989-5afa3d5b011d admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:15.797377 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae791ac2-2a22-4095-a9cf-f9a4c67e6940 tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:15.803461 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9443c9a-9d49-45b4-abe1-f03a6c24b52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:15.804441 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9443c9a-9d49-45b4-abe1-f03a6c24b52a admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:15.804760 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9443c9a-9d49-45b4-abe1-f03a6c24b52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:15.805042 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9443c9a-9d49-45b4-abe1-f03a6c24b52a admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:15.805689 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9443c9a-9d49-45b4-abe1-f03a6c24b52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:15.807354 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9443c9a-9d49-45b4-abe1-f03a6c24b52a admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:15.810327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:15.822284 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1035/2048] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:15.824239 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b400420-df65-4156-b0a4-0ee8b17efdbb None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:15.824524 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b400420-df65-4156-b0a4-0ee8b17efdbb None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:15.824797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b400420-df65-4156-b0a4-0ee8b17efdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:15.847974 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-4b400420-df65-4156-b0a4-0ee8b17efdbb None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:15.849301 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4b400420-df65-4156-b0a4-0ee8b17efdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:15.851095 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-538b2afc-3466-4e9d-a989-5afa3d5b011d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177f34b8a42f4e9cb4a18e4ff00669d2', 'request_id': 'req-538b2afc-3466-4e9d-a989-5afa3d5b011d'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:15.857208 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-538b2afc-3466-4e9d-a989-5afa3d5b011d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177f34b8a42f4e9cb4a18e4ff00669d2', 'request_id': 'req-538b2afc-3466-4e9d-a989-5afa3d5b011d'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:15.864036 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-538b2afc-3466-4e9d-a989-5afa3d5b011d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177f34b8a42f4e9cb4a18e4ff00669d2', 'request_id': 'req-538b2afc-3466-4e9d-a989-5afa3d5b011d'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:15.877581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-538b2afc-3466-4e9d-a989-5afa3d5b011d admin admin] The token cache is being invalidate because project 177f34b8a42f4e9cb4a18e4ff00669d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:15.877869 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-538b2afc-3466-4e9d-a989-5afa3d5b011d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:15.878502 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-538b2afc-3466-4e9d-a989-5afa3d5b011d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:15.880012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1014/2049] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:15 2022] DELETE /identity/v3/projects/177f34b8a42f4e9cb4a18e4ff00669d2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:15.880764 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b2afc-3466-4e9d-a989-5afa3d5b011d admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:15.882888 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-538b2afc-3466-4e9d-a989-5afa3d5b011d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:15.914882 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1036/2050] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:15.915631 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b400420-df65-4156-b0a4-0ee8b17efdbb None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:15.916957 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4b400420-df65-4156-b0a4-0ee8b17efdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:15.929305 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b400420-df65-4156-b0a4-0ee8b17efdbb None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:15.934055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054b273-0bfe-482c-a648-de3cadf5db64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:15.934725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054b273-0bfe-482c-a648-de3cadf5db64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:15.935031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054b273-0bfe-482c-a648-de3cadf5db64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:15.935464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054b273-0bfe-482c-a648-de3cadf5db64 admin admin] PATH_INFO: `/v3/projects/d2693a2e4c284f2ab783de085cbe7c6e/users/e2e1bc5af2de43dfb8c92af8939a29b4/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:15.950704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054b273-0bfe-482c-a648-de3cadf5db64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2693a2e4c284f2ab783de085cbe7c6e, user_id=e2e1bc5af2de43dfb8c92af8939a29b4, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:15.953477 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054b273-0bfe-482c-a648-de3cadf5db64 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:15.955161 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b2afc-3466-4e9d-a989-5afa3d5b011d admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:15.960763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d4364-472f-4ecc-8b1e-a05faaad809a tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f557206929142c3b2da56329bd6817f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a32ec0848d24147be836317db4bca5b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:15.961398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d4364-472f-4ecc-8b1e-a05faaad809a tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:15.961682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d4364-472f-4ecc-8b1e-a05faaad809a tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:15.961955 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d4364-472f-4ecc-8b1e-a05faaad809a tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] PATH_INFO: `/v3/projects/69134e210b2a40f797d6a6b70cf3a33f` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:15.963088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d4364-472f-4ecc-8b1e-a05faaad809a tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] RBAC: Authorizing `identity:delete_project(project_id=69134e210b2a40f797d6a6b70cf3a33f)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:15.964973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d4364-472f-4ecc-8b1e-a05faaad809a tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:15.967675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1037/2051] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:15 2022] PUT /identity/v3/projects/d2693a2e4c284f2ab783de085cbe7c6e/users/e2e1bc5af2de43dfb8c92af8939a29b4/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:15.971467 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054b273-0bfe-482c-a648-de3cadf5db64 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:15.973042 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-7054b273-0bfe-482c-a648-de3cadf5db64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:16.014738 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-828d4364-472f-4ecc-8b1e-a05faaad809a tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69134e210b2a40f797d6a6b70cf3a33f', 'request_id': 'req-828d4364-472f-4ecc-8b1e-a05faaad809a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.019732 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:16.022277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-828d4364-472f-4ecc-8b1e-a05faaad809a tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69134e210b2a40f797d6a6b70cf3a33f', 'request_id': 'req-828d4364-472f-4ecc-8b1e-a05faaad809a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.030758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-828d4364-472f-4ecc-8b1e-a05faaad809a tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69134e210b2a40f797d6a6b70cf3a33f', 'request_id': 'req-828d4364-472f-4ecc-8b1e-a05faaad809a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.040028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054b273-0bfe-482c-a648-de3cadf5db64 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:16.043848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-828d4364-472f-4ecc-8b1e-a05faaad809a tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] The token cache is being invalidate because project 69134e210b2a40f797d6a6b70cf3a33f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:16.044115 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-828d4364-472f-4ecc-8b1e-a05faaad809a tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.044760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-828d4364-472f-4ecc-8b1e-a05faaad809a tempest-VolumeQuotaClassesTest-623613332 tempest-VolumeQuotaClassesTest-623613332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.046267 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1015/2052] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:15 2022] DELETE /identity/v3/projects/69134e210b2a40f797d6a6b70cf3a33f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:16.047506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29c50a-f030-4a61-9139-e98eaedc86a5 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:16.047787 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29c50a-f030-4a61-9139-e98eaedc86a5 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:16.048060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29c50a-f030-4a61-9139-e98eaedc86a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:16.078474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-4e29c50a-f030-4a61-9139-e98eaedc86a5 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:16.079901 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4e29c50a-f030-4a61-9139-e98eaedc86a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:16.112242 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a8897-0a62-43e0-bee1-2679cff3aa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:16.112858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a8897-0a62-43e0-bee1-2679cff3aa78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:16.113307 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a8897-0a62-43e0-bee1-2679cff3aa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:16.113581 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a8897-0a62-43e0-bee1-2679cff3aa78 admin admin] PATH_INFO: `/v3/users/f918860d6ce647a8842465614bff203c` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:16.115211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a8897-0a62-43e0-bee1-2679cff3aa78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f918860d6ce647a8842465614bff203c)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:16.118045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a8897-0a62-43e0-bee1-2679cff3aa78 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:16.144994 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:16.153035 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1016/2053] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:16.157276 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29c50a-f030-4a61-9139-e98eaedc86a5 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:16.159103 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4e29c50a-f030-4a61-9139-e98eaedc86a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:16.174018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29c50a-f030-4a61-9139-e98eaedc86a5 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:16.179951 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d1e73-7866-4098-b2f1-f07e506b8e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:16.180679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1e73-7866-4098-b2f1-f07e506b8e69 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:16.180850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1e73-7866-4098-b2f1-f07e506b8e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:16.181125 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1e73-7866-4098-b2f1-f07e506b8e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:16.181842 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d1e73-7866-4098-b2f1-f07e506b8e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:16.182108 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-7b4a8897-0a62-43e0-bee1-2679cff3aa78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f918860d6ce647a8842465614bff203c'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.183004 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-7b4a8897-0a62-43e0-bee1-2679cff3aa78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f918860d6ce647a8842465614bff203c'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.183918 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-7b4a8897-0a62-43e0-bee1-2679cff3aa78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f918860d6ce647a8842465614bff203c'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.188320 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d1e73-7866-4098-b2f1-f07e506b8e69 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:16.210031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-7b4a8897-0a62-43e0-bee1-2679cff3aa78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f918860d6ce647a8842465614bff203c'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.210420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1017/2054] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:16.211908 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d1e73-7866-4098-b2f1-f07e506b8e69 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:16.214602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-565d1e73-7866-4098-b2f1-f07e506b8e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:16.222980 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-7b4a8897-0a62-43e0-bee1-2679cff3aa78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f918860d6ce647a8842465614bff203c'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.236629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d1e73-7866-4098-b2f1-f07e506b8e69 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:16.242035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1038/2055] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:15 2022] DELETE /identity/v3/users/f918860d6ce647a8842465614bff203c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:16.243171 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a8897-0a62-43e0-bee1-2679cff3aa78 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:16.244649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-7b4a8897-0a62-43e0-bee1-2679cff3aa78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:16.248567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39819eb4-7858-4fb6-9e46-095ca3857a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:16.249450 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39819eb4-7858-4fb6-9e46-095ca3857a59 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:16.249736 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39819eb4-7858-4fb6-9e46-095ca3857a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:16.250007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39819eb4-7858-4fb6-9e46-095ca3857a59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:16.250793 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39819eb4-7858-4fb6-9e46-095ca3857a59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:37:16.251721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39819eb4-7858-4fb6-9e46-095ca3857a59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:16.253132 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39819eb4-7858-4fb6-9e46-095ca3857a59 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:16.277864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1018/2056] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:37:16.280448 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39819eb4-7858-4fb6-9e46-095ca3857a59 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:16.301223 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39819eb4-7858-4fb6-9e46-095ca3857a59 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:16.357450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a8897-0a62-43e0-bee1-2679cff3aa78 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:16.368027 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8756f-d025-4606-8be1-5efe73fca2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:16.369175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8756f-d025-4606-8be1-5efe73fca2bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:16.369468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8756f-d025-4606-8be1-5efe73fca2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:16.369754 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8756f-d025-4606-8be1-5efe73fca2bf admin admin] PATH_INFO: `/v3/projects/d2693a2e4c284f2ab783de085cbe7c6e/users/e2e1bc5af2de43dfb8c92af8939a29b4/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:16.372164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8756f-d025-4606-8be1-5efe73fca2bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2693a2e4c284f2ab783de085cbe7c6e, user_id=e2e1bc5af2de43dfb8c92af8939a29b4, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:16.375188 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8756f-d025-4606-8be1-5efe73fca2bf admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:16.389526 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1039/2057] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:16 2022] PUT /identity/v3/projects/d2693a2e4c284f2ab783de085cbe7c6e/users/e2e1bc5af2de43dfb8c92af8939a29b4/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:16.390328 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8756f-d025-4606-8be1-5efe73fca2bf admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:16.397061 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdf7b4-ba99-4da0-8525-282bde776a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:16.400548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdf7b4-ba99-4da0-8525-282bde776a99 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:16.401326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-7ee8756f-d025-4606-8be1-5efe73fca2bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:16.402116 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdf7b4-ba99-4da0-8525-282bde776a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:16.402767 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdf7b4-ba99-4da0-8525-282bde776a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:16.404668 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdf7b4-ba99-4da0-8525-282bde776a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:16.407077 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdf7b4-ba99-4da0-8525-282bde776a99 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:16.444964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1019/2058] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:16 2022] POST /identity/v3/projects => generated 363 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:37:16.446278 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2b471-c991-4619-a0a2-b9b8efbbf27a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:16.446553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2b471-c991-4619-a0a2-b9b8efbbf27a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:16.446870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2b471-c991-4619-a0a2-b9b8efbbf27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:16.492184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-e3b2b471-c991-4619-a0a2-b9b8efbbf27a None None] MFA Rules not processed for user `e2e1bc5af2de43dfb8c92af8939a29b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:16.493707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e3b2b471-c991-4619-a0a2-b9b8efbbf27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:16.508575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8756f-d025-4606-8be1-5efe73fca2bf admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:16.540469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:16.557361 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:16.580971 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3424b9b-99dc-4599-9f78-199cf8bb5e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:16.582019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3424b9b-99dc-4599-9f78-199cf8bb5e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:16.582131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3424b9b-99dc-4599-9f78-199cf8bb5e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:16.582446 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3424b9b-99dc-4599-9f78-199cf8bb5e06 admin admin] PATH_INFO: `/v3/users/743a2a0883ba4c60b3af827f995ab70a` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:16.583731 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3424b9b-99dc-4599-9f78-199cf8bb5e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=743a2a0883ba4c60b3af827f995ab70a)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:16.586644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3424b9b-99dc-4599-9f78-199cf8bb5e06 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:16.621637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1020/2059] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:16.624906 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2b471-c991-4619-a0a2-b9b8efbbf27a None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:16.644522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2b471-c991-4619-a0a2-b9b8efbbf27a None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:16.661305 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e36cc-70d0-4a2b-b153-bbbe3ee6310a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:16.661952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e36cc-70d0-4a2b-b153-bbbe3ee6310a admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:16.662291 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e36cc-70d0-4a2b-b153-bbbe3ee6310a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:16.662561 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e36cc-70d0-4a2b-b153-bbbe3ee6310a admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:16.663344 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e36cc-70d0-4a2b-b153-bbbe3ee6310a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:16.663625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f3424b9b-99dc-4599-9f78-199cf8bb5e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '743a2a0883ba4c60b3af827f995ab70a'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.664496 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f3424b9b-99dc-4599-9f78-199cf8bb5e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '743a2a0883ba4c60b3af827f995ab70a'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.665436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e36cc-70d0-4a2b-b153-bbbe3ee6310a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:16.665888 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f3424b9b-99dc-4599-9f78-199cf8bb5e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '743a2a0883ba4c60b3af827f995ab70a'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.691914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f3424b9b-99dc-4599-9f78-199cf8bb5e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '743a2a0883ba4c60b3af827f995ab70a'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.698947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1021/2060] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:16 2022] POST /identity/v3/users => generated 282 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:16.698947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e36cc-70d0-4a2b-b153-bbbe3ee6310a admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:16.700483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-943e36cc-70d0-4a2b-b153-bbbe3ee6310a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:16.700794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f3424b9b-99dc-4599-9f78-199cf8bb5e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '743a2a0883ba4c60b3af827f995ab70a'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.716889 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1040/2061] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:16 2022] DELETE /identity/v3/users/743a2a0883ba4c60b3af827f995ab70a => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:16.719725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3424b9b-99dc-4599-9f78-199cf8bb5e06 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:16.721238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f3424b9b-99dc-4599-9f78-199cf8bb5e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:16.775180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e36cc-70d0-4a2b-b153-bbbe3ee6310a admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:16.789457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3424b9b-99dc-4599-9f78-199cf8bb5e06 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:16.795090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f86e1-aa7a-4182-a32c-bb75ac1cd80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:16.795717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f86e1-aa7a-4182-a32c-bb75ac1cd80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:16.796383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f86e1-aa7a-4182-a32c-bb75ac1cd80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:16.796672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f86e1-aa7a-4182-a32c-bb75ac1cd80b admin admin] PATH_INFO: `/v3/projects/ccdcfd89db11419784d27bad26f04a80` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:16.798132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f86e1-aa7a-4182-a32c-bb75ac1cd80b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccdcfd89db11419784d27bad26f04a80)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:16.800105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f86e1-aa7a-4182-a32c-bb75ac1cd80b admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:16.838553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4ac69-c199-41f2-9148-16f72c89cc8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:16.839476 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4ac69-c199-41f2-9148-16f72c89cc8c service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:16.839852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4ac69-c199-41f2-9148-16f72c89cc8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:16.840236 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4ac69-c199-41f2-9148-16f72c89cc8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:16.842926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a8e4ac69-c199-41f2-9148-16f72c89cc8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:16.859291 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-929f86e1-aa7a-4182-a32c-bb75ac1cd80b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccdcfd89db11419784d27bad26f04a80', 'request_id': 'req-929f86e1-aa7a-4182-a32c-bb75ac1cd80b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.875192 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-929f86e1-aa7a-4182-a32c-bb75ac1cd80b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccdcfd89db11419784d27bad26f04a80', 'request_id': 'req-929f86e1-aa7a-4182-a32c-bb75ac1cd80b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.892259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-929f86e1-aa7a-4182-a32c-bb75ac1cd80b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccdcfd89db11419784d27bad26f04a80', 'request_id': 'req-929f86e1-aa7a-4182-a32c-bb75ac1cd80b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.895264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:16.917219 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-929f86e1-aa7a-4182-a32c-bb75ac1cd80b admin admin] The token cache is being invalidate because project ccdcfd89db11419784d27bad26f04a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:16.918551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-929f86e1-aa7a-4182-a32c-bb75ac1cd80b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.919588 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-929f86e1-aa7a-4182-a32c-bb75ac1cd80b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:16.925363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1041/2062] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:16 2022] DELETE /identity/v3/projects/ccdcfd89db11419784d27bad26f04a80 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:16.926642 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f86e1-aa7a-4182-a32c-bb75ac1cd80b admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:16.927192 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4ac69-c199-41f2-9148-16f72c89cc8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:16.929012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4ac69-c199-41f2-9148-16f72c89cc8c service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:16.932522 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-929f86e1-aa7a-4182-a32c-bb75ac1cd80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:16.941811 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1022/2063] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:16.944138 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f339df9-fc04-42ff-845f-b4d37a5a759e None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:16.944664 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f339df9-fc04-42ff-845f-b4d37a5a759e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:16.945180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f339df9-fc04-42ff-845f-b4d37a5a759e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:16.985150 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-6f339df9-fc04-42ff-845f-b4d37a5a759e None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:16.986337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6f339df9-fc04-42ff-845f-b4d37a5a759e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:17.038156 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:17.090792 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f86e1-aa7a-4182-a32c-bb75ac1cd80b admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:17.107845 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa83eb-958f-4b7d-ab22-ac08f998d01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:17.108106 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa83eb-958f-4b7d-ab22-ac08f998d01a admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:17.108203 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa83eb-958f-4b7d-ab22-ac08f998d01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:17.108476 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa83eb-958f-4b7d-ab22-ac08f998d01a admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:17.109279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa83eb-958f-4b7d-ab22-ac08f998d01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:17.111415 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa83eb-958f-4b7d-ab22-ac08f998d01a admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:17.142513 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1023/2064] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:17.143515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f339df9-fc04-42ff-845f-b4d37a5a759e None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:17.145001 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6f339df9-fc04-42ff-845f-b4d37a5a759e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:17.152333 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1042/2065] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:17.153296 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa83eb-958f-4b7d-ab22-ac08f998d01a admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:17.161514 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f339df9-fc04-42ff-845f-b4d37a5a759e None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:17.168694 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf06eb-59bb-427c-9c15-dcd96c3a5187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:17.169557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf06eb-59bb-427c-9c15-dcd96c3a5187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:17.169916 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf06eb-59bb-427c-9c15-dcd96c3a5187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:17.170257 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf06eb-59bb-427c-9c15-dcd96c3a5187 admin admin] PATH_INFO: `/v3/users/c04673fe93224ac3ab35e0de5b2d777f` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:17.172909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf06eb-59bb-427c-9c15-dcd96c3a5187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c04673fe93224ac3ab35e0de5b2d777f)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:17.175538 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf06eb-59bb-427c-9c15-dcd96c3a5187 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:17.194657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa83eb-958f-4b7d-ab22-ac08f998d01a admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:17.214511 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d7029-cf96-48c4-aa16-9a9890d4788d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:17.215339 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d7029-cf96-48c4-aa16-9a9890d4788d admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:17.215767 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d7029-cf96-48c4-aa16-9a9890d4788d admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:17.216212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d7029-cf96-48c4-aa16-9a9890d4788d admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:17.217048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d7029-cf96-48c4-aa16-9a9890d4788d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:17.218819 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d7029-cf96-48c4-aa16-9a9890d4788d admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:17.242477 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1043/2066] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:17.250486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d7029-cf96-48c4-aa16-9a9890d4788d admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:17.255695 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-508d7029-cf96-48c4-aa16-9a9890d4788d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:17.304042 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-80cf06eb-59bb-427c-9c15-dcd96c3a5187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c04673fe93224ac3ab35e0de5b2d777f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:17.305511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-80cf06eb-59bb-427c-9c15-dcd96c3a5187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c04673fe93224ac3ab35e0de5b2d777f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:17.309105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-80cf06eb-59bb-427c-9c15-dcd96c3a5187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c04673fe93224ac3ab35e0de5b2d777f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:17.330385 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-80cf06eb-59bb-427c-9c15-dcd96c3a5187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c04673fe93224ac3ab35e0de5b2d777f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:17.346529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-80cf06eb-59bb-427c-9c15-dcd96c3a5187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c04673fe93224ac3ab35e0de5b2d777f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:17.362532 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d7029-cf96-48c4-aa16-9a9890d4788d admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:17.367735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de70828-fa0b-4619-b25e-b3cb9d034376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:17.368563 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de70828-fa0b-4619-b25e-b3cb9d034376 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:17.368912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de70828-fa0b-4619-b25e-b3cb9d034376 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:17.369264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de70828-fa0b-4619-b25e-b3cb9d034376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:17.372812 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1024/2067] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:17 2022] DELETE /identity/v3/users/c04673fe93224ac3ab35e0de5b2d777f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:17.373834 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf06eb-59bb-427c-9c15-dcd96c3a5187 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:17.375421 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-80cf06eb-59bb-427c-9c15-dcd96c3a5187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:17.380975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4de70828-fa0b-4619-b25e-b3cb9d034376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:17.403093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de70828-fa0b-4619-b25e-b3cb9d034376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:17.407580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de70828-fa0b-4619-b25e-b3cb9d034376 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:17.419787 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1044/2068] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:17.487602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf06eb-59bb-427c-9c15-dcd96c3a5187 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:17.497461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7b137-33cc-4a50-b31a-898bd0f52bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:17.498289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7b137-33cc-4a50-b31a-898bd0f52bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:17.499052 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7b137-33cc-4a50-b31a-898bd0f52bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:17.499338 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7b137-33cc-4a50-b31a-898bd0f52bbb admin admin] PATH_INFO: `/v3/projects/d95b60b8694f408b876f39d7efaaca54/users/e95e3c5e21c441aea07cccfdfc3bbb1b/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:17.538196 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7b137-33cc-4a50-b31a-898bd0f52bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95b60b8694f408b876f39d7efaaca54, user_id=e95e3c5e21c441aea07cccfdfc3bbb1b, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:17.542591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7b137-33cc-4a50-b31a-898bd0f52bbb admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:17.574541 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1025/2069] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:17 2022] PUT /identity/v3/projects/d95b60b8694f408b876f39d7efaaca54/users/e95e3c5e21c441aea07cccfdfc3bbb1b/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:17.586978 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef9052-ab54-40f2-aec8-1148393879d7 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:17.588032 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef9052-ab54-40f2-aec8-1148393879d7 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:17.588541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef9052-ab54-40f2-aec8-1148393879d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:17.620606 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-36ef9052-ab54-40f2-aec8-1148393879d7 None None] MFA Rules not processed for user `e95e3c5e21c441aea07cccfdfc3bbb1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:17.621945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-36ef9052-ab54-40f2-aec8-1148393879d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:17.658077 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7b137-33cc-4a50-b31a-898bd0f52bbb admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:17.659984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-9fe7b137-33cc-4a50-b31a-898bd0f52bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:17.685032 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:17.751835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1045/2070] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:17.763984 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef9052-ab54-40f2-aec8-1148393879d7 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:17.765374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-36ef9052-ab54-40f2-aec8-1148393879d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:17.775123 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7b137-33cc-4a50-b31a-898bd0f52bbb admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:17.780753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:17.781006 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ed0fa-6c77-4049-90f7-78b3688dbbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:17.783526 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ed0fa-6c77-4049-90f7-78b3688dbbc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:17.784002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ed0fa-6c77-4049-90f7-78b3688dbbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:17.784504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ed0fa-6c77-4049-90f7-78b3688dbbc0 admin admin] PATH_INFO: `/v3/users/1da94fcdcc20486dbe438acdfaebf5d5` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:17.799234 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ed0fa-6c77-4049-90f7-78b3688dbbc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da94fcdcc20486dbe438acdfaebf5d5)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:17.803643 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ed0fa-6c77-4049-90f7-78b3688dbbc0 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:17.876041 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef9052-ab54-40f2-aec8-1148393879d7 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:17.884762 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e77fd3-d65f-4e83-9782-ade9791e19cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:17.886298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e77fd3-d65f-4e83-9782-ade9791e19cc service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:17.887453 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e77fd3-d65f-4e83-9782-ade9791e19cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:17.887981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e77fd3-d65f-4e83-9782-ade9791e19cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:17.909386 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-646ed0fa-6c77-4049-90f7-78b3688dbbc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da94fcdcc20486dbe438acdfaebf5d5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:17.910965 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-646ed0fa-6c77-4049-90f7-78b3688dbbc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da94fcdcc20486dbe438acdfaebf5d5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:17.912056 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-646ed0fa-6c77-4049-90f7-78b3688dbbc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da94fcdcc20486dbe438acdfaebf5d5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:17.913940 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e77fd3-d65f-4e83-9782-ade9791e19cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:17.915803 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e77fd3-d65f-4e83-9782-ade9791e19cc service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:17.925778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-646ed0fa-6c77-4049-90f7-78b3688dbbc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da94fcdcc20486dbe438acdfaebf5d5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:17.930899 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1046/2071] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:37:17.939424 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-646ed0fa-6c77-4049-90f7-78b3688dbbc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da94fcdcc20486dbe438acdfaebf5d5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:17.963176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1026/2072] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:17 2022] DELETE /identity/v3/users/1da94fcdcc20486dbe438acdfaebf5d5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:37:17.968037 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bab617-944d-4f46-a888-11aa6db47798 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:17.968394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bab617-944d-4f46-a888-11aa6db47798 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:17.968778 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bab617-944d-4f46-a888-11aa6db47798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:18.002614 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-52bab617-944d-4f46-a888-11aa6db47798 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:18.006719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-52bab617-944d-4f46-a888-11aa6db47798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:18.007569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ed0fa-6c77-4049-90f7-78b3688dbbc0 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:18.009613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-646ed0fa-6c77-4049-90f7-78b3688dbbc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:18.096449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1047/2073] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:18.097425 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bab617-944d-4f46-a888-11aa6db47798 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:18.099383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-52bab617-944d-4f46-a888-11aa6db47798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:18.110875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ed0fa-6c77-4049-90f7-78b3688dbbc0 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:18.117103 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98a04a-3ce8-476a-9dc9-0130d51252f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:18.117882 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98a04a-3ce8-476a-9dc9-0130d51252f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:18.118167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98a04a-3ce8-476a-9dc9-0130d51252f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:18.118596 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98a04a-3ce8-476a-9dc9-0130d51252f9 admin admin] PATH_INFO: `/v3/projects/fa46dbd5bc944170a3affbf094c63e94` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:18.120042 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98a04a-3ce8-476a-9dc9-0130d51252f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa46dbd5bc944170a3affbf094c63e94)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:18.122124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98a04a-3ce8-476a-9dc9-0130d51252f9 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:18.127803 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bab617-944d-4f46-a888-11aa6db47798 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:18.135111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb254a-d02c-40cc-8646-d44a959ba5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:18.135757 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb254a-d02c-40cc-8646-d44a959ba5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:18.136040 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb254a-d02c-40cc-8646-d44a959ba5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:18.136321 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb254a-d02c-40cc-8646-d44a959ba5d8 admin admin] PATH_INFO: `/v3/projects/85220da3b96e4c6e8c8166c46bfc5d8d` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:18.139011 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb254a-d02c-40cc-8646-d44a959ba5d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85220da3b96e4c6e8c8166c46bfc5d8d)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:18.141090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb254a-d02c-40cc-8646-d44a959ba5d8 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:18.176899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:18.194247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7e98a04a-3ce8-476a-9dc9-0130d51252f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa46dbd5bc944170a3affbf094c63e94', 'request_id': 'req-7e98a04a-3ce8-476a-9dc9-0130d51252f9'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:18.202244 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7e98a04a-3ce8-476a-9dc9-0130d51252f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa46dbd5bc944170a3affbf094c63e94', 'request_id': 'req-7e98a04a-3ce8-476a-9dc9-0130d51252f9'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:18.210077 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7e98a04a-3ce8-476a-9dc9-0130d51252f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa46dbd5bc944170a3affbf094c63e94', 'request_id': 'req-7e98a04a-3ce8-476a-9dc9-0130d51252f9'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:18.217022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-7ccb254a-d02c-40cc-8646-d44a959ba5d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85220da3b96e4c6e8c8166c46bfc5d8d', 'request_id': 'req-7ccb254a-d02c-40cc-8646-d44a959ba5d8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:18.225145 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-7ccb254a-d02c-40cc-8646-d44a959ba5d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85220da3b96e4c6e8c8166c46bfc5d8d', 'request_id': 'req-7ccb254a-d02c-40cc-8646-d44a959ba5d8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:18.232182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-7ccb254a-d02c-40cc-8646-d44a959ba5d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85220da3b96e4c6e8c8166c46bfc5d8d', 'request_id': 'req-7ccb254a-d02c-40cc-8646-d44a959ba5d8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:18.233185 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7e98a04a-3ce8-476a-9dc9-0130d51252f9 admin admin] The token cache is being invalidate because project fa46dbd5bc944170a3affbf094c63e94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:18.233478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7e98a04a-3ce8-476a-9dc9-0130d51252f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:18.234289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7e98a04a-3ce8-476a-9dc9-0130d51252f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:18.236499 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1027/2074] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:18 2022] DELETE /identity/v3/projects/fa46dbd5bc944170a3affbf094c63e94 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:37:18.240085 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98a04a-3ce8-476a-9dc9-0130d51252f9 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:18.241316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7e98a04a-3ce8-476a-9dc9-0130d51252f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:18.252214 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-7ccb254a-d02c-40cc-8646-d44a959ba5d8 admin admin] The token cache is being invalidate because project 85220da3b96e4c6e8c8166c46bfc5d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:18.252750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-7ccb254a-d02c-40cc-8646-d44a959ba5d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:18.253847 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-7ccb254a-d02c-40cc-8646-d44a959ba5d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:18.256561 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1048/2075] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:18 2022] DELETE /identity/v3/projects/85220da3b96e4c6e8c8166c46bfc5d8d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:18.258696 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb254a-d02c-40cc-8646-d44a959ba5d8 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:18.264978 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-7ccb254a-d02c-40cc-8646-d44a959ba5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:18.322801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98a04a-3ce8-476a-9dc9-0130d51252f9 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:18.362881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:18.419348 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb254a-d02c-40cc-8646-d44a959ba5d8 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:18.425990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fe126-a6e7-4ec2-9b68-aac6dd619eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:18.427004 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fe126-a6e7-4ec2-9b68-aac6dd619eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:18.427557 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fe126-a6e7-4ec2-9b68-aac6dd619eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:18.428341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fe126-a6e7-4ec2-9b68-aac6dd619eed admin admin] PATH_INFO: `/v3/users/3f557206929142c3b2da56329bd6817f` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:18.429772 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365925ad-f2db-4080-b5f5-ca4a0c416d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:18.430472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365925ad-f2db-4080-b5f5-ca4a0c416d48 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:18.430670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365925ad-f2db-4080-b5f5-ca4a0c416d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:18.431108 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fe126-a6e7-4ec2-9b68-aac6dd619eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f557206929142c3b2da56329bd6817f)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:18.431411 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365925ad-f2db-4080-b5f5-ca4a0c416d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:18.433889 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fe126-a6e7-4ec2-9b68-aac6dd619eed admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:18.435235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-365925ad-f2db-4080-b5f5-ca4a0c416d48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:18.472172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365925ad-f2db-4080-b5f5-ca4a0c416d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:18.473811 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365925ad-f2db-4080-b5f5-ca4a0c416d48 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:18.488048 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1028/2076] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:18.492513 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df13ee6-d09e-4149-9875-291e6a1bfb96 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:18.492871 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df13ee6-d09e-4149-9875-291e6a1bfb96 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:18.493636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df13ee6-d09e-4149-9875-291e6a1bfb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:18.504077 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-0a6fe126-a6e7-4ec2-9b68-aac6dd619eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f557206929142c3b2da56329bd6817f'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:18.507126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-0a6fe126-a6e7-4ec2-9b68-aac6dd619eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f557206929142c3b2da56329bd6817f'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:18.508395 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-0a6fe126-a6e7-4ec2-9b68-aac6dd619eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f557206929142c3b2da56329bd6817f'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:18.523976 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-5df13ee6-d09e-4149-9875-291e6a1bfb96 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:18.526380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5df13ee6-d09e-4149-9875-291e6a1bfb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:18.527055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-0a6fe126-a6e7-4ec2-9b68-aac6dd619eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f557206929142c3b2da56329bd6817f'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:18.535162 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-0a6fe126-a6e7-4ec2-9b68-aac6dd619eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f557206929142c3b2da56329bd6817f'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:18.538604 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1029/2077] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:18.551573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11278194-1522-4682-b3f4-2cdd856662c1 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:18.552081 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11278194-1522-4682-b3f4-2cdd856662c1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:18.552423 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11278194-1522-4682-b3f4-2cdd856662c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:18.558644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1049/2078] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:18 2022] DELETE /identity/v3/users/3f557206929142c3b2da56329bd6817f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:18.583036 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-11278194-1522-4682-b3f4-2cdd856662c1 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:18.585547 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-11278194-1522-4682-b3f4-2cdd856662c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:18.667798 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1030/2079] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:37:18.673206 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fe126-a6e7-4ec2-9b68-aac6dd619eed admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:18.685861 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fe126-a6e7-4ec2-9b68-aac6dd619eed admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:18.691797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14267951-b9ba-4ab9-9c4c-82581ee60a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:18.692464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14267951-b9ba-4ab9-9c4c-82581ee60a6d admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:18.692749 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14267951-b9ba-4ab9-9c4c-82581ee60a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:18.693023 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14267951-b9ba-4ab9-9c4c-82581ee60a6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:18.694515 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14267951-b9ba-4ab9-9c4c-82581ee60a6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:37:18.694954 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14267951-b9ba-4ab9-9c4c-82581ee60a6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:18.696739 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14267951-b9ba-4ab9-9c4c-82581ee60a6d admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:18.711209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1050/2080] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:37:18.715467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11278194-1522-4682-b3f4-2cdd856662c1 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:18.726078 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11278194-1522-4682-b3f4-2cdd856662c1 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:18.731665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2fa9c-98b0-4b5e-988e-49c845d5a1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:18.732289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2fa9c-98b0-4b5e-988e-49c845d5a1a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:18.732577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2fa9c-98b0-4b5e-988e-49c845d5a1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:18.732855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2fa9c-98b0-4b5e-988e-49c845d5a1a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:18.733504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2fa9c-98b0-4b5e-988e-49c845d5a1a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:18.735650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2fa9c-98b0-4b5e-988e-49c845d5a1a1 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:18.757869 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:18.789181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1031/2081] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:18 2022] POST /identity/v3/projects => generated 389 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:37:18.794111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14267951-b9ba-4ab9-9c4c-82581ee60a6d admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:18.812560 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14267951-b9ba-4ab9-9c4c-82581ee60a6d admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:18.848675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2fa9c-98b0-4b5e-988e-49c845d5a1a1 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:18.851873 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-50f2fa9c-98b0-4b5e-988e-49c845d5a1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:18.908450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c5c2c-cf70-4609-abaa-7c099a83eee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:18.909043 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c5c2c-cf70-4609-abaa-7c099a83eee4 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:18.909397 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c5c2c-cf70-4609-abaa-7c099a83eee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:18.909670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c5c2c-cf70-4609-abaa-7c099a83eee4 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:18.910468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c5c2c-cf70-4609-abaa-7c099a83eee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:18.913889 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c5c2c-cf70-4609-abaa-7c099a83eee4 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:18.948673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1051/2082] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:18 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:18.952265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c5c2c-cf70-4609-abaa-7c099a83eee4 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:18.973460 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c5c2c-cf70-4609-abaa-7c099a83eee4 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:18.981544 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d4e75-6fc7-40e3-849f-79b0b7c6210f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:18.982115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d4e75-6fc7-40e3-849f-79b0b7c6210f admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:18.982646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d4e75-6fc7-40e3-849f-79b0b7c6210f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:18.983025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d4e75-6fc7-40e3-849f-79b0b7c6210f admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:18.985339 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d4e75-6fc7-40e3-849f-79b0b7c6210f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:18.985669 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d4e75-6fc7-40e3-849f-79b0b7c6210f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:19.001181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2fa9c-98b0-4b5e-988e-49c845d5a1a1 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:19.001373 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1052/2083] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:19.004778 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d4e75-6fc7-40e3-849f-79b0b7c6210f admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:19.007285 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-da5d4e75-6fc7-40e3-849f-79b0b7c6210f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:19.016741 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25a3fc-7458-473e-8d6a-846d59793a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:19.018893 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25a3fc-7458-473e-8d6a-846d59793a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:19.020210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25a3fc-7458-473e-8d6a-846d59793a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:19.020716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25a3fc-7458-473e-8d6a-846d59793a32 admin admin] PATH_INFO: `/v3/projects/6770f77843ad4899bd1c0e0cc6aa6f69` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:19.023190 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25a3fc-7458-473e-8d6a-846d59793a32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6770f77843ad4899bd1c0e0cc6aa6f69)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:19.025436 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25a3fc-7458-473e-8d6a-846d59793a32 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:19.041565 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d4e75-6fc7-40e3-849f-79b0b7c6210f admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:19.046438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303204a-fab1-4346-87a1-a672228135ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:19.047216 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303204a-fab1-4346-87a1-a672228135ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:19.047497 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303204a-fab1-4346-87a1-a672228135ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:19.047764 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303204a-fab1-4346-87a1-a672228135ef admin admin] PATH_INFO: `/v3/projects/4a32ec0848d24147be836317db4bca5b` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:19.048896 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303204a-fab1-4346-87a1-a672228135ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a32ec0848d24147be836317db4bca5b)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:19.050781 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303204a-fab1-4346-87a1-a672228135ef admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:19.069659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:19.101571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-1f25a3fc-7458-473e-8d6a-846d59793a32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6770f77843ad4899bd1c0e0cc6aa6f69', 'request_id': 'req-1f25a3fc-7458-473e-8d6a-846d59793a32'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:19.111714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-1f25a3fc-7458-473e-8d6a-846d59793a32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6770f77843ad4899bd1c0e0cc6aa6f69', 'request_id': 'req-1f25a3fc-7458-473e-8d6a-846d59793a32'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:19.119378 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-1f25a3fc-7458-473e-8d6a-846d59793a32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6770f77843ad4899bd1c0e0cc6aa6f69', 'request_id': 'req-1f25a3fc-7458-473e-8d6a-846d59793a32'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:19.122135 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6303204a-fab1-4346-87a1-a672228135ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a32ec0848d24147be836317db4bca5b', 'request_id': 'req-6303204a-fab1-4346-87a1-a672228135ef'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:19.130497 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6303204a-fab1-4346-87a1-a672228135ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a32ec0848d24147be836317db4bca5b', 'request_id': 'req-6303204a-fab1-4346-87a1-a672228135ef'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:19.138459 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6303204a-fab1-4346-87a1-a672228135ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a32ec0848d24147be836317db4bca5b', 'request_id': 'req-6303204a-fab1-4346-87a1-a672228135ef'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:19.141359 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-1f25a3fc-7458-473e-8d6a-846d59793a32 admin admin] The token cache is being invalidate because project 6770f77843ad4899bd1c0e0cc6aa6f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:19.141726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-1f25a3fc-7458-473e-8d6a-846d59793a32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:19.142516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-1f25a3fc-7458-473e-8d6a-846d59793a32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:19.144496 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1032/2084] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:18 2022] DELETE /identity/v3/projects/6770f77843ad4899bd1c0e0cc6aa6f69 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:37:19.145472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25a3fc-7458-473e-8d6a-846d59793a32 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:19.146929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1f25a3fc-7458-473e-8d6a-846d59793a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:19.181572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6303204a-fab1-4346-87a1-a672228135ef admin admin] The token cache is being invalidate because project 4a32ec0848d24147be836317db4bca5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:19.181864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6303204a-fab1-4346-87a1-a672228135ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:19.182557 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6303204a-fab1-4346-87a1-a672228135ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:19.184554 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1053/2085] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:19 2022] DELETE /identity/v3/projects/4a32ec0848d24147be836317db4bca5b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:19.185377 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303204a-fab1-4346-87a1-a672228135ef admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:19.186684 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6303204a-fab1-4346-87a1-a672228135ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:19.236888 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25a3fc-7458-473e-8d6a-846d59793a32 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:19.253495 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303204a-fab1-4346-87a1-a672228135ef admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:19.258632 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6be40-b885-4d30-b97d-33bb553d8e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:19.259544 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6be40-b885-4d30-b97d-33bb553d8e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:19.259829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6be40-b885-4d30-b97d-33bb553d8e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:19.260102 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6be40-b885-4d30-b97d-33bb553d8e3d admin admin] PATH_INFO: `/v3/users/e2e1bc5af2de43dfb8c92af8939a29b4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:19.261259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6be40-b885-4d30-b97d-33bb553d8e3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e1bc5af2de43dfb8c92af8939a29b4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:19.263208 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6be40-b885-4d30-b97d-33bb553d8e3d admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:19.266804 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:19.301782 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb9c50-0ab1-4835-8e70-d3054747033f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:19.302390 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb9c50-0ab1-4835-8e70-d3054747033f admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:19.303233 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb9c50-0ab1-4835-8e70-d3054747033f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:19.303756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb9c50-0ab1-4835-8e70-d3054747033f admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:19.304423 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb9c50-0ab1-4835-8e70-d3054747033f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:19.306040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb9c50-0ab1-4835-8e70-d3054747033f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:19.323181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1033/2086] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:19.323181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65c1d6-0099-4317-b066-5723579b3dca None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:19.323181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65c1d6-0099-4317-b066-5723579b3dca None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:19.323181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65c1d6-0099-4317-b066-5723579b3dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:19.331577 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-ffc6be40-b885-4d30-b97d-33bb553d8e3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e1bc5af2de43dfb8c92af8939a29b4'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:19.333199 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-ffc6be40-b885-4d30-b97d-33bb553d8e3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e1bc5af2de43dfb8c92af8939a29b4'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:19.334196 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-ffc6be40-b885-4d30-b97d-33bb553d8e3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e1bc5af2de43dfb8c92af8939a29b4'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:19.345599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-3a65c1d6-0099-4317-b066-5723579b3dca None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:19.347726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3a65c1d6-0099-4317-b066-5723579b3dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:19.349205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-ffc6be40-b885-4d30-b97d-33bb553d8e3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e1bc5af2de43dfb8c92af8939a29b4'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:19.358635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-ffc6be40-b885-4d30-b97d-33bb553d8e3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e1bc5af2de43dfb8c92af8939a29b4'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:19.362977 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1034/2087] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:19.363827 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65c1d6-0099-4317-b066-5723579b3dca None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:19.366376 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3a65c1d6-0099-4317-b066-5723579b3dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:19.383332 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65c1d6-0099-4317-b066-5723579b3dca None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:19.386139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1054/2088] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:19 2022] DELETE /identity/v3/users/e2e1bc5af2de43dfb8c92af8939a29b4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:19.388332 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e50ca-df17-43a8-8c30-6f1239c8e08d None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:19.388889 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e50ca-df17-43a8-8c30-6f1239c8e08d None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:19.389741 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e50ca-df17-43a8-8c30-6f1239c8e08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:19.418611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-707e50ca-df17-43a8-8c30-6f1239c8e08d None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:19.421349 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-707e50ca-df17-43a8-8c30-6f1239c8e08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:19.444626 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:19.519097 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4febc-82bc-4637-9a7d-21311708d2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:19.519691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4febc-82bc-4637-9a7d-21311708d2ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:19.519960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4febc-82bc-4637-9a7d-21311708d2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:19.520341 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4febc-82bc-4637-9a7d-21311708d2ae admin admin] PATH_INFO: `/v3/projects/801742cb63c04b2eb4781a6ac10ef60f/users/d27409aa52f34fc582e07dd4ddc57c49/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:19.537729 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1055/2089] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:19.543576 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e50ca-df17-43a8-8c30-6f1239c8e08d None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:19.545250 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4febc-82bc-4637-9a7d-21311708d2ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=801742cb63c04b2eb4781a6ac10ef60f, user_id=d27409aa52f34fc582e07dd4ddc57c49, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:19.548461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4febc-82bc-4637-9a7d-21311708d2ae admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:19.567706 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e50ca-df17-43a8-8c30-6f1239c8e08d None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:19.582129 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1035/2090] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:19 2022] PUT /identity/v3/projects/801742cb63c04b2eb4781a6ac10ef60f/users/d27409aa52f34fc582e07dd4ddc57c49/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:19.584988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00dfd5-cf24-4469-9544-1cc61bddc4b1 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:19.585406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00dfd5-cf24-4469-9544-1cc61bddc4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:19.587740 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00dfd5-cf24-4469-9544-1cc61bddc4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:19.694902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-fc00dfd5-cf24-4469-9544-1cc61bddc4b1 None None] MFA Rules not processed for user `d27409aa52f34fc582e07dd4ddc57c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:19.696315 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-fc00dfd5-cf24-4469-9544-1cc61bddc4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:19.720139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e396c8-0868-45fa-995b-dd8e1b30aebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:19.720965 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e396c8-0868-45fa-995b-dd8e1b30aebe admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:19.721271 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e396c8-0868-45fa-995b-dd8e1b30aebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:19.721545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e396c8-0868-45fa-995b-dd8e1b30aebe admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:19.722204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e396c8-0868-45fa-995b-dd8e1b30aebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:37:19.722505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e396c8-0868-45fa-995b-dd8e1b30aebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:19.725951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e396c8-0868-45fa-995b-dd8e1b30aebe admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:19.759162 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1056/2091] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:37:19.760290 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e396c8-0868-45fa-995b-dd8e1b30aebe admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:19.775941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e396c8-0868-45fa-995b-dd8e1b30aebe admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:19.801453 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0e673-4e19-44e0-9deb-9d7d122f6e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:19.807025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0e673-4e19-44e0-9deb-9d7d122f6e11 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:19.807417 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0e673-4e19-44e0-9deb-9d7d122f6e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:19.807770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0e673-4e19-44e0-9deb-9d7d122f6e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:19.809843 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0e673-4e19-44e0-9deb-9d7d122f6e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:19.812191 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0e673-4e19-44e0-9deb-9d7d122f6e11 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:19.875690 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1057/2092] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:19 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:19.888161 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0e673-4e19-44e0-9deb-9d7d122f6e11 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:19.892005 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1036/2093] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:19.897516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00dfd5-cf24-4469-9544-1cc61bddc4b1 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:19.926243 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00dfd5-cf24-4469-9544-1cc61bddc4b1 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:20.008974 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:20.022274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0e673-4e19-44e0-9deb-9d7d122f6e11 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:20.029367 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469a973-71a1-499c-bf06-ace3f8d24eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:20.030554 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469a973-71a1-499c-bf06-ace3f8d24eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:20.030938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469a973-71a1-499c-bf06-ace3f8d24eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:20.031289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469a973-71a1-499c-bf06-ace3f8d24eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:20.032482 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469a973-71a1-499c-bf06-ace3f8d24eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:20.034665 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469a973-71a1-499c-bf06-ace3f8d24eb7 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:20.066759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80ea1d-e743-4545-9f2c-a07f105f7b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:20.067605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80ea1d-e743-4545-9f2c-a07f105f7b85 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:20.067929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80ea1d-e743-4545-9f2c-a07f105f7b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:20.068211 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80ea1d-e743-4545-9f2c-a07f105f7b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:20.070622 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80ea1d-e743-4545-9f2c-a07f105f7b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:20.077181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80ea1d-e743-4545-9f2c-a07f105f7b85 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:20.110509 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1058/2094] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:19 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:37:20.120248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469a973-71a1-499c-bf06-ace3f8d24eb7 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:20.122314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c469a973-71a1-499c-bf06-ace3f8d24eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:20.138398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1037/2095] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:19 2022] POST /identity/v3/projects => generated 387 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:20.139697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80ea1d-e743-4545-9f2c-a07f105f7b85 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:20.150493 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469a973-71a1-499c-bf06-ace3f8d24eb7 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:20.183074 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:20.255559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068899d0-dfb4-4efe-8486-17bc75bac462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:20.256270 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068899d0-dfb4-4efe-8486-17bc75bac462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:20.256553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068899d0-dfb4-4efe-8486-17bc75bac462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:20.256826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80ea1d-e743-4545-9f2c-a07f105f7b85 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:20.256935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068899d0-dfb4-4efe-8486-17bc75bac462 admin admin] PATH_INFO: `/v3/projects/d2693a2e4c284f2ab783de085cbe7c6e` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:20.262493 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068899d0-dfb4-4efe-8486-17bc75bac462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2693a2e4c284f2ab783de085cbe7c6e)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:20.264592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b773ce-766d-4f47-9223-2739ea57027d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:20.264896 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068899d0-dfb4-4efe-8486-17bc75bac462 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:20.265204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b773ce-766d-4f47-9223-2739ea57027d admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:20.265547 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b773ce-766d-4f47-9223-2739ea57027d admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:20.265828 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b773ce-766d-4f47-9223-2739ea57027d admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:20.266485 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b773ce-766d-4f47-9223-2739ea57027d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:20.268545 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b773ce-766d-4f47-9223-2739ea57027d admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:20.283455 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1038/2096] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:20.284291 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b773ce-766d-4f47-9223-2739ea57027d admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:20.298939 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b773ce-766d-4f47-9223-2739ea57027d admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:20.305676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7894e-0f9e-4655-a556-9c0d4ee9a051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:20.306421 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7894e-0f9e-4655-a556-9c0d4ee9a051 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:20.306707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7894e-0f9e-4655-a556-9c0d4ee9a051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:20.307028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7894e-0f9e-4655-a556-9c0d4ee9a051 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:20.307665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7894e-0f9e-4655-a556-9c0d4ee9a051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:20.309581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7894e-0f9e-4655-a556-9c0d4ee9a051 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:20.341864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-068899d0-dfb4-4efe-8486-17bc75bac462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2693a2e4c284f2ab783de085cbe7c6e', 'request_id': 'req-068899d0-dfb4-4efe-8486-17bc75bac462'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:20.342220 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1039/2097] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:20 2022] POST /identity/v3/users => generated 300 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:20.342977 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7894e-0f9e-4655-a556-9c0d4ee9a051 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:20.352717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-068899d0-dfb4-4efe-8486-17bc75bac462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2693a2e4c284f2ab783de085cbe7c6e', 'request_id': 'req-068899d0-dfb4-4efe-8486-17bc75bac462'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:20.357798 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7894e-0f9e-4655-a556-9c0d4ee9a051 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:20.362201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-068899d0-dfb4-4efe-8486-17bc75bac462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2693a2e4c284f2ab783de085cbe7c6e', 'request_id': 'req-068899d0-dfb4-4efe-8486-17bc75bac462'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:20.387908 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-068899d0-dfb4-4efe-8486-17bc75bac462 admin admin] The token cache is being invalidate because project d2693a2e4c284f2ab783de085cbe7c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:20.388535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-068899d0-dfb4-4efe-8486-17bc75bac462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:20.389441 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-068899d0-dfb4-4efe-8486-17bc75bac462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:20.391781 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1059/2098] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:20 2022] DELETE /identity/v3/projects/d2693a2e4c284f2ab783de085cbe7c6e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:20.392979 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068899d0-dfb4-4efe-8486-17bc75bac462 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:20.394602 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-068899d0-dfb4-4efe-8486-17bc75bac462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:20.465940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d339e9-1e10-48ea-b815-2b70a56ed4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:20.466568 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d339e9-1e10-48ea-b815-2b70a56ed4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:20.466893 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d339e9-1e10-48ea-b815-2b70a56ed4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:20.467158 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d339e9-1e10-48ea-b815-2b70a56ed4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:20.467810 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d339e9-1e10-48ea-b815-2b70a56ed4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:20.469423 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d339e9-1e10-48ea-b815-2b70a56ed4b2 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:20.494432 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1040/2099] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:20.494432 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e2353-f26a-4e5c-8710-c767d34e0667 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:20.494432 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e2353-f26a-4e5c-8710-c767d34e0667 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:20.494432 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e2353-f26a-4e5c-8710-c767d34e0667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:20.516431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-d42e2353-f26a-4e5c-8710-c767d34e0667 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:20.517700 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d42e2353-f26a-4e5c-8710-c767d34e0667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:20.526340 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1041/2100] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:20.527169 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e2353-f26a-4e5c-8710-c767d34e0667 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:20.528390 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d42e2353-f26a-4e5c-8710-c767d34e0667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:20.538353 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068899d0-dfb4-4efe-8486-17bc75bac462 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:20.540816 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e2353-f26a-4e5c-8710-c767d34e0667 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:20.543463 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210831a2-d41f-45a6-bde6-8c5e3d7893f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:20.544071 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210831a2-d41f-45a6-bde6-8c5e3d7893f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:20.544352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210831a2-d41f-45a6-bde6-8c5e3d7893f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:20.544628 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210831a2-d41f-45a6-bde6-8c5e3d7893f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:20.545274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210831a2-d41f-45a6-bde6-8c5e3d7893f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:20.546333 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01450aad-a739-465e-84cd-909b147a8d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:20.546946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210831a2-d41f-45a6-bde6-8c5e3d7893f7 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:20.547460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01450aad-a739-465e-84cd-909b147a8d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:20.547937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01450aad-a739-465e-84cd-909b147a8d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:20.548620 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01450aad-a739-465e-84cd-909b147a8d5b admin admin] PATH_INFO: `/v3/projects/df9a4464c20b4d51abec96e5bd918a6c/users/f930be8cacf84cf0b67bf1982d86f00e/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:20.558211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1060/2101] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:20.559520 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f52673-0703-4c07-a3be-3dea257f5e40 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:20.559811 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f52673-0703-4c07-a3be-3dea257f5e40 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:20.560141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f52673-0703-4c07-a3be-3dea257f5e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:20.569295 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01450aad-a739-465e-84cd-909b147a8d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9a4464c20b4d51abec96e5bd918a6c, user_id=f930be8cacf84cf0b67bf1982d86f00e, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:20.573399 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01450aad-a739-465e-84cd-909b147a8d5b admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:20.586165 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-92f52673-0703-4c07-a3be-3dea257f5e40 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:20.587489 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-92f52673-0703-4c07-a3be-3dea257f5e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:20.588726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1042/2102] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:20 2022] PUT /identity/v3/projects/df9a4464c20b4d51abec96e5bd918a6c/users/f930be8cacf84cf0b67bf1982d86f00e/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:20.589414 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01450aad-a739-465e-84cd-909b147a8d5b admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:20.600918 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:20.642812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:20.660581 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1061/2103] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:20.663895 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01450aad-a739-465e-84cd-909b147a8d5b admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:20.665110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16df23-aeff-4510-8e84-4f7dbddd2e95 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:20.665392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16df23-aeff-4510-8e84-4f7dbddd2e95 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:20.665665 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16df23-aeff-4510-8e84-4f7dbddd2e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:20.668684 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba9805-6412-4a81-ae96-3bf7afb106bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:20.669332 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba9805-6412-4a81-ae96-3bf7afb106bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:20.669617 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba9805-6412-4a81-ae96-3bf7afb106bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:20.669893 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba9805-6412-4a81-ae96-3bf7afb106bf admin admin] PATH_INFO: `/v3/projects/ef0d2fedcf144bc0905c05a5e36b11f8/users/c97b283205304f388495df09336b159c/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:20.685483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba9805-6412-4a81-ae96-3bf7afb106bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0d2fedcf144bc0905c05a5e36b11f8, user_id=c97b283205304f388495df09336b159c, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:20.688207 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba9805-6412-4a81-ae96-3bf7afb106bf admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:20.695314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-fd16df23-aeff-4510-8e84-4f7dbddd2e95 None None] MFA Rules not processed for user `f930be8cacf84cf0b67bf1982d86f00e`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:20.696805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-fd16df23-aeff-4510-8e84-4f7dbddd2e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:20.701945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1043/2104] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:20 2022] PUT /identity/v3/projects/ef0d2fedcf144bc0905c05a5e36b11f8/users/c97b283205304f388495df09336b159c/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:20.702783 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba9805-6412-4a81-ae96-3bf7afb106bf admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:20.772629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1062/2105] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:20.772629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16df23-aeff-4510-8e84-4f7dbddd2e95 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:20.772901 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba9805-6412-4a81-ae96-3bf7afb106bf admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:20.779197 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ec75b-eba0-406a-a2cb-830a9063b715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:20.779862 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ec75b-eba0-406a-a2cb-830a9063b715 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:20.780148 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ec75b-eba0-406a-a2cb-830a9063b715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:20.780424 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ec75b-eba0-406a-a2cb-830a9063b715 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:20.781130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ec75b-eba0-406a-a2cb-830a9063b715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:37:20.781444 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ec75b-eba0-406a-a2cb-830a9063b715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:20.783166 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ec75b-eba0-406a-a2cb-830a9063b715 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:20.783709 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16df23-aeff-4510-8e84-4f7dbddd2e95 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:20.789283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed40fd-3ae9-4835-be2e-b2ff1799d865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:20.789881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed40fd-3ae9-4835-be2e-b2ff1799d865 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:20.790158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed40fd-3ae9-4835-be2e-b2ff1799d865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:20.790425 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed40fd-3ae9-4835-be2e-b2ff1799d865 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:20.791596 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed40fd-3ae9-4835-be2e-b2ff1799d865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:20.793880 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed40fd-3ae9-4835-be2e-b2ff1799d865 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:20.796463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1044/2106] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:37:20.799950 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ec75b-eba0-406a-a2cb-830a9063b715 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:20.807986 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1063/2107] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:20.807986 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed40fd-3ae9-4835-be2e-b2ff1799d865 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:20.812377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ec75b-eba0-406a-a2cb-830a9063b715 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:20.817363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed40fd-3ae9-4835-be2e-b2ff1799d865 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:20.819375 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b74cd4-792b-478f-ac40-429b20b9bd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:20.820267 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b74cd4-792b-478f-ac40-429b20b9bd93 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:20.820726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b74cd4-792b-478f-ac40-429b20b9bd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:20.821157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b74cd4-792b-478f-ac40-429b20b9bd93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:20.821938 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b74cd4-792b-478f-ac40-429b20b9bd93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:20.822498 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65caf6e-7ae3-4d62-a081-8d71a0ff1424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:20.823367 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65caf6e-7ae3-4d62-a081-8d71a0ff1424 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:20.823643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65caf6e-7ae3-4d62-a081-8d71a0ff1424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:20.823916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65caf6e-7ae3-4d62-a081-8d71a0ff1424 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:20.824539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65caf6e-7ae3-4d62-a081-8d71a0ff1424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:20.825297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b74cd4-792b-478f-ac40-429b20b9bd93 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:20.826398 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65caf6e-7ae3-4d62-a081-8d71a0ff1424 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:20.856230 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1064/2108] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:20 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:20.857049 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65caf6e-7ae3-4d62-a081-8d71a0ff1424 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:20.864043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1045/2109] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:20 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:20.864750 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b74cd4-792b-478f-ac40-429b20b9bd93 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:20.932024 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:20.934256 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65caf6e-7ae3-4d62-a081-8d71a0ff1424 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:20.936482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b74cd4-792b-478f-ac40-429b20b9bd93 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:20.939991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b364257-7207-433b-a0fd-1d56b769b340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:20.940726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b364257-7207-433b-a0fd-1d56b769b340 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:20.941083 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b364257-7207-433b-a0fd-1d56b769b340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:20.941362 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b364257-7207-433b-a0fd-1d56b769b340 admin admin] PATH_INFO: `/v3/projects/ef0d2fedcf144bc0905c05a5e36b11f8/users/c97b283205304f388495df09336b159c/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:20.943358 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b364257-7207-433b-a0fd-1d56b769b340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0d2fedcf144bc0905c05a5e36b11f8, user_id=c97b283205304f388495df09336b159c, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:20.944561 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738660d-9283-44a4-961c-c22cabb527aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:20.945149 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738660d-9283-44a4-961c-c22cabb527aa admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:20.945433 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738660d-9283-44a4-961c-c22cabb527aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:20.945713 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738660d-9283-44a4-961c-c22cabb527aa admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:20.946348 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738660d-9283-44a4-961c-c22cabb527aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:20.946514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b364257-7207-433b-a0fd-1d56b769b340 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:20.948628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738660d-9283-44a4-961c-c22cabb527aa admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:20.957184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1065/2110] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:20 2022] PUT /identity/v3/projects/ef0d2fedcf144bc0905c05a5e36b11f8/users/c97b283205304f388495df09336b159c/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:20.958109 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b364257-7207-433b-a0fd-1d56b769b340 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:20.972506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1046/2111] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:20 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:20.973625 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34356321-661f-45cb-85d9-ae3175de9fa2 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:20.973912 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34356321-661f-45cb-85d9-ae3175de9fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:20.974190 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34356321-661f-45cb-85d9-ae3175de9fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:21.007582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-34356321-661f-45cb-85d9-ae3175de9fa2 None None] MFA Rules not processed for user `c97b283205304f388495df09336b159c`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:21.008973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-34356321-661f-45cb-85d9-ae3175de9fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:21.017232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:21.043796 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b364257-7207-433b-a0fd-1d56b769b340 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:21.049090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5fb13-79d1-4346-94a2-e5ea0a22e38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:21.050435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5fb13-79d1-4346-94a2-e5ea0a22e38c admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:21.050435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5fb13-79d1-4346-94a2-e5ea0a22e38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:21.050435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5fb13-79d1-4346-94a2-e5ea0a22e38c admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:21.050888 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5fb13-79d1-4346-94a2-e5ea0a22e38c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:21.052838 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5fb13-79d1-4346-94a2-e5ea0a22e38c admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:21.076286 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1066/2112] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:20 2022] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:21.077145 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5fb13-79d1-4346-94a2-e5ea0a22e38c admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:21.090577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1047/2113] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:21.091247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34356321-661f-45cb-85d9-ae3175de9fa2 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:21.093756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5fb13-79d1-4346-94a2-e5ea0a22e38c admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:21.099947 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622c7a6-76cd-441d-92d2-6494628c97cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:21.101050 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622c7a6-76cd-441d-92d2-6494628c97cd admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:21.101734 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622c7a6-76cd-441d-92d2-6494628c97cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:21.101928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622c7a6-76cd-441d-92d2-6494628c97cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:21.102641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622c7a6-76cd-441d-92d2-6494628c97cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:21.104345 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622c7a6-76cd-441d-92d2-6494628c97cd admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:21.107192 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34356321-661f-45cb-85d9-ae3175de9fa2 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:21.111358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd87f60-bea0-4e84-b759-3dbd62454e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:21.111973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd87f60-bea0-4e84-b759-3dbd62454e00 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:21.112258 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd87f60-bea0-4e84-b759-3dbd62454e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:21.112534 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd87f60-bea0-4e84-b759-3dbd62454e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:21.113178 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd87f60-bea0-4e84-b759-3dbd62454e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:21.114842 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd87f60-bea0-4e84-b759-3dbd62454e00 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:21.116174 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1067/2114] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:21.117097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622c7a6-76cd-441d-92d2-6494628c97cd admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:21.118945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b622c7a6-76cd-441d-92d2-6494628c97cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:21.125998 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1048/2115] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:21.127755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd87f60-bea0-4e84-b759-3dbd62454e00 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:21.138702 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd87f60-bea0-4e84-b759-3dbd62454e00 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:21.144685 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f137b-1565-4faf-9818-137289168858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:21.145295 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f137b-1565-4faf-9818-137289168858 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:21.145572 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f137b-1565-4faf-9818-137289168858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:21.145843 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f137b-1565-4faf-9818-137289168858 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:21.147018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f137b-1565-4faf-9818-137289168858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:21.148741 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f137b-1565-4faf-9818-137289168858 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:21.160920 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1049/2116] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:21.161824 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f137b-1565-4faf-9818-137289168858 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:21.175845 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f137b-1565-4faf-9818-137289168858 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:21.182768 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aaeefa-34a7-4a7e-9e73-da9156e315dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:21.183632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aaeefa-34a7-4a7e-9e73-da9156e315dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:21.184716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aaeefa-34a7-4a7e-9e73-da9156e315dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:21.184841 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aaeefa-34a7-4a7e-9e73-da9156e315dd admin admin] PATH_INFO: `/v3/projects/e4754bd9047f4aa08e9d6d23fefdbec9/users/952935d6adf64b66a6766362706b7e89/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:21.194496 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622c7a6-76cd-441d-92d2-6494628c97cd admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:21.199582 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ebca1-ce41-4836-94f0-1b37758118f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:21.200489 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ebca1-ce41-4836-94f0-1b37758118f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:21.200900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ebca1-ce41-4836-94f0-1b37758118f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:21.201276 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ebca1-ce41-4836-94f0-1b37758118f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:21.207517 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aaeefa-34a7-4a7e-9e73-da9156e315dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4754bd9047f4aa08e9d6d23fefdbec9, user_id=952935d6adf64b66a6766362706b7e89, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:21.210964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aaeefa-34a7-4a7e-9e73-da9156e315dd admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:21.214236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ebca1-ce41-4836-94f0-1b37758118f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:21.216011 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ebca1-ce41-4836-94f0-1b37758118f4 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:21.228229 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1068/2117] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:21.229002 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ebca1-ce41-4836-94f0-1b37758118f4 service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:21.232392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1050/2118] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:21 2022] PUT /identity/v3/projects/e4754bd9047f4aa08e9d6d23fefdbec9/users/952935d6adf64b66a6766362706b7e89/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:21.236106 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aaeefa-34a7-4a7e-9e73-da9156e315dd admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:21.254648 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ebca1-ce41-4836-94f0-1b37758118f4 service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:21.318444 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aaeefa-34a7-4a7e-9e73-da9156e315dd admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:21.319386 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e7dce-57b3-46bb-bf0a-48e2c3221e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:21.320093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e7dce-57b3-46bb-bf0a-48e2c3221e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:21.320335 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e7dce-57b3-46bb-bf0a-48e2c3221e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:21.320611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e7dce-57b3-46bb-bf0a-48e2c3221e9b admin admin] PATH_INFO: `/v3/projects/591b412b583440ccb1ea8a8bf132657d/users/27b40187eabd46f2897b9c16fe828eab/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:21.324021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2be9c4-fba8-41b5-80e1-f4cec5353688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:21.324628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2be9c4-fba8-41b5-80e1-f4cec5353688 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:21.324912 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2be9c4-fba8-41b5-80e1-f4cec5353688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:21.325188 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2be9c4-fba8-41b5-80e1-f4cec5353688 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:21.325829 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2be9c4-fba8-41b5-80e1-f4cec5353688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:21.327539 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2be9c4-fba8-41b5-80e1-f4cec5353688 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:21.338167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1051/2119] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:37:21.338798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e7dce-57b3-46bb-bf0a-48e2c3221e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=591b412b583440ccb1ea8a8bf132657d, user_id=27b40187eabd46f2897b9c16fe828eab, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:21.341798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e7dce-57b3-46bb-bf0a-48e2c3221e9b admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:21.342192 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2be9c4-fba8-41b5-80e1-f4cec5353688 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:21.354369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2be9c4-fba8-41b5-80e1-f4cec5353688 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:21.359723 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed197e-bb99-4c86-b729-ead720396b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:21.360369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed197e-bb99-4c86-b729-ead720396b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:21.360653 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed197e-bb99-4c86-b729-ead720396b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:21.360931 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed197e-bb99-4c86-b729-ead720396b4e admin admin] PATH_INFO: `/v3/projects/e4754bd9047f4aa08e9d6d23fefdbec9/users/952935d6adf64b66a6766362706b7e89/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:21.363126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1069/2120] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:21 2022] PUT /identity/v3/projects/591b412b583440ccb1ea8a8bf132657d/users/27b40187eabd46f2897b9c16fe828eab/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:21.363244 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed197e-bb99-4c86-b729-ead720396b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4754bd9047f4aa08e9d6d23fefdbec9, user_id=952935d6adf64b66a6766362706b7e89, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:21.366482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed197e-bb99-4c86-b729-ead720396b4e admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:21.374946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336aecb-789e-4b48-85a6-fe3ba2ba9689 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:21.375975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336aecb-789e-4b48-85a6-fe3ba2ba9689 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:21.375975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336aecb-789e-4b48-85a6-fe3ba2ba9689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:21.383914 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1052/2121] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:21 2022] PUT /identity/v3/projects/e4754bd9047f4aa08e9d6d23fefdbec9/users/952935d6adf64b66a6766362706b7e89/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:37:21.397524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a151a-da8e-4fb5-9b63-2ad50fd1d561 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:21.398189 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a151a-da8e-4fb5-9b63-2ad50fd1d561 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:21.398472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a151a-da8e-4fb5-9b63-2ad50fd1d561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:21.416890 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-0336aecb-789e-4b48-85a6-fe3ba2ba9689 None None] MFA Rules not processed for user `27b40187eabd46f2897b9c16fe828eab`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:21.418110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0336aecb-789e-4b48-85a6-fe3ba2ba9689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:21.421720 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:21.432714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-e70a151a-da8e-4fb5-9b63-2ad50fd1d561 None None] MFA Rules not processed for user `952935d6adf64b66a6766362706b7e89`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:21.433943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e70a151a-da8e-4fb5-9b63-2ad50fd1d561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:21.453873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:21.492686 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1070/2122] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:37:21.493617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336aecb-789e-4b48-85a6-fe3ba2ba9689 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:21.518278 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1053/2123] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:21.518278 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a151a-da8e-4fb5-9b63-2ad50fd1d561 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:21.603307 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a151a-da8e-4fb5-9b63-2ad50fd1d561 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:21.606803 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336aecb-789e-4b48-85a6-fe3ba2ba9689 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:21.608160 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e3162-b872-4bef-898d-02c1380b0874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:21.608938 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e3162-b872-4bef-898d-02c1380b0874 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:21.609767 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e3162-b872-4bef-898d-02c1380b0874 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:21.610327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e3162-b872-4bef-898d-02c1380b0874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:21.613308 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eed9bc-4aaf-4bf2-a20e-22a9946473dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:21.613934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eed9bc-4aaf-4bf2-a20e-22a9946473dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:21.614211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eed9bc-4aaf-4bf2-a20e-22a9946473dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:21.614481 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eed9bc-4aaf-4bf2-a20e-22a9946473dc admin admin] PATH_INFO: `/v3/users/d27409aa52f34fc582e07dd4ddc57c49` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:21.615769 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eed9bc-4aaf-4bf2-a20e-22a9946473dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d27409aa52f34fc582e07dd4ddc57c49)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:21.618258 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eed9bc-4aaf-4bf2-a20e-22a9946473dc admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:21.621595 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e3162-b872-4bef-898d-02c1380b0874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:21.623071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e3162-b872-4bef-898d-02c1380b0874 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:21.637453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1054/2124] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:21.640688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e3162-b872-4bef-898d-02c1380b0874 service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:21.642348 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-280e3162-b872-4bef-898d-02c1380b0874 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:21.660128 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e3162-b872-4bef-898d-02c1380b0874 service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:21.665231 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39803134-8e09-46b9-8e0d-a4f0b8908ad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:21.666037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39803134-8e09-46b9-8e0d-a4f0b8908ad6 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:21.666355 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39803134-8e09-46b9-8e0d-a4f0b8908ad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:21.667119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39803134-8e09-46b9-8e0d-a4f0b8908ad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:21.676959 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b4eed9bc-4aaf-4bf2-a20e-22a9946473dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd27409aa52f34fc582e07dd4ddc57c49'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:21.678452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b4eed9bc-4aaf-4bf2-a20e-22a9946473dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd27409aa52f34fc582e07dd4ddc57c49'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:21.679428 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b4eed9bc-4aaf-4bf2-a20e-22a9946473dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd27409aa52f34fc582e07dd4ddc57c49'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:21.694248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b4eed9bc-4aaf-4bf2-a20e-22a9946473dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd27409aa52f34fc582e07dd4ddc57c49'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:21.717218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39803134-8e09-46b9-8e0d-a4f0b8908ad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:21.721625 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39803134-8e09-46b9-8e0d-a4f0b8908ad6 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:21.727247 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b4eed9bc-4aaf-4bf2-a20e-22a9946473dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd27409aa52f34fc582e07dd4ddc57c49'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:21.733768 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1055/2125] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:21.776700 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1071/2126] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:21 2022] DELETE /identity/v3/users/d27409aa52f34fc582e07dd4ddc57c49 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:21.781289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e51c4-0e64-4e1d-9536-dd3792e2153a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:21.790881 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e51c4-0e64-4e1d-9536-dd3792e2153a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:21.790881 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e51c4-0e64-4e1d-9536-dd3792e2153a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:21.823036 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2f2e51c4-0e64-4e1d-9536-dd3792e2153a None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:21.824321 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2f2e51c4-0e64-4e1d-9536-dd3792e2153a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:21.908817 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1056/2127] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:21.919421 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eed9bc-4aaf-4bf2-a20e-22a9946473dc admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:21.921092 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b4eed9bc-4aaf-4bf2-a20e-22a9946473dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:22.022756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e51c4-0e64-4e1d-9536-dd3792e2153a None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:22.024913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2f2e51c4-0e64-4e1d-9536-dd3792e2153a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:22.045225 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eed9bc-4aaf-4bf2-a20e-22a9946473dc admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:22.049016 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3429409-3e7a-4d70-9a73-c0865f6211d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:22.049560 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3429409-3e7a-4d70-9a73-c0865f6211d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:22.049842 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3429409-3e7a-4d70-9a73-c0865f6211d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:22.050114 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3429409-3e7a-4d70-9a73-c0865f6211d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:22.065081 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3429409-3e7a-4d70-9a73-c0865f6211d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:22.066155 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:22.068468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3429409-3e7a-4d70-9a73-c0865f6211d0 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:22.074788 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:22.083379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1072/2128] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:22.109495 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e51c4-0e64-4e1d-9536-dd3792e2153a None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:22.116013 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb896f-a7da-481a-abc1-018e1642e454 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:22.116948 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb896f-a7da-481a-abc1-018e1642e454 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:22.117385 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb896f-a7da-481a-abc1-018e1642e454 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:22.117816 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb896f-a7da-481a-abc1-018e1642e454 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:22.119907 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ebcb896f-a7da-481a-abc1-018e1642e454 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:22.211543 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb896f-a7da-481a-abc1-018e1642e454 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:22.213139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb896f-a7da-481a-abc1-018e1642e454 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:22.225085 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1057/2129] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:37:22.440191 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3429409-3e7a-4d70-9a73-c0865f6211d0 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:22.441691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f3429409-3e7a-4d70-9a73-c0865f6211d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:22.469004 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3429409-3e7a-4d70-9a73-c0865f6211d0 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:22.474007 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b506f-b69d-4811-ac44-70626f1b1044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:22.474741 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b506f-b69d-4811-ac44-70626f1b1044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:22.475094 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b506f-b69d-4811-ac44-70626f1b1044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:22.475378 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b506f-b69d-4811-ac44-70626f1b1044 admin admin] PATH_INFO: `/v3/projects/801742cb63c04b2eb4781a6ac10ef60f` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:22.476502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b506f-b69d-4811-ac44-70626f1b1044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=801742cb63c04b2eb4781a6ac10ef60f)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:22.478473 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b506f-b69d-4811-ac44-70626f1b1044 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:22.542861 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-415b506f-b69d-4811-ac44-70626f1b1044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '801742cb63c04b2eb4781a6ac10ef60f', 'request_id': 'req-415b506f-b69d-4811-ac44-70626f1b1044'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:22.551042 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-415b506f-b69d-4811-ac44-70626f1b1044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '801742cb63c04b2eb4781a6ac10ef60f', 'request_id': 'req-415b506f-b69d-4811-ac44-70626f1b1044'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:22.558376 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-415b506f-b69d-4811-ac44-70626f1b1044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '801742cb63c04b2eb4781a6ac10ef60f', 'request_id': 'req-415b506f-b69d-4811-ac44-70626f1b1044'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:22.573514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-415b506f-b69d-4811-ac44-70626f1b1044 admin admin] The token cache is being invalidate because project 801742cb63c04b2eb4781a6ac10ef60f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:22.573808 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-415b506f-b69d-4811-ac44-70626f1b1044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:22.574475 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-415b506f-b69d-4811-ac44-70626f1b1044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:22.575967 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1073/2130] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:22 2022] DELETE /identity/v3/projects/801742cb63c04b2eb4781a6ac10ef60f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:22.579949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb896f-a7da-481a-abc1-018e1642e454 service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:22.592007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb896f-a7da-481a-abc1-018e1642e454 service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:22.649960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceae49a-6f9c-4dd0-900b-67afb9ea53fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:22.650583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceae49a-6f9c-4dd0-900b-67afb9ea53fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:22.650868 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceae49a-6f9c-4dd0-900b-67afb9ea53fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:22.651145 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceae49a-6f9c-4dd0-900b-67afb9ea53fa admin admin] PATH_INFO: `/v3/users/c97b283205304f388495df09336b159c` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:22.652249 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceae49a-6f9c-4dd0-900b-67afb9ea53fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c97b283205304f388495df09336b159c)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:22.654158 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceae49a-6f9c-4dd0-900b-67afb9ea53fa admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:22.700828 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8ceae49a-6f9c-4dd0-900b-67afb9ea53fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c97b283205304f388495df09336b159c'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:22.701486 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8ceae49a-6f9c-4dd0-900b-67afb9ea53fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c97b283205304f388495df09336b159c'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:22.702100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8ceae49a-6f9c-4dd0-900b-67afb9ea53fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c97b283205304f388495df09336b159c'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:22.714162 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8ceae49a-6f9c-4dd0-900b-67afb9ea53fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c97b283205304f388495df09336b159c'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:22.721056 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8ceae49a-6f9c-4dd0-900b-67afb9ea53fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c97b283205304f388495df09336b159c'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:22.730183 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:22.738124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1058/2131] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:22 2022] DELETE /identity/v3/users/c97b283205304f388495df09336b159c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:23.195514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b506f-b69d-4811-ac44-70626f1b1044 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:23.196966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-415b506f-b69d-4811-ac44-70626f1b1044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:23.211949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b506f-b69d-4811-ac44-70626f1b1044 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:23.290807 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056907d7-71c3-456c-9f77-51b512a62676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:23.292006 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056907d7-71c3-456c-9f77-51b512a62676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:23.292392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056907d7-71c3-456c-9f77-51b512a62676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:23.292779 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056907d7-71c3-456c-9f77-51b512a62676 admin admin] PATH_INFO: `/v3/projects/ef0d2fedcf144bc0905c05a5e36b11f8` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:23.294578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056907d7-71c3-456c-9f77-51b512a62676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef0d2fedcf144bc0905c05a5e36b11f8)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:23.297372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056907d7-71c3-456c-9f77-51b512a62676 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:23.361461 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-056907d7-71c3-456c-9f77-51b512a62676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef0d2fedcf144bc0905c05a5e36b11f8', 'request_id': 'req-056907d7-71c3-456c-9f77-51b512a62676'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:23.369433 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-056907d7-71c3-456c-9f77-51b512a62676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef0d2fedcf144bc0905c05a5e36b11f8', 'request_id': 'req-056907d7-71c3-456c-9f77-51b512a62676'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:23.381032 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-056907d7-71c3-456c-9f77-51b512a62676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef0d2fedcf144bc0905c05a5e36b11f8', 'request_id': 'req-056907d7-71c3-456c-9f77-51b512a62676'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:23.418145 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-056907d7-71c3-456c-9f77-51b512a62676 admin admin] The token cache is being invalidate because project ef0d2fedcf144bc0905c05a5e36b11f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:23.418520 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-056907d7-71c3-456c-9f77-51b512a62676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:23.419337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-056907d7-71c3-456c-9f77-51b512a62676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:23.420997 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1074/2132] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:23 2022] DELETE /identity/v3/projects/ef0d2fedcf144bc0905c05a5e36b11f8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:23.425864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5121f5d-99b4-423a-a66c-566cec85b6b8 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:23.426151 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5121f5d-99b4-423a-a66c-566cec85b6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:23.426428 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5121f5d-99b4-423a-a66c-566cec85b6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:23.448350 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-c5121f5d-99b4-423a-a66c-566cec85b6b8 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:23.449420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c5121f5d-99b4-423a-a66c-566cec85b6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:23.535214 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1059/2133] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:23.536820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df65cd-c772-4a7d-be0b-8f8da00c0776 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:23.537666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df65cd-c772-4a7d-be0b-8f8da00c0776 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:23.538065 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df65cd-c772-4a7d-be0b-8f8da00c0776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:23.558091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-d6df65cd-c772-4a7d-be0b-8f8da00c0776 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:23.559346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d6df65cd-c772-4a7d-be0b-8f8da00c0776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:23.571192 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1075/2134] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:23.572405 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5121f5d-99b4-423a-a66c-566cec85b6b8 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:23.587146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5121f5d-99b4-423a-a66c-566cec85b6b8 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:23.594255 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b07a6-2195-4f48-88f5-b02f498885d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:23.594935 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b07a6-2195-4f48-88f5-b02f498885d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:23.595226 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b07a6-2195-4f48-88f5-b02f498885d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:23.595873 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b07a6-2195-4f48-88f5-b02f498885d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:23.596544 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b07a6-2195-4f48-88f5-b02f498885d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:37:23.596856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b07a6-2195-4f48-88f5-b02f498885d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:23.600476 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b07a6-2195-4f48-88f5-b02f498885d9 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:23.615073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1060/2135] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:37:23.619659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df65cd-c772-4a7d-be0b-8f8da00c0776 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:23.631440 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:23.637134 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df65cd-c772-4a7d-be0b-8f8da00c0776 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:23.649214 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97497e3-fac7-4d4b-aa1e-587d66201b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:23.649982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97497e3-fac7-4d4b-aa1e-587d66201b85 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:23.650277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97497e3-fac7-4d4b-aa1e-587d66201b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:23.650561 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97497e3-fac7-4d4b-aa1e-587d66201b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:23.657157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97497e3-fac7-4d4b-aa1e-587d66201b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:23.659280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97497e3-fac7-4d4b-aa1e-587d66201b85 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:23.705369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1076/2136] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:23 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:23.709313 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b07a6-2195-4f48-88f5-b02f498885d9 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:23.722511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b07a6-2195-4f48-88f5-b02f498885d9 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:23.849599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69e675-c026-41a4-9626-34732f3c8e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:23.850736 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69e675-c026-41a4-9626-34732f3c8e7e admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:23.851079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69e675-c026-41a4-9626-34732f3c8e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:23.851785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69e675-c026-41a4-9626-34732f3c8e7e admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:23.852072 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69e675-c026-41a4-9626-34732f3c8e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:23.854148 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69e675-c026-41a4-9626-34732f3c8e7e admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:23.878741 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1061/2137] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:23 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:23.883435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97497e3-fac7-4d4b-aa1e-587d66201b85 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:23.911817 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97497e3-fac7-4d4b-aa1e-587d66201b85 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:23.923309 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8c00f-95c7-457d-8f19-1315aa2a7c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:23.923937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c00f-95c7-457d-8f19-1315aa2a7c8e admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:23.924217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c00f-95c7-457d-8f19-1315aa2a7c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:23.924491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c00f-95c7-457d-8f19-1315aa2a7c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:23.925144 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8c00f-95c7-457d-8f19-1315aa2a7c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:23.932180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8c00f-95c7-457d-8f19-1315aa2a7c8e admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:23.950302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1077/2138] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:23.956647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69e675-c026-41a4-9626-34732f3c8e7e admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:23.972039 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69e675-c026-41a4-9626-34732f3c8e7e admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:23.978787 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5170fb-e7a7-495c-ac4a-57f6ebdb6792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:23.979567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5170fb-e7a7-495c-ac4a-57f6ebdb6792 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:23.979930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5170fb-e7a7-495c-ac4a-57f6ebdb6792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:23.980383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5170fb-e7a7-495c-ac4a-57f6ebdb6792 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:23.981441 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5170fb-e7a7-495c-ac4a-57f6ebdb6792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:23.984345 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5170fb-e7a7-495c-ac4a-57f6ebdb6792 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:24.009431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1062/2139] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:24.013939 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8c00f-95c7-457d-8f19-1315aa2a7c8e admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:24.024487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8c00f-95c7-457d-8f19-1315aa2a7c8e admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:24.029451 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3705a6-7ce0-4869-b8d3-beb00fb75543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:24.030178 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3705a6-7ce0-4869-b8d3-beb00fb75543 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:24.030678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3705a6-7ce0-4869-b8d3-beb00fb75543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:24.030950 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3705a6-7ce0-4869-b8d3-beb00fb75543 admin admin] PATH_INFO: `/v3/projects/0b295feab19143d89746bc5e6060cbc6/users/93d8b431feed4b6383a9743c4c0d4710/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:24.051832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3705a6-7ce0-4869-b8d3-beb00fb75543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b295feab19143d89746bc5e6060cbc6, user_id=93d8b431feed4b6383a9743c4c0d4710, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:24.054557 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3705a6-7ce0-4869-b8d3-beb00fb75543 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:24.071792 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1078/2140] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:24 2022] PUT /identity/v3/projects/0b295feab19143d89746bc5e6060cbc6/users/93d8b431feed4b6383a9743c4c0d4710/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:37:24.082289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e647-b213-4c00-8120-4941ce1e4bd7 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:24.082674 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e647-b213-4c00-8120-4941ce1e4bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:24.083057 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e647-b213-4c00-8120-4941ce1e4bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:24.121096 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-6094e647-b213-4c00-8120-4941ce1e4bd7 None None] MFA Rules not processed for user `93d8b431feed4b6383a9743c4c0d4710`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:24.122691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6094e647-b213-4c00-8120-4941ce1e4bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:24.285573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:24.306819 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1063/2141] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:24.310201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3705a6-7ce0-4869-b8d3-beb00fb75543 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:24.403616 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3705a6-7ce0-4869-b8d3-beb00fb75543 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:24.417815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d824fc-c2fb-4e61-9332-98fba3605503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:24.418568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d824fc-c2fb-4e61-9332-98fba3605503 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:24.419112 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d824fc-c2fb-4e61-9332-98fba3605503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:24.419388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d824fc-c2fb-4e61-9332-98fba3605503 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:24.420281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d824fc-c2fb-4e61-9332-98fba3605503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:24.422509 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d824fc-c2fb-4e61-9332-98fba3605503 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:24.454873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1079/2142] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:24 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:24.457363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094e647-b213-4c00-8120-4941ce1e4bd7 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:24.477431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094e647-b213-4c00-8120-4941ce1e4bd7 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:24.588817 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803858e9-f936-4b2a-a43c-789799c9ee46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:24.589495 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803858e9-f936-4b2a-a43c-789799c9ee46 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:24.589759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803858e9-f936-4b2a-a43c-789799c9ee46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:24.590012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803858e9-f936-4b2a-a43c-789799c9ee46 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:24.590606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803858e9-f936-4b2a-a43c-789799c9ee46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:24.592699 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803858e9-f936-4b2a-a43c-789799c9ee46 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:24.622109 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1064/2143] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:24 2022] POST /identity/v3/users => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:24.626962 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d824fc-c2fb-4e61-9332-98fba3605503 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:24.643090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d824fc-c2fb-4e61-9332-98fba3605503 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:24.648991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5f966-2c54-4f5b-bcd4-fa9518a98c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:24.649756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5f966-2c54-4f5b-bcd4-fa9518a98c75 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:24.650045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5f966-2c54-4f5b-bcd4-fa9518a98c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:24.650336 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5f966-2c54-4f5b-bcd4-fa9518a98c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:24.651018 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5f966-2c54-4f5b-bcd4-fa9518a98c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:24.652601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5f966-2c54-4f5b-bcd4-fa9518a98c75 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:24.666858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1080/2144] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:24.669619 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803858e9-f936-4b2a-a43c-789799c9ee46 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:24.682700 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803858e9-f936-4b2a-a43c-789799c9ee46 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:24.689225 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77f9a0-0f71-4c61-95d4-8556560a3246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:24.690475 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77f9a0-0f71-4c61-95d4-8556560a3246 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:24.690851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77f9a0-0f71-4c61-95d4-8556560a3246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:24.691159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77f9a0-0f71-4c61-95d4-8556560a3246 admin admin] PATH_INFO: `/v3/projects/35601a017a05488fbaa9e8351223ab95/users/f83c0eed7e6545209465705b544e0a58/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:24.710008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77f9a0-0f71-4c61-95d4-8556560a3246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35601a017a05488fbaa9e8351223ab95, user_id=f83c0eed7e6545209465705b544e0a58, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:24.712748 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77f9a0-0f71-4c61-95d4-8556560a3246 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:24.732475 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1065/2145] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:24 2022] PUT /identity/v3/projects/35601a017a05488fbaa9e8351223ab95/users/f83c0eed7e6545209465705b544e0a58/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:24.736645 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5f966-2c54-4f5b-bcd4-fa9518a98c75 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:24.747245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5f966-2c54-4f5b-bcd4-fa9518a98c75 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:24.806049 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06f9f0-8e58-4cb3-9edd-f99ead821edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:24.806677 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06f9f0-8e58-4cb3-9edd-f99ead821edf admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:24.806984 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06f9f0-8e58-4cb3-9edd-f99ead821edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:24.807264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06f9f0-8e58-4cb3-9edd-f99ead821edf admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:24.807889 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06f9f0-8e58-4cb3-9edd-f99ead821edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:24.809447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06f9f0-8e58-4cb3-9edd-f99ead821edf admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:24.823062 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1081/2146] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:24.824110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77f9a0-0f71-4c61-95d4-8556560a3246 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:24.834371 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77f9a0-0f71-4c61-95d4-8556560a3246 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:24.839186 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537002a-7542-4be6-955b-55e02c4b7a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:24.839823 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537002a-7542-4be6-955b-55e02c4b7a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:24.840098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537002a-7542-4be6-955b-55e02c4b7a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:24.840394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537002a-7542-4be6-955b-55e02c4b7a91 admin admin] PATH_INFO: `/v3/projects/35601a017a05488fbaa9e8351223ab95/users/f83c0eed7e6545209465705b544e0a58/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:24.842392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537002a-7542-4be6-955b-55e02c4b7a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35601a017a05488fbaa9e8351223ab95, user_id=f83c0eed7e6545209465705b544e0a58, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:24.845024 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537002a-7542-4be6-955b-55e02c4b7a91 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:24.855437 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1066/2147] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:24 2022] PUT /identity/v3/projects/35601a017a05488fbaa9e8351223ab95/users/f83c0eed7e6545209465705b544e0a58/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:24.867450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264bf83-0e5d-4706-95d9-5b65ba2c29f2 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:24.867799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264bf83-0e5d-4706-95d9-5b65ba2c29f2 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:24.868143 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264bf83-0e5d-4706-95d9-5b65ba2c29f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:24.897466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-6264bf83-0e5d-4706-95d9-5b65ba2c29f2 None None] MFA Rules not processed for user `f83c0eed7e6545209465705b544e0a58`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:24.898658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6264bf83-0e5d-4706-95d9-5b65ba2c29f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:24.903870 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:24.953794 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537002a-7542-4be6-955b-55e02c4b7a91 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:24.955547 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f537002a-7542-4be6-955b-55e02c4b7a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:24.976891 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1082/2148] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:24 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:24.988503 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264bf83-0e5d-4706-95d9-5b65ba2c29f2 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:24.991431 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6264bf83-0e5d-4706-95d9-5b65ba2c29f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:25.030249 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537002a-7542-4be6-955b-55e02c4b7a91 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:25.035246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d32a8-445d-4052-aa5e-e3c5bdca8f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:25.035878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d32a8-445d-4052-aa5e-e3c5bdca8f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:25.036573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d32a8-445d-4052-aa5e-e3c5bdca8f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:25.036573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d32a8-445d-4052-aa5e-e3c5bdca8f8d admin admin] PATH_INFO: `/v3/users/f930be8cacf84cf0b67bf1982d86f00e` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:25.038159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d32a8-445d-4052-aa5e-e3c5bdca8f8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f930be8cacf84cf0b67bf1982d86f00e)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:25.040443 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d32a8-445d-4052-aa5e-e3c5bdca8f8d admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:25.057343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264bf83-0e5d-4706-95d9-5b65ba2c29f2 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:25.064697 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85960abb-571c-4bd4-8df7-974c7798a059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:25.066020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85960abb-571c-4bd4-8df7-974c7798a059 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:25.066332 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85960abb-571c-4bd4-8df7-974c7798a059 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:25.066605 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85960abb-571c-4bd4-8df7-974c7798a059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:25.079599 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85960abb-571c-4bd4-8df7-974c7798a059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:25.081315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85960abb-571c-4bd4-8df7-974c7798a059 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:25.095327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1083/2149] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:37:25.104055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-427d32a8-445d-4052-aa5e-e3c5bdca8f8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f930be8cacf84cf0b67bf1982d86f00e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:25.105047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-427d32a8-445d-4052-aa5e-e3c5bdca8f8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f930be8cacf84cf0b67bf1982d86f00e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:25.106013 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-427d32a8-445d-4052-aa5e-e3c5bdca8f8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f930be8cacf84cf0b67bf1982d86f00e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:25.107726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:25.124824 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-427d32a8-445d-4052-aa5e-e3c5bdca8f8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f930be8cacf84cf0b67bf1982d86f00e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:25.135084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-427d32a8-445d-4052-aa5e-e3c5bdca8f8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f930be8cacf84cf0b67bf1982d86f00e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:25.155167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1067/2150] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:24 2022] DELETE /identity/v3/users/f930be8cacf84cf0b67bf1982d86f00e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:37:25.159100 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981b21d-05b2-4aba-a179-674c5da05de6 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:25.159564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981b21d-05b2-4aba-a179-674c5da05de6 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:25.160081 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981b21d-05b2-4aba-a179-674c5da05de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:25.214782 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d32a8-445d-4052-aa5e-e3c5bdca8f8d admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:25.215872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-9981b21d-05b2-4aba-a179-674c5da05de6 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:25.216400 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-427d32a8-445d-4052-aa5e-e3c5bdca8f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:25.217397 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-9981b21d-05b2-4aba-a179-674c5da05de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:25.308815 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d32a8-445d-4052-aa5e-e3c5bdca8f8d admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:25.312727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880788b-7a45-48aa-9e96-6fec81f24191 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:25.313795 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880788b-7a45-48aa-9e96-6fec81f24191 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:25.314899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880788b-7a45-48aa-9e96-6fec81f24191 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:25.315185 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880788b-7a45-48aa-9e96-6fec81f24191 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:25.317407 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a880788b-7a45-48aa-9e96-6fec81f24191 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:25.358620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1084/2151] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:25.374678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981b21d-05b2-4aba-a179-674c5da05de6 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:25.376432 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-9981b21d-05b2-4aba-a179-674c5da05de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:25.451170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880788b-7a45-48aa-9e96-6fec81f24191 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:25.452260 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:25.452605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880788b-7a45-48aa-9e96-6fec81f24191 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:25.458736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981b21d-05b2-4aba-a179-674c5da05de6 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:25.465572 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1068/2152] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:25.465770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac13ac-56b6-40f7-b272-a01d8a2c7752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:25.465770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac13ac-56b6-40f7-b272-a01d8a2c7752 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:25.465770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac13ac-56b6-40f7-b272-a01d8a2c7752 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:25.465770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac13ac-56b6-40f7-b272-a01d8a2c7752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:25.476296 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac13ac-56b6-40f7-b272-a01d8a2c7752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:25.478172 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac13ac-56b6-40f7-b272-a01d8a2c7752 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:25.491008 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1085/2153] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:37:25.853743 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880788b-7a45-48aa-9e96-6fec81f24191 service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:25.855267 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a880788b-7a45-48aa-9e96-6fec81f24191 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:25.870309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880788b-7a45-48aa-9e96-6fec81f24191 service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:25.876202 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60bcfc-cb34-4c85-be30-ad50c4457542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:25.877065 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60bcfc-cb34-4c85-be30-ad50c4457542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:25.877305 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60bcfc-cb34-4c85-be30-ad50c4457542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:25.877646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60bcfc-cb34-4c85-be30-ad50c4457542 admin admin] PATH_INFO: `/v3/projects/df9a4464c20b4d51abec96e5bd918a6c` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:25.889654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60bcfc-cb34-4c85-be30-ad50c4457542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df9a4464c20b4d51abec96e5bd918a6c)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:25.892461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60bcfc-cb34-4c85-be30-ad50c4457542 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:25.964575 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-2c60bcfc-cb34-4c85-be30-ad50c4457542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df9a4464c20b4d51abec96e5bd918a6c', 'request_id': 'req-2c60bcfc-cb34-4c85-be30-ad50c4457542'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:25.976154 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-2c60bcfc-cb34-4c85-be30-ad50c4457542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df9a4464c20b4d51abec96e5bd918a6c', 'request_id': 'req-2c60bcfc-cb34-4c85-be30-ad50c4457542'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:25.992657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-2c60bcfc-cb34-4c85-be30-ad50c4457542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df9a4464c20b4d51abec96e5bd918a6c', 'request_id': 'req-2c60bcfc-cb34-4c85-be30-ad50c4457542'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:26.016985 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-2c60bcfc-cb34-4c85-be30-ad50c4457542 admin admin] The token cache is being invalidate because project df9a4464c20b4d51abec96e5bd918a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:26.017860 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-2c60bcfc-cb34-4c85-be30-ad50c4457542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:26.019721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-2c60bcfc-cb34-4c85-be30-ad50c4457542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:26.031643 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1069/2154] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:25 2022] DELETE /identity/v3/projects/df9a4464c20b4d51abec96e5bd918a6c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:26.042080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac13ac-56b6-40f7-b272-a01d8a2c7752 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:26.055039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac13ac-56b6-40f7-b272-a01d8a2c7752 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:26.135449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c1b8e-da30-4ba4-8a99-aa41033dca49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:26.136067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c1b8e-da30-4ba4-8a99-aa41033dca49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:26.136342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c1b8e-da30-4ba4-8a99-aa41033dca49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:26.136622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c1b8e-da30-4ba4-8a99-aa41033dca49 admin admin] PATH_INFO: `/v3/users/952935d6adf64b66a6766362706b7e89` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:26.138019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c1b8e-da30-4ba4-8a99-aa41033dca49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=952935d6adf64b66a6766362706b7e89)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:26.140177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c1b8e-da30-4ba4-8a99-aa41033dca49 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:26.164435 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60bcfc-cb34-4c85-be30-ad50c4457542 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:26.166693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2c60bcfc-cb34-4c85-be30-ad50c4457542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:26.176520 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:26.186758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60bcfc-cb34-4c85-be30-ad50c4457542 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:26.193770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f1300-1638-4416-b5ad-44bfa649b4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:26.194559 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f1300-1638-4416-b5ad-44bfa649b4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:26.195000 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f1300-1638-4416-b5ad-44bfa649b4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:26.195439 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f1300-1638-4416-b5ad-44bfa649b4f7 admin admin] PATH_INFO: `/v3/users/93d8b431feed4b6383a9743c4c0d4710` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:26.197020 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f1300-1638-4416-b5ad-44bfa649b4f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93d8b431feed4b6383a9743c4c0d4710)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:26.200485 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f1300-1638-4416-b5ad-44bfa649b4f7 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:26.203845 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-bc1c1b8e-da30-4ba4-8a99-aa41033dca49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '952935d6adf64b66a6766362706b7e89'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:26.204558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-bc1c1b8e-da30-4ba4-8a99-aa41033dca49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '952935d6adf64b66a6766362706b7e89'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:26.205207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-bc1c1b8e-da30-4ba4-8a99-aa41033dca49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '952935d6adf64b66a6766362706b7e89'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:26.219039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-bc1c1b8e-da30-4ba4-8a99-aa41033dca49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '952935d6adf64b66a6766362706b7e89'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:26.226654 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-bc1c1b8e-da30-4ba4-8a99-aa41033dca49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '952935d6adf64b66a6766362706b7e89'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:26.242143 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1086/2155] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:26 2022] DELETE /identity/v3/users/952935d6adf64b66a6766362706b7e89 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:26.249595 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c52f1300-1638-4416-b5ad-44bfa649b4f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93d8b431feed4b6383a9743c4c0d4710'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:26.250251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c52f1300-1638-4416-b5ad-44bfa649b4f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93d8b431feed4b6383a9743c4c0d4710'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:26.250886 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c52f1300-1638-4416-b5ad-44bfa649b4f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93d8b431feed4b6383a9743c4c0d4710'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:26.265169 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c52f1300-1638-4416-b5ad-44bfa649b4f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93d8b431feed4b6383a9743c4c0d4710'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:26.275188 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c52f1300-1638-4416-b5ad-44bfa649b4f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93d8b431feed4b6383a9743c4c0d4710'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:26.294470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1070/2156] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:26 2022] DELETE /identity/v3/users/93d8b431feed4b6383a9743c4c0d4710 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:26.300193 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a070f-bfb1-460d-b80c-34e69d2e3b39 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:26.301563 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a070f-bfb1-460d-b80c-34e69d2e3b39 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:26.301917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a070f-bfb1-460d-b80c-34e69d2e3b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:26.325410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-215a070f-bfb1-460d-b80c-34e69d2e3b39 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:26.326639 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-215a070f-bfb1-460d-b80c-34e69d2e3b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:26.403550 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1087/2157] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:37:26.422936 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f1300-1638-4416-b5ad-44bfa649b4f7 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:26.424459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c52f1300-1638-4416-b5ad-44bfa649b4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:26.520043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f1300-1638-4416-b5ad-44bfa649b4f7 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:26.527445 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87c1a0-166b-44a6-9321-beea94d582b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:26.528992 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87c1a0-166b-44a6-9321-beea94d582b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:26.531838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87c1a0-166b-44a6-9321-beea94d582b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:26.532206 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87c1a0-166b-44a6-9321-beea94d582b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:26.544256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87c1a0-166b-44a6-9321-beea94d582b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:26.546253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87c1a0-166b-44a6-9321-beea94d582b3 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:26.561387 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1071/2158] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:26.649594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a070f-bfb1-460d-b80c-34e69d2e3b39 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:26.651438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-215a070f-bfb1-460d-b80c-34e69d2e3b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:26.668098 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a070f-bfb1-460d-b80c-34e69d2e3b39 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:26.679838 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdec7f-0851-4d22-b069-caa0f3a3ee7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:26.682164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdec7f-0851-4d22-b069-caa0f3a3ee7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:26.682848 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdec7f-0851-4d22-b069-caa0f3a3ee7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:26.683704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdec7f-0851-4d22-b069-caa0f3a3ee7b admin admin] PATH_INFO: `/v3/projects/e4754bd9047f4aa08e9d6d23fefdbec9` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:26.686475 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdec7f-0851-4d22-b069-caa0f3a3ee7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4754bd9047f4aa08e9d6d23fefdbec9)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:26.689504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdec7f-0851-4d22-b069-caa0f3a3ee7b admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:26.711430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:26.805815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8abdec7f-0851-4d22-b069-caa0f3a3ee7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4754bd9047f4aa08e9d6d23fefdbec9', 'request_id': 'req-8abdec7f-0851-4d22-b069-caa0f3a3ee7b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:26.812566 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8abdec7f-0851-4d22-b069-caa0f3a3ee7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4754bd9047f4aa08e9d6d23fefdbec9', 'request_id': 'req-8abdec7f-0851-4d22-b069-caa0f3a3ee7b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:26.827358 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8abdec7f-0851-4d22-b069-caa0f3a3ee7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4754bd9047f4aa08e9d6d23fefdbec9', 'request_id': 'req-8abdec7f-0851-4d22-b069-caa0f3a3ee7b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:26.846067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8abdec7f-0851-4d22-b069-caa0f3a3ee7b admin admin] The token cache is being invalidate because project e4754bd9047f4aa08e9d6d23fefdbec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:26.846525 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8abdec7f-0851-4d22-b069-caa0f3a3ee7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:26.847394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8abdec7f-0851-4d22-b069-caa0f3a3ee7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:26.853896 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1088/2159] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:26 2022] DELETE /identity/v3/projects/e4754bd9047f4aa08e9d6d23fefdbec9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:26.854925 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fef518-3ac8-47c6-850d-11b3d860b761 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:26.856052 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fef518-3ac8-47c6-850d-11b3d860b761 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:26.856330 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fef518-3ac8-47c6-850d-11b3d860b761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:26.879434 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-e1fef518-3ac8-47c6-850d-11b3d860b761 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:26.882420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e1fef518-3ac8-47c6-850d-11b3d860b761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:26.965971 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1072/2160] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:26.973469 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544090c-2472-4ef5-b777-5e1ba245af15 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:26.973754 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544090c-2472-4ef5-b777-5e1ba245af15 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:26.974029 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544090c-2472-4ef5-b777-5e1ba245af15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:27.033201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-d544090c-2472-4ef5-b777-5e1ba245af15 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:27.033799 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fef518-3ac8-47c6-850d-11b3d860b761 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:27.035245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d544090c-2472-4ef5-b777-5e1ba245af15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:27.035860 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e1fef518-3ac8-47c6-850d-11b3d860b761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:27.071150 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fef518-3ac8-47c6-850d-11b3d860b761 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:27.073362 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1089/2161] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:27.086880 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544090c-2472-4ef5-b777-5e1ba245af15 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:27.092413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b58d1-9af8-431d-9f27-974870586528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:27.092413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b58d1-9af8-431d-9f27-974870586528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:27.092835 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b58d1-9af8-431d-9f27-974870586528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:27.093219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b58d1-9af8-431d-9f27-974870586528 admin admin] PATH_INFO: `/v3/projects/0b295feab19143d89746bc5e6060cbc6` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:27.093369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544090c-2472-4ef5-b777-5e1ba245af15 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:27.094870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b58d1-9af8-431d-9f27-974870586528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b295feab19143d89746bc5e6060cbc6)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:27.097181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b58d1-9af8-431d-9f27-974870586528 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:27.117676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db4a73-5e5e-41b9-b9a9-8e9e13bc7d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:27.119089 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db4a73-5e5e-41b9-b9a9-8e9e13bc7d46 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:27.119436 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db4a73-5e5e-41b9-b9a9-8e9e13bc7d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:27.120410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db4a73-5e5e-41b9-b9a9-8e9e13bc7d46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:27.121936 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db4a73-5e5e-41b9-b9a9-8e9e13bc7d46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:37:27.122248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db4a73-5e5e-41b9-b9a9-8e9e13bc7d46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:27.123864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db4a73-5e5e-41b9-b9a9-8e9e13bc7d46 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:27.126694 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:27.159845 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1090/2162] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:37:27.166289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db4a73-5e5e-41b9-b9a9-8e9e13bc7d46 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:27.182792 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db4a73-5e5e-41b9-b9a9-8e9e13bc7d46 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:27.200090 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f4a91-891d-414f-979f-9b54f8ca6025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:27.202423 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f4a91-891d-414f-979f-9b54f8ca6025 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:27.202700 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f4a91-891d-414f-979f-9b54f8ca6025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:27.203002 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f4a91-891d-414f-979f-9b54f8ca6025 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:27.203670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f4a91-891d-414f-979f-9b54f8ca6025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:27.206165 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f4a91-891d-414f-979f-9b54f8ca6025 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:27.212341 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-013b58d1-9af8-431d-9f27-974870586528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b295feab19143d89746bc5e6060cbc6', 'request_id': 'req-013b58d1-9af8-431d-9f27-974870586528'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:27.220876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-013b58d1-9af8-431d-9f27-974870586528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b295feab19143d89746bc5e6060cbc6', 'request_id': 'req-013b58d1-9af8-431d-9f27-974870586528'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:27.235089 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-013b58d1-9af8-431d-9f27-974870586528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b295feab19143d89746bc5e6060cbc6', 'request_id': 'req-013b58d1-9af8-431d-9f27-974870586528'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:27.249572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1091/2163] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:27 2022] POST /identity/v3/projects => generated 361 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:27.250792 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f4a91-891d-414f-979f-9b54f8ca6025 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:27.264584 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-013b58d1-9af8-431d-9f27-974870586528 admin admin] The token cache is being invalidate because project 0b295feab19143d89746bc5e6060cbc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:27.264876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-013b58d1-9af8-431d-9f27-974870586528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:27.266061 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-013b58d1-9af8-431d-9f27-974870586528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:27.267880 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1073/2164] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:27 2022] DELETE /identity/v3/projects/0b295feab19143d89746bc5e6060cbc6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:37:27.273263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b58d1-9af8-431d-9f27-974870586528 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:27.274875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-013b58d1-9af8-431d-9f27-974870586528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:27.339658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f4a91-891d-414f-979f-9b54f8ca6025 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:27.345873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1b23f-00f9-4773-862a-e1400cc15359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:27.346707 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1b23f-00f9-4773-862a-e1400cc15359 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:27.347149 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1b23f-00f9-4773-862a-e1400cc15359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:27.347449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1b23f-00f9-4773-862a-e1400cc15359 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:27.348144 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1b23f-00f9-4773-862a-e1400cc15359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:27.350753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1b23f-00f9-4773-862a-e1400cc15359 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:27.369126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b58d1-9af8-431d-9f27-974870586528 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:27.377468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1092/2165] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:27 2022] POST /identity/v3/users => generated 281 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:27.379161 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea5a59-fe41-47a7-9b4e-c8da0693bdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:27.379914 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea5a59-fe41-47a7-9b4e-c8da0693bdb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:27.380216 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea5a59-fe41-47a7-9b4e-c8da0693bdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:27.380921 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea5a59-fe41-47a7-9b4e-c8da0693bdb3 admin admin] PATH_INFO: `/v3/users/f83c0eed7e6545209465705b544e0a58` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:27.382123 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1b23f-00f9-4773-862a-e1400cc15359 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:27.382257 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea5a59-fe41-47a7-9b4e-c8da0693bdb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83c0eed7e6545209465705b544e0a58)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:27.384089 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-72b1b23f-00f9-4773-862a-e1400cc15359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:27.384449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea5a59-fe41-47a7-9b4e-c8da0693bdb3 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:27.406300 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1b23f-00f9-4773-862a-e1400cc15359 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:27.421419 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386274e-db90-4a8d-9c4d-d9784a8dd49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:27.422554 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386274e-db90-4a8d-9c4d-d9784a8dd49f admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:27.430900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386274e-db90-4a8d-9c4d-d9784a8dd49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:27.430900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386274e-db90-4a8d-9c4d-d9784a8dd49f admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:27.430900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386274e-db90-4a8d-9c4d-d9784a8dd49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:27.430900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386274e-db90-4a8d-9c4d-d9784a8dd49f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:27.456164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1093/2166] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:27.460152 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386274e-db90-4a8d-9c4d-d9784a8dd49f admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:27.481120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b7ea5a59-fe41-47a7-9b4e-c8da0693bdb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83c0eed7e6545209465705b544e0a58'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:27.483344 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b7ea5a59-fe41-47a7-9b4e-c8da0693bdb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83c0eed7e6545209465705b544e0a58'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:27.483998 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b7ea5a59-fe41-47a7-9b4e-c8da0693bdb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83c0eed7e6545209465705b544e0a58'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:27.484130 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386274e-db90-4a8d-9c4d-d9784a8dd49f admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:27.490235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b2354-85ca-4314-8997-58c7254f95ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:27.490235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b2354-85ca-4314-8997-58c7254f95ff admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:27.490235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b2354-85ca-4314-8997-58c7254f95ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:27.490235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b2354-85ca-4314-8997-58c7254f95ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:27.490916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b2354-85ca-4314-8997-58c7254f95ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:27.492453 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b2354-85ca-4314-8997-58c7254f95ff admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:27.504775 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b7ea5a59-fe41-47a7-9b4e-c8da0693bdb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83c0eed7e6545209465705b544e0a58'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:27.516553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1094/2167] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:27.520300 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b2354-85ca-4314-8997-58c7254f95ff admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:27.535828 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-960b2354-85ca-4314-8997-58c7254f95ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:27.546724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b7ea5a59-fe41-47a7-9b4e-c8da0693bdb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83c0eed7e6545209465705b544e0a58'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:27.562324 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b2354-85ca-4314-8997-58c7254f95ff admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:27.568580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7f2ba-153f-490f-98cb-c870a138c657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:27.570191 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7f2ba-153f-490f-98cb-c870a138c657 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:27.571339 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7f2ba-153f-490f-98cb-c870a138c657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:27.571831 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7f2ba-153f-490f-98cb-c870a138c657 admin admin] PATH_INFO: `/v3/projects/c3e88d44043840b8a0d64136d418d18e/users/135051232ac544db951edcf2dd37d346/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:27.581227 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1074/2168] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:27 2022] DELETE /identity/v3/users/f83c0eed7e6545209465705b544e0a58 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:27.597147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7f2ba-153f-490f-98cb-c870a138c657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e88d44043840b8a0d64136d418d18e, user_id=135051232ac544db951edcf2dd37d346, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:27.601347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7f2ba-153f-490f-98cb-c870a138c657 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:27.604593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:27.627141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1095/2169] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:27 2022] PUT /identity/v3/projects/c3e88d44043840b8a0d64136d418d18e/users/135051232ac544db951edcf2dd37d346/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:27.639447 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084253b-d46b-4318-90dc-d24a5ae7d473 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:27.639653 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084253b-d46b-4318-90dc-d24a5ae7d473 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:27.639900 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084253b-d46b-4318-90dc-d24a5ae7d473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:27.679465 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7f2ba-153f-490f-98cb-c870a138c657 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:27.681639 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-eac7f2ba-153f-490f-98cb-c870a138c657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:27.688014 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-a084253b-d46b-4318-90dc-d24a5ae7d473 None None] MFA Rules not processed for user `135051232ac544db951edcf2dd37d346`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:27.690042 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a084253b-d46b-4318-90dc-d24a5ae7d473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:27.703389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:27.747763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7f2ba-153f-490f-98cb-c870a138c657 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:27.751654 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f96d9-3b40-4c31-8fad-b51cc97cefb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:27.752157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f96d9-3b40-4c31-8fad-b51cc97cefb9 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:27.752443 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f96d9-3b40-4c31-8fad-b51cc97cefb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:27.752721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f96d9-3b40-4c31-8fad-b51cc97cefb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:27.757168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e08f96d9-3b40-4c31-8fad-b51cc97cefb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:27.785626 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1075/2170] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:27.844835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f96d9-3b40-4c31-8fad-b51cc97cefb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:27.846587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f96d9-3b40-4c31-8fad-b51cc97cefb9 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:27.858901 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1096/2171] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:28.167861 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084253b-d46b-4318-90dc-d24a5ae7d473 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:28.170375 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a084253b-d46b-4318-90dc-d24a5ae7d473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:28.231055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f96d9-3b40-4c31-8fad-b51cc97cefb9 service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:28.239445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f96d9-3b40-4c31-8fad-b51cc97cefb9 service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:28.244229 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc51a9d-3c29-47b4-8046-6624e31a61c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:28.246028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc51a9d-3c29-47b4-8046-6624e31a61c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:28.246626 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc51a9d-3c29-47b4-8046-6624e31a61c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:28.247047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc51a9d-3c29-47b4-8046-6624e31a61c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:28.278044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc51a9d-3c29-47b4-8046-6624e31a61c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:28.279786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc51a9d-3c29-47b4-8046-6624e31a61c1 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:28.296122 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1097/2172] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:28.298956 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084253b-d46b-4318-90dc-d24a5ae7d473 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:28.304343 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c315736-28e8-4e9c-917f-f3931ec10032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:28.304972 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c315736-28e8-4e9c-917f-f3931ec10032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:28.305248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c315736-28e8-4e9c-917f-f3931ec10032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:28.305519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c315736-28e8-4e9c-917f-f3931ec10032 admin admin] PATH_INFO: `/v3/projects/35601a017a05488fbaa9e8351223ab95` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:28.306929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c315736-28e8-4e9c-917f-f3931ec10032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35601a017a05488fbaa9e8351223ab95)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:28.308955 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c315736-28e8-4e9c-917f-f3931ec10032 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:28.314981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc51a9d-3c29-47b4-8046-6624e31a61c1 service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:28.336238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc51a9d-3c29-47b4-8046-6624e31a61c1 service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:28.354009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26358c-3e47-416a-b48e-425445e04a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:28.354761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26358c-3e47-416a-b48e-425445e04a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:28.355245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26358c-3e47-416a-b48e-425445e04a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:28.356146 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26358c-3e47-416a-b48e-425445e04a04 admin admin] PATH_INFO: `/v3/users/135051232ac544db951edcf2dd37d346` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:28.361106 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26358c-3e47-416a-b48e-425445e04a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=135051232ac544db951edcf2dd37d346)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:28.363428 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26358c-3e47-416a-b48e-425445e04a04 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:28.379180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-4c315736-28e8-4e9c-917f-f3931ec10032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35601a017a05488fbaa9e8351223ab95', 'request_id': 'req-4c315736-28e8-4e9c-917f-f3931ec10032'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:28.387305 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-4c315736-28e8-4e9c-917f-f3931ec10032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35601a017a05488fbaa9e8351223ab95', 'request_id': 'req-4c315736-28e8-4e9c-917f-f3931ec10032'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:28.397696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-4c315736-28e8-4e9c-917f-f3931ec10032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35601a017a05488fbaa9e8351223ab95', 'request_id': 'req-4c315736-28e8-4e9c-917f-f3931ec10032'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:28.424080 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-4c315736-28e8-4e9c-917f-f3931ec10032 admin admin] The token cache is being invalidate because project 35601a017a05488fbaa9e8351223ab95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:28.424727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-4c315736-28e8-4e9c-917f-f3931ec10032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:28.426056 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-4c315736-28e8-4e9c-917f-f3931ec10032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:28.432511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1076/2173] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:28 2022] DELETE /identity/v3/projects/35601a017a05488fbaa9e8351223ab95 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:28.435117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc87b8-e461-4928-a05d-5a0a2eee00e9 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:28.435491 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc87b8-e461-4928-a05d-5a0a2eee00e9 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:28.435856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc87b8-e461-4928-a05d-5a0a2eee00e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:28.461331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-68fc87b8-e461-4928-a05d-5a0a2eee00e9 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:28.462625 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-68fc87b8-e461-4928-a05d-5a0a2eee00e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:28.473896 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4e26358c-3e47-416a-b48e-425445e04a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '135051232ac544db951edcf2dd37d346'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:28.475524 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4e26358c-3e47-416a-b48e-425445e04a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '135051232ac544db951edcf2dd37d346'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:28.476352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4e26358c-3e47-416a-b48e-425445e04a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '135051232ac544db951edcf2dd37d346'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:28.498873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4e26358c-3e47-416a-b48e-425445e04a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '135051232ac544db951edcf2dd37d346'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:28.509110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4e26358c-3e47-416a-b48e-425445e04a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '135051232ac544db951edcf2dd37d346'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:28.521858 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:28.534545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1098/2174] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:28 2022] DELETE /identity/v3/users/135051232ac544db951edcf2dd37d346 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:37:28.539281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98c4a2-e04a-472b-813a-8588c7a7d5f9 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:28.540042 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98c4a2-e04a-472b-813a-8588c7a7d5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:28.540042 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98c4a2-e04a-472b-813a-8588c7a7d5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:28.547458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:28.568854 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-5b98c4a2-e04a-472b-813a-8588c7a7d5f9 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:28.570804 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-5b98c4a2-e04a-472b-813a-8588c7a7d5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:28.593979 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1077/2175] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:37:28.604181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177b294-01e5-4e34-913a-9df878551135 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:28.604476 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177b294-01e5-4e34-913a-9df878551135 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:28.604755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177b294-01e5-4e34-913a-9df878551135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:28.639465 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-d177b294-01e5-4e34-913a-9df878551135 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:28.640827 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d177b294-01e5-4e34-913a-9df878551135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:28.673132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1099/2176] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:28.684955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98c4a2-e04a-472b-813a-8588c7a7d5f9 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:28.686122 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-5b98c4a2-e04a-472b-813a-8588c7a7d5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:28.760657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1078/2177] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:28.761585 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177b294-01e5-4e34-913a-9df878551135 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:28.772931 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177b294-01e5-4e34-913a-9df878551135 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:28.778707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0c904-c85a-47bf-a5cb-d4494ba58309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:28.779783 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0c904-c85a-47bf-a5cb-d4494ba58309 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:28.780075 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0c904-c85a-47bf-a5cb-d4494ba58309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:28.780359 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0c904-c85a-47bf-a5cb-d4494ba58309 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:28.781065 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0c904-c85a-47bf-a5cb-d4494ba58309 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:37:28.781381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0c904-c85a-47bf-a5cb-d4494ba58309 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:28.784322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0c904-c85a-47bf-a5cb-d4494ba58309 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:28.797610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98c4a2-e04a-472b-813a-8588c7a7d5f9 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:28.812217 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1079/2178] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:37:28.813118 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1ed8-94ee-4604-8656-d7a2a655bfed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:28.813680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0c904-c85a-47bf-a5cb-d4494ba58309 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:28.814094 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1ed8-94ee-4604-8656-d7a2a655bfed service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:28.814618 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1ed8-94ee-4604-8656-d7a2a655bfed service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:28.815031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1ed8-94ee-4604-8656-d7a2a655bfed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:28.828371 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0c904-c85a-47bf-a5cb-d4494ba58309 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:28.829538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c1ed8-94ee-4604-8656-d7a2a655bfed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:28.831272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c1ed8-94ee-4604-8656-d7a2a655bfed service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:28.833769 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33349e70-74e6-4838-b4d7-c554d89a310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:28.834788 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33349e70-74e6-4838-b4d7-c554d89a310c admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:28.835124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33349e70-74e6-4838-b4d7-c554d89a310c admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:28.835398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33349e70-74e6-4838-b4d7-c554d89a310c admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:28.836099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33349e70-74e6-4838-b4d7-c554d89a310c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:28.839366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33349e70-74e6-4838-b4d7-c554d89a310c admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:28.845015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1100/2179] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:28.882156 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1080/2180] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:28 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:28.883295 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1ed8-94ee-4604-8656-d7a2a655bfed service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:28.894790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1ed8-94ee-4604-8656-d7a2a655bfed service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:29.011086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e70ac-3cc4-4402-9b53-d37327e49eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:29.011935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e70ac-3cc4-4402-9b53-d37327e49eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:29.012265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e70ac-3cc4-4402-9b53-d37327e49eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:29.012539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e70ac-3cc4-4402-9b53-d37327e49eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:29.013181 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e70ac-3cc4-4402-9b53-d37327e49eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:29.015985 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e70ac-3cc4-4402-9b53-d37327e49eb3 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:29.049547 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1101/2181] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:28 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:37:29.050709 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33349e70-74e6-4838-b4d7-c554d89a310c admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:29.063240 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33349e70-74e6-4838-b4d7-c554d89a310c admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:29.069690 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb53022-3b87-4610-95a4-ba37a64170fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:29.070351 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb53022-3b87-4610-95a4-ba37a64170fc admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:29.070629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb53022-3b87-4610-95a4-ba37a64170fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:29.071388 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb53022-3b87-4610-95a4-ba37a64170fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:29.072220 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb53022-3b87-4610-95a4-ba37a64170fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:29.075134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb53022-3b87-4610-95a4-ba37a64170fc admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:29.096142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1081/2182] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:29.097119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e70ac-3cc4-4402-9b53-d37327e49eb3 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:29.125008 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e70ac-3cc4-4402-9b53-d37327e49eb3 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:29.145539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc4811-6d0b-4020-8a33-f85f25b3833f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:29.146161 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc4811-6d0b-4020-8a33-f85f25b3833f admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:29.147077 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc4811-6d0b-4020-8a33-f85f25b3833f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:29.147497 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc4811-6d0b-4020-8a33-f85f25b3833f admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:29.148161 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc4811-6d0b-4020-8a33-f85f25b3833f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:29.150566 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc4811-6d0b-4020-8a33-f85f25b3833f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:29.164808 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1102/2183] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:37:29.171829 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb53022-3b87-4610-95a4-ba37a64170fc admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:29.185500 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb53022-3b87-4610-95a4-ba37a64170fc admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:29.193026 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286614e1-e619-4fe3-941e-26977c50afdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:29.193820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286614e1-e619-4fe3-941e-26977c50afdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:29.194471 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286614e1-e619-4fe3-941e-26977c50afdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:29.194738 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286614e1-e619-4fe3-941e-26977c50afdb admin admin] PATH_INFO: `/v3/projects/12c738bca7684e7080a813298f871e6b/users/68a3c387ee6743bf910d8a5b988ff609/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:29.212597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286614e1-e619-4fe3-941e-26977c50afdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c738bca7684e7080a813298f871e6b, user_id=68a3c387ee6743bf910d8a5b988ff609, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:29.215951 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286614e1-e619-4fe3-941e-26977c50afdb admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:29.244114 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1082/2184] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:29 2022] PUT /identity/v3/projects/12c738bca7684e7080a813298f871e6b/users/68a3c387ee6743bf910d8a5b988ff609/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:29.256483 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f6cd6-deb7-4fb3-8a1c-de31e2aff69b None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:29.256808 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f6cd6-deb7-4fb3-8a1c-de31e2aff69b None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:29.260958 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f6cd6-deb7-4fb3-8a1c-de31e2aff69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:29.320209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-b14f6cd6-deb7-4fb3-8a1c-de31e2aff69b None None] MFA Rules not processed for user `68a3c387ee6743bf910d8a5b988ff609`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:29.321594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b14f6cd6-deb7-4fb3-8a1c-de31e2aff69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:29.349957 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:29.485053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1103/2185] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:29.500137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286614e1-e619-4fe3-941e-26977c50afdb admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:29.501696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-286614e1-e619-4fe3-941e-26977c50afdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:29.698206 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286614e1-e619-4fe3-941e-26977c50afdb admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:29.705881 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5208bd0-a24b-4ad8-97ba-1fc95024e2ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15538b95acef435798ff7651fc1710cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:29.706939 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5208bd0-a24b-4ad8-97ba-1fc95024e2ef service glance] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:29.707813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5208bd0-a24b-4ad8-97ba-1fc95024e2ef service glance] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:29.708132 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5208bd0-a24b-4ad8-97ba-1fc95024e2ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:29.738389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:29.742726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5208bd0-a24b-4ad8-97ba-1fc95024e2ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:29.744720 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5208bd0-a24b-4ad8-97ba-1fc95024e2ef service glance] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:29.757281 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1083/2186] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:29.914975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f6cd6-deb7-4fb3-8a1c-de31e2aff69b None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:29.916427 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b14f6cd6-deb7-4fb3-8a1c-de31e2aff69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:30.016600 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f6cd6-deb7-4fb3-8a1c-de31e2aff69b None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:30.029613 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39908d2c-79a5-450c-b131-11e220f87de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:30.030266 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39908d2c-79a5-450c-b131-11e220f87de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:30.030547 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39908d2c-79a5-450c-b131-11e220f87de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:30.030820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39908d2c-79a5-450c-b131-11e220f87de5 admin admin] PATH_INFO: `/v3/projects/c3e88d44043840b8a0d64136d418d18e` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:30.032986 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39908d2c-79a5-450c-b131-11e220f87de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3e88d44043840b8a0d64136d418d18e)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:30.035917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39908d2c-79a5-450c-b131-11e220f87de5 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:30.141478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-39908d2c-79a5-450c-b131-11e220f87de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e88d44043840b8a0d64136d418d18e', 'request_id': 'req-39908d2c-79a5-450c-b131-11e220f87de5'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:30.149084 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-39908d2c-79a5-450c-b131-11e220f87de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e88d44043840b8a0d64136d418d18e', 'request_id': 'req-39908d2c-79a5-450c-b131-11e220f87de5'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:30.155795 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-39908d2c-79a5-450c-b131-11e220f87de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e88d44043840b8a0d64136d418d18e', 'request_id': 'req-39908d2c-79a5-450c-b131-11e220f87de5'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:30.176897 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-39908d2c-79a5-450c-b131-11e220f87de5 admin admin] The token cache is being invalidate because project c3e88d44043840b8a0d64136d418d18e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:30.178110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-39908d2c-79a5-450c-b131-11e220f87de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:30.178816 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-39908d2c-79a5-450c-b131-11e220f87de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:30.181894 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1104/2187] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:29 2022] DELETE /identity/v3/projects/c3e88d44043840b8a0d64136d418d18e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:30.188245 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958413e-d832-4587-b730-ad3c6630b156 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:30.188707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958413e-d832-4587-b730-ad3c6630b156 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:30.189525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958413e-d832-4587-b730-ad3c6630b156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:30.216859 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-4958413e-d832-4587-b730-ad3c6630b156 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:30.218871 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4958413e-d832-4587-b730-ad3c6630b156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:30.310210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1084/2188] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:30.318908 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c1a21-7687-4996-89d1-65a1b11f6e64 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:30.319302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c1a21-7687-4996-89d1-65a1b11f6e64 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:30.319595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c1a21-7687-4996-89d1-65a1b11f6e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:30.341644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-c18c1a21-7687-4996-89d1-65a1b11f6e64 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:30.343034 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c18c1a21-7687-4996-89d1-65a1b11f6e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:30.353407 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1105/2189] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:30.357864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958413e-d832-4587-b730-ad3c6630b156 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:30.369594 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958413e-d832-4587-b730-ad3c6630b156 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:30.374772 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea81435-18e0-410b-ad92-21ce0a5cef60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:30.385279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea81435-18e0-410b-ad92-21ce0a5cef60 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:30.385279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea81435-18e0-410b-ad92-21ce0a5cef60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:30.385279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea81435-18e0-410b-ad92-21ce0a5cef60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:30.385279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea81435-18e0-410b-ad92-21ce0a5cef60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:37:30.385279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea81435-18e0-410b-ad92-21ce0a5cef60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:30.385279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea81435-18e0-410b-ad92-21ce0a5cef60 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:30.393884 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1085/2190] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:37:30.399021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c1a21-7687-4996-89d1-65a1b11f6e64 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:30.417467 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c1a21-7687-4996-89d1-65a1b11f6e64 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:30.424079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f60e44-a6ab-48e3-a4b1-ee13d8f1f67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:30.424816 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f60e44-a6ab-48e3-a4b1-ee13d8f1f67e admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:30.425181 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f60e44-a6ab-48e3-a4b1-ee13d8f1f67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:30.425523 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f60e44-a6ab-48e3-a4b1-ee13d8f1f67e admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:30.426610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f60e44-a6ab-48e3-a4b1-ee13d8f1f67e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:30.431042 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f60e44-a6ab-48e3-a4b1-ee13d8f1f67e admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:30.470773 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1106/2191] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:30 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:37:30.476291 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea81435-18e0-410b-ad92-21ce0a5cef60 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:30.499142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea81435-18e0-410b-ad92-21ce0a5cef60 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:30.594249 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a393d7-e21c-4b3d-aebd-9891b4dffca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:30.595109 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a393d7-e21c-4b3d-aebd-9891b4dffca3 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:30.595523 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a393d7-e21c-4b3d-aebd-9891b4dffca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:30.595901 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a393d7-e21c-4b3d-aebd-9891b4dffca3 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:30.596705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a393d7-e21c-4b3d-aebd-9891b4dffca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:30.598762 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a393d7-e21c-4b3d-aebd-9891b4dffca3 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:30.624940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1086/2192] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:30 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:30.628828 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f60e44-a6ab-48e3-a4b1-ee13d8f1f67e admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:30.640627 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f60e44-a6ab-48e3-a4b1-ee13d8f1f67e admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:30.647772 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee95a7-7cd4-422f-bc91-cedf3aec9cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:30.648389 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee95a7-7cd4-422f-bc91-cedf3aec9cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:30.648760 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee95a7-7cd4-422f-bc91-cedf3aec9cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:30.649092 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee95a7-7cd4-422f-bc91-cedf3aec9cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:30.649882 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee95a7-7cd4-422f-bc91-cedf3aec9cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:30.651704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee95a7-7cd4-422f-bc91-cedf3aec9cf5 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:30.663515 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1107/2193] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:37:30.667504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a393d7-e21c-4b3d-aebd-9891b4dffca3 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:30.686532 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a393d7-e21c-4b3d-aebd-9891b4dffca3 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:30.691601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40d2a2-50dc-4376-8c1e-7a5df8ba8f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:30.692247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40d2a2-50dc-4376-8c1e-7a5df8ba8f7c admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:30.692646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40d2a2-50dc-4376-8c1e-7a5df8ba8f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:30.693285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40d2a2-50dc-4376-8c1e-7a5df8ba8f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:30.694314 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40d2a2-50dc-4376-8c1e-7a5df8ba8f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:30.695959 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40d2a2-50dc-4376-8c1e-7a5df8ba8f7c admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:30.714993 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1087/2194] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:30.716601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee95a7-7cd4-422f-bc91-cedf3aec9cf5 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:30.731075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:30.737622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee95a7-7cd4-422f-bc91-cedf3aec9cf5 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:30.766932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e928173-fdd4-4eae-9972-edbd8944bbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:30.768015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e928173-fdd4-4eae-9972-edbd8944bbb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:30.768504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e928173-fdd4-4eae-9972-edbd8944bbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:30.768998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e928173-fdd4-4eae-9972-edbd8944bbb9 admin admin] PATH_INFO: `/v3/projects/931911ffff004685ab249ef1f1bba875/users/ee68463434bd4ef2854a34585ca48ae7/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:30.797212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e928173-fdd4-4eae-9972-edbd8944bbb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=931911ffff004685ab249ef1f1bba875, user_id=ee68463434bd4ef2854a34585ca48ae7, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:30.800180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e928173-fdd4-4eae-9972-edbd8944bbb9 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:30.821826 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1108/2195] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:30 2022] PUT /identity/v3/projects/931911ffff004685ab249ef1f1bba875/users/ee68463434bd4ef2854a34585ca48ae7/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:30.832378 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967822c2-25a4-4ad8-9aa2-61a1d8c84f62 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:30.832734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967822c2-25a4-4ad8-9aa2-61a1d8c84f62 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:30.833012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967822c2-25a4-4ad8-9aa2-61a1d8c84f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:30.889361 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-967822c2-25a4-4ad8-9aa2-61a1d8c84f62 None None] MFA Rules not processed for user `ee68463434bd4ef2854a34585ca48ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:30.890520 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-967822c2-25a4-4ad8-9aa2-61a1d8c84f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:31.001697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:31.026093 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1088/2196] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:31.040115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e928173-fdd4-4eae-9972-edbd8944bbb9 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:31.047636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4e928173-fdd4-4eae-9972-edbd8944bbb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:31.161033 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e928173-fdd4-4eae-9972-edbd8944bbb9 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:31.168545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe4614-8518-47ba-ada4-4bb648cdf9aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:31.169397 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe4614-8518-47ba-ada4-4bb648cdf9aa service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:31.175577 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe4614-8518-47ba-ada4-4bb648cdf9aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:31.175947 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe4614-8518-47ba-ada4-4bb648cdf9aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:31.196418 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe4614-8518-47ba-ada4-4bb648cdf9aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:31.199445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe4614-8518-47ba-ada4-4bb648cdf9aa service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:31.224060 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1109/2197] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:33.361676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ce239-c3c5-4328-bd87-af28d4fbaf11 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:33.362549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ce239-c3c5-4328-bd87-af28d4fbaf11 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:33.362892 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ce239-c3c5-4328-bd87-af28d4fbaf11 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:33.364228 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1089/2198] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 26 01:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:37:33.379425 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c7036-5063-4d8c-9aa9-8a956d1a0fbc None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:33.379954 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c7036-5063-4d8c-9aa9-8a956d1a0fbc None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:33.380143 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c7036-5063-4d8c-9aa9-8a956d1a0fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:33.400897 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-9e1c7036-5063-4d8c-9aa9-8a956d1a0fbc None None] MFA Rules not processed for user `df7a1b839a6f4bdb9870217fa4d2527c`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:33.402274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-9e1c7036-5063-4d8c-9aa9-8a956d1a0fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:33.442946 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ce239-c3c5-4328-bd87-af28d4fbaf11 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:33.444973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-647ce239-c3c5-4328-bd87-af28d4fbaf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:33.485210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1110/2199] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 26 01:37:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:33.496761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c7036-5063-4d8c-9aa9-8a956d1a0fbc None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:33.498115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-9e1c7036-5063-4d8c-9aa9-8a956d1a0fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:33.512144 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c7036-5063-4d8c-9aa9-8a956d1a0fbc None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:33.517667 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ce239-c3c5-4328-bd87-af28d4fbaf11 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:33.518216 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074957f-6be0-427a-bee9-c01709b508cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7a1b839a6f4bdb9870217fa4d2527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:33.518836 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074957f-6be0-427a-bee9-c01709b508cb service placement] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:33.519163 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074957f-6be0-427a-bee9-c01709b508cb service placement] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:33.519438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074957f-6be0-427a-bee9-c01709b508cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:33.523281 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba1436-c60d-429d-8c3b-41ac69f20617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:33.523910 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba1436-c60d-429d-8c3b-41ac69f20617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:33.524193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba1436-c60d-429d-8c3b-41ac69f20617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:33.524460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba1436-c60d-429d-8c3b-41ac69f20617 admin admin] PATH_INFO: `/v3/users/33b264f4cc3c4eac8944e7e2f34370f5` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:33.525628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba1436-c60d-429d-8c3b-41ac69f20617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b264f4cc3c4eac8944e7e2f34370f5)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:33.527646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba1436-c60d-429d-8c3b-41ac69f20617 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:33.535789 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074957f-6be0-427a-bee9-c01709b508cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:33.537703 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074957f-6be0-427a-bee9-c01709b508cb service placement] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:33.549656 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1111/2200] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:37:33.593827 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6dba1436-c60d-429d-8c3b-41ac69f20617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b264f4cc3c4eac8944e7e2f34370f5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:33.594491 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6dba1436-c60d-429d-8c3b-41ac69f20617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b264f4cc3c4eac8944e7e2f34370f5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:33.595414 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6dba1436-c60d-429d-8c3b-41ac69f20617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b264f4cc3c4eac8944e7e2f34370f5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:33.617807 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6dba1436-c60d-429d-8c3b-41ac69f20617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b264f4cc3c4eac8944e7e2f34370f5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:33.632768 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6dba1436-c60d-429d-8c3b-41ac69f20617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b264f4cc3c4eac8944e7e2f34370f5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:33.664864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1090/2201] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:33 2022] DELETE /identity/v3/users/33b264f4cc3c4eac8944e7e2f34370f5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:33.824038 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074957f-6be0-427a-bee9-c01709b508cb service placement] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:33.826086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e074957f-6be0-427a-bee9-c01709b508cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:33.845708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074957f-6be0-427a-bee9-c01709b508cb service placement] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:33.901578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba1436-c60d-429d-8c3b-41ac69f20617 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:33.903099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6dba1436-c60d-429d-8c3b-41ac69f20617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:33.969821 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8051ec-6a68-4f87-9f30-ef06e33676cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:33.971095 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8051ec-6a68-4f87-9f30-ef06e33676cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:33.971494 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8051ec-6a68-4f87-9f30-ef06e33676cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:33.971902 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8051ec-6a68-4f87-9f30-ef06e33676cb admin admin] PATH_INFO: `/v3/users/27b40187eabd46f2897b9c16fe828eab` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:33.973404 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8051ec-6a68-4f87-9f30-ef06e33676cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=27b40187eabd46f2897b9c16fe828eab)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:33.975797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8051ec-6a68-4f87-9f30-ef06e33676cb admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:33.983125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:34.041572 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba1436-c60d-429d-8c3b-41ac69f20617 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:34.046470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a3efb-d176-4524-9e18-1b3aab4d0882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:34.047369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a3efb-d176-4524-9e18-1b3aab4d0882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:34.047964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a3efb-d176-4524-9e18-1b3aab4d0882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:34.048240 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a3efb-d176-4524-9e18-1b3aab4d0882 admin admin] PATH_INFO: `/v3/projects/23355a519b7648bc98a112b2a2f2cec4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:34.049901 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-3c8051ec-6a68-4f87-9f30-ef06e33676cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27b40187eabd46f2897b9c16fe828eab'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.050121 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a3efb-d176-4524-9e18-1b3aab4d0882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23355a519b7648bc98a112b2a2f2cec4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:34.050672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-3c8051ec-6a68-4f87-9f30-ef06e33676cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27b40187eabd46f2897b9c16fe828eab'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.051380 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-3c8051ec-6a68-4f87-9f30-ef06e33676cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27b40187eabd46f2897b9c16fe828eab'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.052272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a3efb-d176-4524-9e18-1b3aab4d0882 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:34.064250 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:34.065465 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-3c8051ec-6a68-4f87-9f30-ef06e33676cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27b40187eabd46f2897b9c16fe828eab'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.074375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-3c8051ec-6a68-4f87-9f30-ef06e33676cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27b40187eabd46f2897b9c16fe828eab'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.089474 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1112/2202] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:33 2022] DELETE /identity/v3/users/27b40187eabd46f2897b9c16fe828eab => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:34.093824 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114b2e7-64dd-43a7-ae50-3731b1fa5ee2 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:34.094140 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114b2e7-64dd-43a7-ae50-3731b1fa5ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:34.094448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114b2e7-64dd-43a7-ae50-3731b1fa5ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:34.106221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-3c6a3efb-d176-4524-9e18-1b3aab4d0882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23355a519b7648bc98a112b2a2f2cec4', 'request_id': 'req-3c6a3efb-d176-4524-9e18-1b3aab4d0882'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.111870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-3c6a3efb-d176-4524-9e18-1b3aab4d0882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23355a519b7648bc98a112b2a2f2cec4', 'request_id': 'req-3c6a3efb-d176-4524-9e18-1b3aab4d0882'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.115974 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-6114b2e7-64dd-43a7-ae50-3731b1fa5ee2 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:34.117188 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6114b2e7-64dd-43a7-ae50-3731b1fa5ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:34.118584 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-3c6a3efb-d176-4524-9e18-1b3aab4d0882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23355a519b7648bc98a112b2a2f2cec4', 'request_id': 'req-3c6a3efb-d176-4524-9e18-1b3aab4d0882'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.133419 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-3c6a3efb-d176-4524-9e18-1b3aab4d0882 admin admin] The token cache is being invalidate because project 23355a519b7648bc98a112b2a2f2cec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:34.133419 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-3c6a3efb-d176-4524-9e18-1b3aab4d0882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.133647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-3c6a3efb-d176-4524-9e18-1b3aab4d0882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.135415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1091/2203] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:33 2022] DELETE /identity/v3/projects/23355a519b7648bc98a112b2a2f2cec4 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:37:34.140417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0c36f-2a92-45d7-b4c5-ea0c577b197e None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:34.140699 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0c36f-2a92-45d7-b4c5-ea0c577b197e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:34.141018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0c36f-2a92-45d7-b4c5-ea0c577b197e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:34.165917 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-f7c0c36f-2a92-45d7-b4c5-ea0c577b197e None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:34.167425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f7c0c36f-2a92-45d7-b4c5-ea0c577b197e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:34.188052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1113/2204] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:37:34.188891 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114b2e7-64dd-43a7-ae50-3731b1fa5ee2 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:34.190148 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6114b2e7-64dd-43a7-ae50-3731b1fa5ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:34.202210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114b2e7-64dd-43a7-ae50-3731b1fa5ee2 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:34.207703 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649be14b-b49d-49a2-9833-378c7435a10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:34.208325 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649be14b-b49d-49a2-9833-378c7435a10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:34.208607 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649be14b-b49d-49a2-9833-378c7435a10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:34.208937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649be14b-b49d-49a2-9833-378c7435a10b admin admin] PATH_INFO: `/v3/users/ee68463434bd4ef2854a34585ca48ae7` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:34.210108 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649be14b-b49d-49a2-9833-378c7435a10b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee68463434bd4ef2854a34585ca48ae7)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:34.212129 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649be14b-b49d-49a2-9833-378c7435a10b admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:34.234294 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1092/2205] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:37:34.235172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0c36f-2a92-45d7-b4c5-ea0c577b197e None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:34.236424 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f7c0c36f-2a92-45d7-b4c5-ea0c577b197e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:34.266992 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-649be14b-b49d-49a2-9833-378c7435a10b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee68463434bd4ef2854a34585ca48ae7'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.267817 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-649be14b-b49d-49a2-9833-378c7435a10b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee68463434bd4ef2854a34585ca48ae7'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.268444 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-649be14b-b49d-49a2-9833-378c7435a10b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee68463434bd4ef2854a34585ca48ae7'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.284880 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-649be14b-b49d-49a2-9833-378c7435a10b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee68463434bd4ef2854a34585ca48ae7'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.292480 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-649be14b-b49d-49a2-9833-378c7435a10b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee68463434bd4ef2854a34585ca48ae7'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.296451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0c36f-2a92-45d7-b4c5-ea0c577b197e None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:34.300340 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80eb901-6aa0-407f-b32b-aa63a9ec5f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:34.300906 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eb901-6aa0-407f-b32b-aa63a9ec5f31 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:34.301210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eb901-6aa0-407f-b32b-aa63a9ec5f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:34.301491 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eb901-6aa0-407f-b32b-aa63a9ec5f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:34.301928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:34.304355 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c80eb901-6aa0-407f-b32b-aa63a9ec5f31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:34.311432 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1114/2206] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:34 2022] DELETE /identity/v3/users/ee68463434bd4ef2854a34585ca48ae7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:34.311432 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f3191-b574-4483-9d3e-0fc90a9eb6a9 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:34.311432 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f3191-b574-4483-9d3e-0fc90a9eb6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:34.311432 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f3191-b574-4483-9d3e-0fc90a9eb6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:34.316651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80eb901-6aa0-407f-b32b-aa63a9ec5f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:34.318138 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80eb901-6aa0-407f-b32b-aa63a9ec5f31 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:34.328006 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1093/2207] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:34.329215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d0dc3-2e7c-4e0b-ad86-72c0d8e46dec None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:34.329503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d0dc3-2e7c-4e0b-ad86-72c0d8e46dec None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:34.329776 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d0dc3-2e7c-4e0b-ad86-72c0d8e46dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:34.331954 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-737f3191-b574-4483-9d3e-0fc90a9eb6a9 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:34.335852 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-737f3191-b574-4483-9d3e-0fc90a9eb6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:34.352674 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-287d0dc3-2e7c-4e0b-ad86-72c0d8e46dec None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:34.353901 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-287d0dc3-2e7c-4e0b-ad86-72c0d8e46dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:34.410269 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:34.421293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1115/2208] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:34.426184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f3191-b574-4483-9d3e-0fc90a9eb6a9 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:34.437082 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f3191-b574-4483-9d3e-0fc90a9eb6a9 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:34.440363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1094/2209] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:34.443167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a8a92-18cb-41c8-abe2-2e0a1f02dc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:34.443740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8a92-18cb-41c8-abe2-2e0a1f02dc03 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:34.444101 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8a92-18cb-41c8-abe2-2e0a1f02dc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:34.444384 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8a92-18cb-41c8-abe2-2e0a1f02dc03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:34.445152 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a8a92-18cb-41c8-abe2-2e0a1f02dc03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:37:34.445561 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a8a92-18cb-41c8-abe2-2e0a1f02dc03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:34.447089 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a8a92-18cb-41c8-abe2-2e0a1f02dc03 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:34.454475 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d0dc3-2e7c-4e0b-ad86-72c0d8e46dec None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:34.455959 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-287d0dc3-2e7c-4e0b-ad86-72c0d8e46dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:34.463160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1116/2210] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:37:34.468609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a8a92-18cb-41c8-abe2-2e0a1f02dc03 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:34.482040 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a8a92-18cb-41c8-abe2-2e0a1f02dc03 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:34.487611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d2d55-65f5-4996-96f4-7556c2698d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:34.488209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d2d55-65f5-4996-96f4-7556c2698d74 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:34.488468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d2d55-65f5-4996-96f4-7556c2698d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:34.488738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d2d55-65f5-4996-96f4-7556c2698d74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:34.489387 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d2d55-65f5-4996-96f4-7556c2698d74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:34.505061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d2d55-65f5-4996-96f4-7556c2698d74 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:34.546886 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1117/2211] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:34 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:34.548868 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d2d55-65f5-4996-96f4-7556c2698d74 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:34.554203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d0dc3-2e7c-4e0b-ad86-72c0d8e46dec None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:34.641559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d2d55-65f5-4996-96f4-7556c2698d74 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:34.647200 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b5aeb-0058-4f01-b508-8c3668ba5822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:34.647882 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b5aeb-0058-4f01-b508-8c3668ba5822 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:34.648239 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b5aeb-0058-4f01-b508-8c3668ba5822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:34.648577 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b5aeb-0058-4f01-b508-8c3668ba5822 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:34.649313 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b5aeb-0058-4f01-b508-8c3668ba5822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:34.649841 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ace4c9-4c7c-48f5-9f6b-b7c56157d097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:34.650459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ace4c9-4c7c-48f5-9f6b-b7c56157d097 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:34.650718 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ace4c9-4c7c-48f5-9f6b-b7c56157d097 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:34.651067 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ace4c9-4c7c-48f5-9f6b-b7c56157d097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:34.651664 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b5aeb-0058-4f01-b508-8c3668ba5822 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:34.671606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ace4c9-4c7c-48f5-9f6b-b7c56157d097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:34.673755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ace4c9-4c7c-48f5-9f6b-b7c56157d097 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:34.691107 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1095/2212] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:34.691107 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ace4c9-4c7c-48f5-9f6b-b7c56157d097 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:34.692363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1118/2213] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:34 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:37:34.692484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e9ace4c9-4c7c-48f5-9f6b-b7c56157d097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:34.694079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b5aeb-0058-4f01-b508-8c3668ba5822 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:34.711306 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ace4c9-4c7c-48f5-9f6b-b7c56157d097 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:34.713156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b5aeb-0058-4f01-b508-8c3668ba5822 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:34.717785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223e8f1-df19-41a4-8ad1-72e76413b8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:34.718615 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223e8f1-df19-41a4-8ad1-72e76413b8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:34.718991 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223e8f1-df19-41a4-8ad1-72e76413b8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:34.719235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d5d67-9fb8-486a-8d62-2d64107eecb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:34.719374 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223e8f1-df19-41a4-8ad1-72e76413b8fd admin admin] PATH_INFO: `/v3/projects/591b412b583440ccb1ea8a8bf132657d` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:34.719979 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d5d67-9fb8-486a-8d62-2d64107eecb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:34.720257 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d5d67-9fb8-486a-8d62-2d64107eecb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:34.720538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d5d67-9fb8-486a-8d62-2d64107eecb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:34.721190 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d5d67-9fb8-486a-8d62-2d64107eecb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:34.721994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223e8f1-df19-41a4-8ad1-72e76413b8fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=591b412b583440ccb1ea8a8bf132657d)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:34.722766 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d5d67-9fb8-486a-8d62-2d64107eecb4 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:34.724459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223e8f1-df19-41a4-8ad1-72e76413b8fd admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:34.736270 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1119/2214] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:34.749959 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d5d67-9fb8-486a-8d62-2d64107eecb4 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:34.777005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d5d67-9fb8-486a-8d62-2d64107eecb4 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:34.796675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c223e8f1-df19-41a4-8ad1-72e76413b8fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '591b412b583440ccb1ea8a8bf132657d', 'request_id': 'req-c223e8f1-df19-41a4-8ad1-72e76413b8fd'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.803416 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c223e8f1-df19-41a4-8ad1-72e76413b8fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '591b412b583440ccb1ea8a8bf132657d', 'request_id': 'req-c223e8f1-df19-41a4-8ad1-72e76413b8fd'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.811685 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c223e8f1-df19-41a4-8ad1-72e76413b8fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '591b412b583440ccb1ea8a8bf132657d', 'request_id': 'req-c223e8f1-df19-41a4-8ad1-72e76413b8fd'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.835203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c223e8f1-df19-41a4-8ad1-72e76413b8fd admin admin] The token cache is being invalidate because project 591b412b583440ccb1ea8a8bf132657d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:34.835495 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c223e8f1-df19-41a4-8ad1-72e76413b8fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.836187 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c223e8f1-df19-41a4-8ad1-72e76413b8fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:34.847269 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1096/2215] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:34 2022] DELETE /identity/v3/projects/591b412b583440ccb1ea8a8bf132657d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:34.847718 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:34.850876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa5399-656b-4898-9de7-4946a90d2580 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:34.850876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa5399-656b-4898-9de7-4946a90d2580 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:34.850876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa5399-656b-4898-9de7-4946a90d2580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:34.875556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0298f1-09c3-4b6b-a2cd-08020d7ea7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:34.876405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0298f1-09c3-4b6b-a2cd-08020d7ea7ca admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:34.876883 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0298f1-09c3-4b6b-a2cd-08020d7ea7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:34.877252 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0298f1-09c3-4b6b-a2cd-08020d7ea7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:34.877689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-f8aa5399-656b-4898-9de7-4946a90d2580 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:34.878790 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0298f1-09c3-4b6b-a2cd-08020d7ea7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:34.883895 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0298f1-09c3-4b6b-a2cd-08020d7ea7ca admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:34.885598 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f8aa5399-656b-4898-9de7-4946a90d2580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:34.894901 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1097/2216] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:34.902685 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1120/2217] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:34.905985 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0a612-6ffb-46d6-980d-a1dec8228f23 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:34.906298 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0a612-6ffb-46d6-980d-a1dec8228f23 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:34.906593 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0a612-6ffb-46d6-980d-a1dec8228f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:34.907903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0298f1-09c3-4b6b-a2cd-08020d7ea7ca admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:34.910228 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-db0298f1-09c3-4b6b-a2cd-08020d7ea7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:34.928622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0298f1-09c3-4b6b-a2cd-08020d7ea7ca admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:34.930325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-8ac0a612-6ffb-46d6-980d-a1dec8228f23 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:34.931878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8ac0a612-6ffb-46d6-980d-a1dec8228f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:34.933834 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fa639-d6a2-4f03-aab6-8375f33602f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:34.934603 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fa639-d6a2-4f03-aab6-8375f33602f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:34.934996 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fa639-d6a2-4f03-aab6-8375f33602f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:34.935343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fa639-d6a2-4f03-aab6-8375f33602f6 admin admin] PATH_INFO: `/v3/projects/52832793efa441adb8b69af641a4b127/users/148b0d6aee584ecab139cf93e8d32578/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:34.946067 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1098/2218] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:37:34.947102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0a612-6ffb-46d6-980d-a1dec8228f23 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:34.955563 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fa639-d6a2-4f03-aab6-8375f33602f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52832793efa441adb8b69af641a4b127, user_id=148b0d6aee584ecab139cf93e8d32578, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:34.960703 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0a612-6ffb-46d6-980d-a1dec8228f23 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:34.963144 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fa639-d6a2-4f03-aab6-8375f33602f6 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:34.965626 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc176adf-58a6-4590-bf3d-93a6ef7393ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:34.966424 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc176adf-58a6-4590-bf3d-93a6ef7393ef admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:34.967127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc176adf-58a6-4590-bf3d-93a6ef7393ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:34.967507 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc176adf-58a6-4590-bf3d-93a6ef7393ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:34.968229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc176adf-58a6-4590-bf3d-93a6ef7393ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:37:34.968600 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc176adf-58a6-4590-bf3d-93a6ef7393ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:34.972357 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc176adf-58a6-4590-bf3d-93a6ef7393ef admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:34.980795 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:34.982765 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1121/2219] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:34 2022] PUT /identity/v3/projects/52832793efa441adb8b69af641a4b127/users/148b0d6aee584ecab139cf93e8d32578/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:34.990338 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1099/2220] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:37:34.991464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59cac8-13f8-40c4-b017-03f2dc210886 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:34.991950 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59cac8-13f8-40c4-b017-03f2dc210886 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:34.992629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59cac8-13f8-40c4-b017-03f2dc210886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:34.997495 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc176adf-58a6-4590-bf3d-93a6ef7393ef admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:35.015549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-ef59cac8-13f8-40c4-b017-03f2dc210886 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:35.017020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-ef59cac8-13f8-40c4-b017-03f2dc210886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:35.023700 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc176adf-58a6-4590-bf3d-93a6ef7393ef admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:35.129062 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1122/2221] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:37:35.144440 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59cac8-13f8-40c4-b017-03f2dc210886 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:35.149193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b6e3a-d4fb-4288-a68d-fff4bdae1187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:35.149942 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b6e3a-d4fb-4288-a68d-fff4bdae1187 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:35.150322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b6e3a-d4fb-4288-a68d-fff4bdae1187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:35.150695 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b6e3a-d4fb-4288-a68d-fff4bdae1187 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:35.151681 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b6e3a-d4fb-4288-a68d-fff4bdae1187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:35.154265 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b6e3a-d4fb-4288-a68d-fff4bdae1187 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:35.168530 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-ef59cac8-13f8-40c4-b017-03f2dc210886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:35.181928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59cac8-13f8-40c4-b017-03f2dc210886 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:35.195513 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1100/2222] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:34 2022] POST /identity/v3/projects => generated 371 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:35.195661 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71095bf-2fad-4000-ac6c-650012f2c637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:35.200263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71095bf-2fad-4000-ac6c-650012f2c637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:35.200263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71095bf-2fad-4000-ac6c-650012f2c637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:35.200263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71095bf-2fad-4000-ac6c-650012f2c637 admin admin] PATH_INFO: `/v3/projects/931911ffff004685ab249ef1f1bba875` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:35.200263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71095bf-2fad-4000-ac6c-650012f2c637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=931911ffff004685ab249ef1f1bba875)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:35.200676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b6e3a-d4fb-4288-a68d-fff4bdae1187 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:35.201031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71095bf-2fad-4000-ac6c-650012f2c637 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:35.202225 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f71b6e3a-d4fb-4288-a68d-fff4bdae1187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:35.261114 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-e71095bf-2fad-4000-ac6c-650012f2c637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '931911ffff004685ab249ef1f1bba875', 'request_id': 'req-e71095bf-2fad-4000-ac6c-650012f2c637'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:35.267660 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-e71095bf-2fad-4000-ac6c-650012f2c637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '931911ffff004685ab249ef1f1bba875', 'request_id': 'req-e71095bf-2fad-4000-ac6c-650012f2c637'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:35.268580 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b6e3a-d4fb-4288-a68d-fff4bdae1187 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:35.275017 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-e71095bf-2fad-4000-ac6c-650012f2c637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '931911ffff004685ab249ef1f1bba875', 'request_id': 'req-e71095bf-2fad-4000-ac6c-650012f2c637'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:35.294929 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-e71095bf-2fad-4000-ac6c-650012f2c637 admin admin] The token cache is being invalidate because project 931911ffff004685ab249ef1f1bba875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:35.295481 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-e71095bf-2fad-4000-ac6c-650012f2c637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:35.296929 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-e71095bf-2fad-4000-ac6c-650012f2c637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:35.299149 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1123/2223] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:35 2022] DELETE /identity/v3/projects/931911ffff004685ab249ef1f1bba875 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:35.308279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71095bf-2fad-4000-ac6c-650012f2c637 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:35.312909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e71095bf-2fad-4000-ac6c-650012f2c637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:35.342713 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6a4bf-d568-49e3-bb0a-79dda21c22c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:35.364508 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6a4bf-d568-49e3-bb0a-79dda21c22c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:35.365696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6a4bf-d568-49e3-bb0a-79dda21c22c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:35.367631 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6a4bf-d568-49e3-bb0a-79dda21c22c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:35.371776 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-60b6a4bf-d568-49e3-bb0a-79dda21c22c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:35.386406 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:35.432476 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71095bf-2fad-4000-ac6c-650012f2c637 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:35.437944 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af96a42-5e00-45f3-9b13-8be14fe03170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:35.438666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af96a42-5e00-45f3-9b13-8be14fe03170 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:35.439038 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af96a42-5e00-45f3-9b13-8be14fe03170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:35.439449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af96a42-5e00-45f3-9b13-8be14fe03170 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:35.440236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af96a42-5e00-45f3-9b13-8be14fe03170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:35.442250 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af96a42-5e00-45f3-9b13-8be14fe03170 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:35.465404 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:35.471589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1124/2224] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:35 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:35.476317 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af96a42-5e00-45f3-9b13-8be14fe03170 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:35.485846 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6a4bf-d568-49e3-bb0a-79dda21c22c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:35.487470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6a4bf-d568-49e3-bb0a-79dda21c22c5 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:35.488951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af96a42-5e00-45f3-9b13-8be14fe03170 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:35.494571 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb06e0-0555-4b66-89c6-33c9036da886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:35.495356 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb06e0-0555-4b66-89c6-33c9036da886 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:35.495639 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb06e0-0555-4b66-89c6-33c9036da886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:35.495983 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb06e0-0555-4b66-89c6-33c9036da886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:35.496922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb06e0-0555-4b66-89c6-33c9036da886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:35.498788 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1101/2225] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:35.499068 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb06e0-0555-4b66-89c6-33c9036da886 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:35.511196 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1125/2226] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:37:35.515616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6a4bf-d568-49e3-bb0a-79dda21c22c5 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:35.527187 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6a4bf-d568-49e3-bb0a-79dda21c22c5 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:35.532273 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d9d06-6c3b-4f02-afcd-224dfe71acf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:35.532890 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d9d06-6c3b-4f02-afcd-224dfe71acf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:35.533169 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d9d06-6c3b-4f02-afcd-224dfe71acf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:35.533444 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d9d06-6c3b-4f02-afcd-224dfe71acf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:35.534078 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d9d06-6c3b-4f02-afcd-224dfe71acf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:35.535729 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d9d06-6c3b-4f02-afcd-224dfe71acf6 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:35.546097 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1102/2227] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:35.550422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb06e0-0555-4b66-89c6-33c9036da886 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:35.560892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb06e0-0555-4b66-89c6-33c9036da886 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:35.566231 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4017a-f2b1-474c-884f-f31414ea2e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:35.566929 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4017a-f2b1-474c-884f-f31414ea2e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:35.567282 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4017a-f2b1-474c-884f-f31414ea2e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:35.567632 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4017a-f2b1-474c-884f-f31414ea2e22 admin admin] PATH_INFO: `/v3/projects/c3d973be917e4fd1bcadf1873766e466/users/bfafb0b4dd5c43e0add92a9eae7677b8/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:35.588302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4017a-f2b1-474c-884f-f31414ea2e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d973be917e4fd1bcadf1873766e466, user_id=bfafb0b4dd5c43e0add92a9eae7677b8, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:35.591042 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4017a-f2b1-474c-884f-f31414ea2e22 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:35.605178 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1126/2228] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:35 2022] PUT /identity/v3/projects/c3d973be917e4fd1bcadf1873766e466/users/bfafb0b4dd5c43e0add92a9eae7677b8/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:35.610644 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b92645-71df-4428-a043-3c85dfc4daaf None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:35.611232 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b92645-71df-4428-a043-3c85dfc4daaf None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:35.611577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b92645-71df-4428-a043-3c85dfc4daaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:35.632987 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-06b92645-71df-4428-a043-3c85dfc4daaf None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:35.634468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-06b92645-71df-4428-a043-3c85dfc4daaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:35.705415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1103/2229] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:35.715879 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4017a-f2b1-474c-884f-f31414ea2e22 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:35.717636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b9d4017a-f2b1-474c-884f-f31414ea2e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:35.787793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4017a-f2b1-474c-884f-f31414ea2e22 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:35.791737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646796d7-7f34-4e61-8745-04d5822ac96e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:35.792456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646796d7-7f34-4e61-8745-04d5822ac96e service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:35.792913 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646796d7-7f34-4e61-8745-04d5822ac96e service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:35.796873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646796d7-7f34-4e61-8745-04d5822ac96e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:35.811321 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646796d7-7f34-4e61-8745-04d5822ac96e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:35.811321 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646796d7-7f34-4e61-8745-04d5822ac96e service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:35.824795 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1127/2230] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:42.045516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198cc02-5ab6-4a80-96bd-336e12403412 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:42.046014 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198cc02-5ab6-4a80-96bd-336e12403412 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:42.046322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198cc02-5ab6-4a80-96bd-336e12403412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:42.086622 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-3198cc02-5ab6-4a80-96bd-336e12403412 None None] MFA Rules not processed for user `148b0d6aee584ecab139cf93e8d32578`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:42.088100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3198cc02-5ab6-4a80-96bd-336e12403412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:42.249567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1104/2231] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:42.265054 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646796d7-7f34-4e61-8745-04d5822ac96e service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:42.266495 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-646796d7-7f34-4e61-8745-04d5822ac96e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:42.492226 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646796d7-7f34-4e61-8745-04d5822ac96e service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:42.512916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b3ba3-f6ba-4998-baa5-71560b238b6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:42.514023 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b3ba3-f6ba-4998-baa5-71560b238b6e service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:42.514621 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b3ba3-f6ba-4998-baa5-71560b238b6e service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:42.515129 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b3ba3-f6ba-4998-baa5-71560b238b6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:42.540770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b3ba3-f6ba-4998-baa5-71560b238b6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:42.554494 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b3ba3-f6ba-4998-baa5-71560b238b6e service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:42.563312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1128/2232] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:42.695784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac12435-7377-4ee3-9f08-7a4af92e2d7d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:42.696554 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac12435-7377-4ee3-9f08-7a4af92e2d7d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:42.696913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac12435-7377-4ee3-9f08-7a4af92e2d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:42.766342 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-8ac12435-7377-4ee3-9f08-7a4af92e2d7d None None] MFA Rules not processed for user `bfafb0b4dd5c43e0add92a9eae7677b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:42.767754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8ac12435-7377-4ee3-9f08-7a4af92e2d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:42.964599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:43.009552 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1105/2233] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:43.012948 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b3ba3-f6ba-4998-baa5-71560b238b6e service nova] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:43.047510 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b3ba3-f6ba-4998-baa5-71560b238b6e service nova] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:43.055348 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced74ac-b0ca-436b-97e7-cc01d4f4d21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:43.057024 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced74ac-b0ca-436b-97e7-cc01d4f4d21a admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:43.057484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced74ac-b0ca-436b-97e7-cc01d4f4d21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:43.057907 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced74ac-b0ca-436b-97e7-cc01d4f4d21a admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:43.059009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced74ac-b0ca-436b-97e7-cc01d4f4d21a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:43.061403 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced74ac-b0ca-436b-97e7-cc01d4f4d21a admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:43.101965 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:43.116988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1129/2234] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:43 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:43.118215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac12435-7377-4ee3-9f08-7a4af92e2d7d None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:43.137072 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac12435-7377-4ee3-9f08-7a4af92e2d7d None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:43.245925 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be2573-0670-4555-97cf-9b3713b8339e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:43.246625 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be2573-0670-4555-97cf-9b3713b8339e admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:43.247285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be2573-0670-4555-97cf-9b3713b8339e admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:43.247723 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be2573-0670-4555-97cf-9b3713b8339e admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:43.248555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be2573-0670-4555-97cf-9b3713b8339e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:43.250586 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be2573-0670-4555-97cf-9b3713b8339e admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:43.305333 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1106/2235] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:43 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:37:43.311325 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced74ac-b0ca-436b-97e7-cc01d4f4d21a admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:43.325107 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced74ac-b0ca-436b-97e7-cc01d4f4d21a admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:43.352932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eeafa-03c8-4736-93b3-ab35fda63aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:43.353669 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eeafa-03c8-4736-93b3-ab35fda63aae admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:43.354077 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eeafa-03c8-4736-93b3-ab35fda63aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:43.355718 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eeafa-03c8-4736-93b3-ab35fda63aae admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:43.356562 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443eeafa-03c8-4736-93b3-ab35fda63aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:43.360097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443eeafa-03c8-4736-93b3-ab35fda63aae admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:43.377433 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1130/2236] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:43.378463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be2573-0670-4555-97cf-9b3713b8339e admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:43.394041 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be2573-0670-4555-97cf-9b3713b8339e admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:43.404782 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f04e0-70e0-40f2-81eb-901a1b8d5c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:43.405473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f04e0-70e0-40f2-81eb-901a1b8d5c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:43.405753 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f04e0-70e0-40f2-81eb-901a1b8d5c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:43.406027 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f04e0-70e0-40f2-81eb-901a1b8d5c3a admin admin] PATH_INFO: `/v3/projects/a5faf6bb04874abf99154ce87c40e780/users/de9e1efe97584046a0f92369d6a5ee00/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:43.449102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f04e0-70e0-40f2-81eb-901a1b8d5c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5faf6bb04874abf99154ce87c40e780, user_id=de9e1efe97584046a0f92369d6a5ee00, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:43.451556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f04e0-70e0-40f2-81eb-901a1b8d5c3a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:43.479915 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1107/2237] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:43 2022] PUT /identity/v3/projects/a5faf6bb04874abf99154ce87c40e780/users/de9e1efe97584046a0f92369d6a5ee00/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:43.484462 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eeafa-03c8-4736-93b3-ab35fda63aae admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:43.529144 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eeafa-03c8-4736-93b3-ab35fda63aae admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:43.665281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2fda4-dfb0-4474-b1c6-1e7c7e475a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:43.666135 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2fda4-dfb0-4474-b1c6-1e7c7e475a36 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:43.666498 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2fda4-dfb0-4474-b1c6-1e7c7e475a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:43.666777 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2fda4-dfb0-4474-b1c6-1e7c7e475a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:43.667496 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2fda4-dfb0-4474-b1c6-1e7c7e475a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:43.685022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2fda4-dfb0-4474-b1c6-1e7c7e475a36 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:43.713716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1131/2238] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:43.715788 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f04e0-70e0-40f2-81eb-901a1b8d5c3a admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:43.732469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f04e0-70e0-40f2-81eb-901a1b8d5c3a admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:43.741760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47655c8f-4be1-49ad-bc35-053dbf3ef50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:43.743181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655c8f-4be1-49ad-bc35-053dbf3ef50e admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:43.743910 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655c8f-4be1-49ad-bc35-053dbf3ef50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:43.744373 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655c8f-4be1-49ad-bc35-053dbf3ef50e admin admin] PATH_INFO: `/v3/projects/a5faf6bb04874abf99154ce87c40e780/users/de9e1efe97584046a0f92369d6a5ee00/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:43.746937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47655c8f-4be1-49ad-bc35-053dbf3ef50e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5faf6bb04874abf99154ce87c40e780, user_id=de9e1efe97584046a0f92369d6a5ee00, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:43.750194 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47655c8f-4be1-49ad-bc35-053dbf3ef50e admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:43.778920 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1108/2239] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:43 2022] PUT /identity/v3/projects/a5faf6bb04874abf99154ce87c40e780/users/de9e1efe97584046a0f92369d6a5ee00/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:45.449293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934a284-cad0-4325-b6fe-4d6df7ec0ae4 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:45.449811 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934a284-cad0-4325-b6fe-4d6df7ec0ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:45.449887 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934a284-cad0-4325-b6fe-4d6df7ec0ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:45.475807 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-7934a284-cad0-4325-b6fe-4d6df7ec0ae4 None None] MFA Rules not processed for user `148b0d6aee584ecab139cf93e8d32578`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:45.477130 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-7934a284-cad0-4325-b6fe-4d6df7ec0ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:45.551085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1132/2240] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:49.969467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33407674-e1a9-4cf7-9d3d-4ebc5e3391b6 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:49.969967 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33407674-e1a9-4cf7-9d3d-4ebc5e3391b6 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:49.970064 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33407674-e1a9-4cf7-9d3d-4ebc5e3391b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:50.037691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-33407674-e1a9-4cf7-9d3d-4ebc5e3391b6 None None] MFA Rules not processed for user `de9e1efe97584046a0f92369d6a5ee00`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:50.039675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-33407674-e1a9-4cf7-9d3d-4ebc5e3391b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:50.157967 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1109/2241] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:50.176836 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934a284-cad0-4325-b6fe-4d6df7ec0ae4 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:50.179057 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-7934a284-cad0-4325-b6fe-4d6df7ec0ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:50.443456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934a284-cad0-4325-b6fe-4d6df7ec0ae4 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:50.480603 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe91a2-00a6-43fe-a9ca-6fa59ccacb9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:50.485182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe91a2-00a6-43fe-a9ca-6fa59ccacb9b service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:50.485769 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe91a2-00a6-43fe-a9ca-6fa59ccacb9b service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:50.486259 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe91a2-00a6-43fe-a9ca-6fa59ccacb9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:50.526999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:50.654475 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe91a2-00a6-43fe-a9ca-6fa59ccacb9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:50.663651 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe91a2-00a6-43fe-a9ca-6fa59ccacb9b service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:50.693698 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1133/2242] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:52.636839 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84135e71-9cd9-42be-a668-7bb274b18590 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:52.637683 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84135e71-9cd9-42be-a668-7bb274b18590 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:52.638692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84135e71-9cd9-42be-a668-7bb274b18590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:52.677399 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-84135e71-9cd9-42be-a668-7bb274b18590 None None] MFA Rules not processed for user `bfafb0b4dd5c43e0add92a9eae7677b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:52.679143 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-84135e71-9cd9-42be-a668-7bb274b18590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:52.696427 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1110/2243] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:53.238414 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe91a2-00a6-43fe-a9ca-6fa59ccacb9b service nova] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:53.241024 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6ebe91a2-00a6-43fe-a9ca-6fa59ccacb9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:53.376383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe91a2-00a6-43fe-a9ca-6fa59ccacb9b service nova] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:53.392472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacee46a-b880-486d-91c0-74fc799846d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:53.393356 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacee46a-b880-486d-91c0-74fc799846d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:53.393721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacee46a-b880-486d-91c0-74fc799846d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:53.394073 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacee46a-b880-486d-91c0-74fc799846d1 admin admin] PATH_INFO: `/v3/users/5c7e5411884a4435928e76cde366076d` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:53.397021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacee46a-b880-486d-91c0-74fc799846d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c7e5411884a4435928e76cde366076d)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:53.402865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacee46a-b880-486d-91c0-74fc799846d1 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:53.514706 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-aacee46a-b880-486d-91c0-74fc799846d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c7e5411884a4435928e76cde366076d'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:53.515632 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-aacee46a-b880-486d-91c0-74fc799846d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c7e5411884a4435928e76cde366076d'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:53.516478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-aacee46a-b880-486d-91c0-74fc799846d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c7e5411884a4435928e76cde366076d'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:53.539728 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-aacee46a-b880-486d-91c0-74fc799846d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c7e5411884a4435928e76cde366076d'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:53.558322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-aacee46a-b880-486d-91c0-74fc799846d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c7e5411884a4435928e76cde366076d'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:53.603339 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1134/2244] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:53 2022] DELETE /identity/v3/users/5c7e5411884a4435928e76cde366076d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:54.072109 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84135e71-9cd9-42be-a668-7bb274b18590 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:54.089236 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84135e71-9cd9-42be-a668-7bb274b18590 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:54.195363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:54.310106 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f2664-ffc5-4b3a-966a-8f146558a9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:54.311083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f2664-ffc5-4b3a-966a-8f146558a9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:54.311517 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f2664-ffc5-4b3a-966a-8f146558a9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:54.311942 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f2664-ffc5-4b3a-966a-8f146558a9e0 admin admin] PATH_INFO: `/v3/projects/e2e415ea5b19456db404b0b11e28b940` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:54.316086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f2664-ffc5-4b3a-966a-8f146558a9e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e415ea5b19456db404b0b11e28b940)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:54.319094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f2664-ffc5-4b3a-966a-8f146558a9e0 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:54.436143 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-5c1f2664-ffc5-4b3a-966a-8f146558a9e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e415ea5b19456db404b0b11e28b940', 'request_id': 'req-5c1f2664-ffc5-4b3a-966a-8f146558a9e0'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:54.444195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-5c1f2664-ffc5-4b3a-966a-8f146558a9e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e415ea5b19456db404b0b11e28b940', 'request_id': 'req-5c1f2664-ffc5-4b3a-966a-8f146558a9e0'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:54.455646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-5c1f2664-ffc5-4b3a-966a-8f146558a9e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e415ea5b19456db404b0b11e28b940', 'request_id': 'req-5c1f2664-ffc5-4b3a-966a-8f146558a9e0'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:54.480193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-5c1f2664-ffc5-4b3a-966a-8f146558a9e0 admin admin] The token cache is being invalidate because project e2e415ea5b19456db404b0b11e28b940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:54.480490 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-5c1f2664-ffc5-4b3a-966a-8f146558a9e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:54.481211 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-5c1f2664-ffc5-4b3a-966a-8f146558a9e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:54.484123 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1111/2245] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:54 2022] DELETE /identity/v3/projects/e2e415ea5b19456db404b0b11e28b940 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:54.487968 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacee46a-b880-486d-91c0-74fc799846d1 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:54.495104 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-aacee46a-b880-486d-91c0-74fc799846d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:54.519149 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacee46a-b880-486d-91c0-74fc799846d1 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:54.649280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:54.703130 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e93001-a075-4570-b398-bdf375d271d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:54.703792 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e93001-a075-4570-b398-bdf375d271d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:54.704073 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e93001-a075-4570-b398-bdf375d271d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:54.704445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e93001-a075-4570-b398-bdf375d271d3 admin admin] PATH_INFO: `/v3/users/937cc20f7fbf42b29e50d39e80da37db` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:54.709107 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e93001-a075-4570-b398-bdf375d271d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=937cc20f7fbf42b29e50d39e80da37db)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:54.714603 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e93001-a075-4570-b398-bdf375d271d3 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:54.832338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f0e93001-a075-4570-b398-bdf375d271d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '937cc20f7fbf42b29e50d39e80da37db'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:54.833341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f0e93001-a075-4570-b398-bdf375d271d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '937cc20f7fbf42b29e50d39e80da37db'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:54.835277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f0e93001-a075-4570-b398-bdf375d271d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '937cc20f7fbf42b29e50d39e80da37db'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:54.852995 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f0e93001-a075-4570-b398-bdf375d271d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '937cc20f7fbf42b29e50d39e80da37db'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:54.861482 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f0e93001-a075-4570-b398-bdf375d271d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '937cc20f7fbf42b29e50d39e80da37db'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:54.886921 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1135/2246] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:54 2022] DELETE /identity/v3/users/937cc20f7fbf42b29e50d39e80da37db => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:55.232238 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f2664-ffc5-4b3a-966a-8f146558a9e0 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:55.234022 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5c1f2664-ffc5-4b3a-966a-8f146558a9e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:55.250291 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f2664-ffc5-4b3a-966a-8f146558a9e0 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:55.336818 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb02459-eaf5-4588-97d2-b9a463960c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:55.337614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb02459-eaf5-4588-97d2-b9a463960c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:55.337895 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb02459-eaf5-4588-97d2-b9a463960c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:55.338160 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb02459-eaf5-4588-97d2-b9a463960c46 admin admin] PATH_INFO: `/v3/projects/5c7119163dfb47edac2a304a207fd5e7` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:55.339817 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb02459-eaf5-4588-97d2-b9a463960c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7119163dfb47edac2a304a207fd5e7)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:55.341813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb02459-eaf5-4588-97d2-b9a463960c46 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:55.433448 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6cb02459-eaf5-4588-97d2-b9a463960c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7119163dfb47edac2a304a207fd5e7', 'request_id': 'req-6cb02459-eaf5-4588-97d2-b9a463960c46'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:55.441483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6cb02459-eaf5-4588-97d2-b9a463960c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7119163dfb47edac2a304a207fd5e7', 'request_id': 'req-6cb02459-eaf5-4588-97d2-b9a463960c46'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:55.452615 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:55.458283 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6cb02459-eaf5-4588-97d2-b9a463960c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7119163dfb47edac2a304a207fd5e7', 'request_id': 'req-6cb02459-eaf5-4588-97d2-b9a463960c46'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:55.479411 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6cb02459-eaf5-4588-97d2-b9a463960c46 admin admin] The token cache is being invalidate because project 5c7119163dfb47edac2a304a207fd5e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:55.480481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6cb02459-eaf5-4588-97d2-b9a463960c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:55.482537 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6cb02459-eaf5-4588-97d2-b9a463960c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:55.485089 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1112/2247] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:55 2022] DELETE /identity/v3/projects/5c7119163dfb47edac2a304a207fd5e7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:55.491518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33412fc-7f5c-4056-a3d0-9c0effcc33a3 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:55.491518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33412fc-7f5c-4056-a3d0-9c0effcc33a3 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:55.491518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33412fc-7f5c-4056-a3d0-9c0effcc33a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:55.519026 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-a33412fc-7f5c-4056-a3d0-9c0effcc33a3 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:55.520353 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a33412fc-7f5c-4056-a3d0-9c0effcc33a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:55.600489 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1136/2248] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:55.608935 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c33340-f0ef-480a-8526-ed958eb33ec0 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:55.609585 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c33340-f0ef-480a-8526-ed958eb33ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:55.610071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c33340-f0ef-480a-8526-ed958eb33ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:55.647927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-d5c33340-f0ef-480a-8526-ed958eb33ec0 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:55.649246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d5c33340-f0ef-480a-8526-ed958eb33ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:55.657889 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1113/2249] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:55.662442 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33412fc-7f5c-4056-a3d0-9c0effcc33a3 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:55.672753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33412fc-7f5c-4056-a3d0-9c0effcc33a3 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:55.678405 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a4800-6ff7-4e24-8c65-fac7a28ca967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:55.679052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a4800-6ff7-4e24-8c65-fac7a28ca967 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:55.679341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a4800-6ff7-4e24-8c65-fac7a28ca967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:55.679614 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a4800-6ff7-4e24-8c65-fac7a28ca967 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:55.680285 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a4800-6ff7-4e24-8c65-fac7a28ca967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:37:55.680578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a4800-6ff7-4e24-8c65-fac7a28ca967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:55.682713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a4800-6ff7-4e24-8c65-fac7a28ca967 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:55.701893 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1137/2250] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:37:55.706866 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c33340-f0ef-480a-8526-ed958eb33ec0 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:55.723219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c33340-f0ef-480a-8526-ed958eb33ec0 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:55.728983 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e04bd-2e13-466c-9df4-3941a2f1935e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:55.729535 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e04bd-2e13-466c-9df4-3941a2f1935e admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:55.729811 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e04bd-2e13-466c-9df4-3941a2f1935e admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:55.730541 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e04bd-2e13-466c-9df4-3941a2f1935e admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:55.732237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e04bd-2e13-466c-9df4-3941a2f1935e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:55.758269 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e04bd-2e13-466c-9df4-3941a2f1935e admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:55.838787 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1114/2251] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:55 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:55.843528 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a4800-6ff7-4e24-8c65-fac7a28ca967 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:55.855319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a4800-6ff7-4e24-8c65-fac7a28ca967 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:55.923891 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:55.939154 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9631bb6-a87f-43c3-9c68-819f32f4c555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:55.940297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9631bb6-a87f-43c3-9c68-819f32f4c555 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:55.940743 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9631bb6-a87f-43c3-9c68-819f32f4c555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:55.941335 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9631bb6-a87f-43c3-9c68-819f32f4c555 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:55.942119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9631bb6-a87f-43c3-9c68-819f32f4c555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:55.944507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9631bb6-a87f-43c3-9c68-819f32f4c555 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:55.970010 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1138/2252] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:55 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:55.974606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e04bd-2e13-466c-9df4-3941a2f1935e admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:55.987263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e04bd-2e13-466c-9df4-3941a2f1935e admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:55.993010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d7e70-3e1f-4b7b-9745-a0bc6ee0a5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:55.993628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d7e70-3e1f-4b7b-9745-a0bc6ee0a5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:55.993909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d7e70-3e1f-4b7b-9745-a0bc6ee0a5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:55.994203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d7e70-3e1f-4b7b-9745-a0bc6ee0a5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:55.994849 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d7e70-3e1f-4b7b-9745-a0bc6ee0a5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:55.997733 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d7e70-3e1f-4b7b-9745-a0bc6ee0a5f6 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:56.014304 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1115/2253] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:56.015636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9631bb6-a87f-43c3-9c68-819f32f4c555 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:56.026807 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9631bb6-a87f-43c3-9c68-819f32f4c555 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:56.032129 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdafd9a-fd45-4fe2-bdcb-f31ab71bdda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:56.032753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdafd9a-fd45-4fe2-bdcb-f31ab71bdda5 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:56.033036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdafd9a-fd45-4fe2-bdcb-f31ab71bdda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:56.033314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdafd9a-fd45-4fe2-bdcb-f31ab71bdda5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:56.033952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdafd9a-fd45-4fe2-bdcb-f31ab71bdda5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:56.035569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdafd9a-fd45-4fe2-bdcb-f31ab71bdda5 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:56.047260 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1139/2254] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:56.051484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d7e70-3e1f-4b7b-9745-a0bc6ee0a5f6 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:56.062484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d7e70-3e1f-4b7b-9745-a0bc6ee0a5f6 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:56.067317 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856c036-33e9-4a8a-950b-c3c52052d378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:56.068007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856c036-33e9-4a8a-950b-c3c52052d378 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:56.068226 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856c036-33e9-4a8a-950b-c3c52052d378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:56.068503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856c036-33e9-4a8a-950b-c3c52052d378 admin admin] PATH_INFO: `/v3/projects/efc9ad9de06646599129efcdb2998277/users/893a43b6c5ba403a936e7571498ec1e9/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:56.084344 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856c036-33e9-4a8a-950b-c3c52052d378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc9ad9de06646599129efcdb2998277, user_id=893a43b6c5ba403a936e7571498ec1e9, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:56.087036 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856c036-33e9-4a8a-950b-c3c52052d378 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:56.101458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1116/2255] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:56 2022] PUT /identity/v3/projects/efc9ad9de06646599129efcdb2998277/users/893a43b6c5ba403a936e7571498ec1e9/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:37:56.116480 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648f914-8cbb-4ab7-bd2f-249af090cf43 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:56.117060 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648f914-8cbb-4ab7-bd2f-249af090cf43 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:56.117671 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648f914-8cbb-4ab7-bd2f-249af090cf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:56.153615 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-a648f914-8cbb-4ab7-bd2f-249af090cf43 None None] MFA Rules not processed for user `893a43b6c5ba403a936e7571498ec1e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:56.155105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a648f914-8cbb-4ab7-bd2f-249af090cf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:56.233516 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1140/2256] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:56.244966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856c036-33e9-4a8a-950b-c3c52052d378 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:56.246768 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-9856c036-33e9-4a8a-950b-c3c52052d378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:56.312713 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856c036-33e9-4a8a-950b-c3c52052d378 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:56.316605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca9be3-c4d3-4c0c-9839-86d674ba5d28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:56.317281 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca9be3-c4d3-4c0c-9839-86d674ba5d28 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:56.317673 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca9be3-c4d3-4c0c-9839-86d674ba5d28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:56.318006 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca9be3-c4d3-4c0c-9839-86d674ba5d28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:56.326779 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca9be3-c4d3-4c0c-9839-86d674ba5d28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:56.328241 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca9be3-c4d3-4c0c-9839-86d674ba5d28 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:56.338647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1117/2257] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:56.358105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648f914-8cbb-4ab7-bd2f-249af090cf43 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:56.434369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648f914-8cbb-4ab7-bd2f-249af090cf43 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:56.439529 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2575b0-1189-41af-aab6-fc0b1be37d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:56.440226 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2575b0-1189-41af-aab6-fc0b1be37d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:56.440572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2575b0-1189-41af-aab6-fc0b1be37d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:56.440911 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2575b0-1189-41af-aab6-fc0b1be37d4c admin admin] PATH_INFO: `/v3/users/893a43b6c5ba403a936e7571498ec1e9` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:56.442216 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2575b0-1189-41af-aab6-fc0b1be37d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=893a43b6c5ba403a936e7571498ec1e9)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:56.444730 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2575b0-1189-41af-aab6-fc0b1be37d4c admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:56.508208 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-5a2575b0-1189-41af-aab6-fc0b1be37d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '893a43b6c5ba403a936e7571498ec1e9'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:56.509400 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-5a2575b0-1189-41af-aab6-fc0b1be37d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '893a43b6c5ba403a936e7571498ec1e9'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:56.510217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-5a2575b0-1189-41af-aab6-fc0b1be37d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '893a43b6c5ba403a936e7571498ec1e9'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:56.524627 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:56.527345 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-5a2575b0-1189-41af-aab6-fc0b1be37d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '893a43b6c5ba403a936e7571498ec1e9'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:56.541535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-5a2575b0-1189-41af-aab6-fc0b1be37d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '893a43b6c5ba403a936e7571498ec1e9'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:56.564184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1141/2258] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:37:56 2022] DELETE /identity/v3/users/893a43b6c5ba403a936e7571498ec1e9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:56.569410 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e9598-932d-4d4d-bac6-27c508e0d84a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:56.569706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e9598-932d-4d4d-bac6-27c508e0d84a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:56.570067 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e9598-932d-4d4d-bac6-27c508e0d84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:56.596756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-945e9598-932d-4d4d-bac6-27c508e0d84a None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:56.599823 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-945e9598-932d-4d4d-bac6-27c508e0d84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:56.680030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1118/2259] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:56.690757 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2575b0-1189-41af-aab6-fc0b1be37d4c admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:56.693491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-5a2575b0-1189-41af-aab6-fc0b1be37d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:56.791391 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2575b0-1189-41af-aab6-fc0b1be37d4c admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:56.795471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3615e-4783-472f-92d6-4c28d9bf60b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:56.796079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3615e-4783-472f-92d6-4c28d9bf60b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:56.796361 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3615e-4783-472f-92d6-4c28d9bf60b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:56.796635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3615e-4783-472f-92d6-4c28d9bf60b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:56.826933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3615e-4783-472f-92d6-4c28d9bf60b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:56.832285 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3615e-4783-472f-92d6-4c28d9bf60b9 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:56.864881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1142/2260] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:37:57.338174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e9598-932d-4d4d-bac6-27c508e0d84a None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:57.340363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-945e9598-932d-4d4d-bac6-27c508e0d84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:57.354389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e9598-932d-4d4d-bac6-27c508e0d84a None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:57.359381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423fcad-a995-4640-b739-d3dfb89e0d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:57.360228 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423fcad-a995-4640-b739-d3dfb89e0d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:57.360503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423fcad-a995-4640-b739-d3dfb89e0d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:57.360779 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423fcad-a995-4640-b739-d3dfb89e0d76 admin admin] PATH_INFO: `/v3/projects/efc9ad9de06646599129efcdb2998277` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:57.361928 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423fcad-a995-4640-b739-d3dfb89e0d76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc9ad9de06646599129efcdb2998277)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:57.364188 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423fcad-a995-4640-b739-d3dfb89e0d76 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:57.397990 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:57.431669 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7423fcad-a995-4640-b739-d3dfb89e0d76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc9ad9de06646599129efcdb2998277', 'request_id': 'req-7423fcad-a995-4640-b739-d3dfb89e0d76'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:57.437388 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7423fcad-a995-4640-b739-d3dfb89e0d76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc9ad9de06646599129efcdb2998277', 'request_id': 'req-7423fcad-a995-4640-b739-d3dfb89e0d76'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:57.444319 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7423fcad-a995-4640-b739-d3dfb89e0d76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc9ad9de06646599129efcdb2998277', 'request_id': 'req-7423fcad-a995-4640-b739-d3dfb89e0d76'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:57.459411 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7423fcad-a995-4640-b739-d3dfb89e0d76 admin admin] The token cache is being invalidate because project efc9ad9de06646599129efcdb2998277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:37:57.459731 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7423fcad-a995-4640-b739-d3dfb89e0d76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:57.460382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7423fcad-a995-4640-b739-d3dfb89e0d76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:37:57.462204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1119/2261] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:37:57 2022] DELETE /identity/v3/projects/efc9ad9de06646599129efcdb2998277 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:37:57.467037 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda42d1-3c16-4f04-8883-7481c07a6586 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:57.467324 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda42d1-3c16-4f04-8883-7481c07a6586 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:57.467602 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda42d1-3c16-4f04-8883-7481c07a6586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:57.492451 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-2dda42d1-3c16-4f04-8883-7481c07a6586 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:57.493859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-2dda42d1-3c16-4f04-8883-7481c07a6586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:57.562561 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1143/2262] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:37:57.570615 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35215509-e059-49ea-a1bc-2505851cabf4 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:57.570930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35215509-e059-49ea-a1bc-2505851cabf4 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:57.571206 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35215509-e059-49ea-a1bc-2505851cabf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:57.593023 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-35215509-e059-49ea-a1bc-2505851cabf4 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:57.594237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-35215509-e059-49ea-a1bc-2505851cabf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:57.603012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1120/2263] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:57.607312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda42d1-3c16-4f04-8883-7481c07a6586 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:57.617285 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda42d1-3c16-4f04-8883-7481c07a6586 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:57.621977 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2ed92-b429-46d5-b98e-a5e607dbe2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:57.622563 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2ed92-b429-46d5-b98e-a5e607dbe2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:57.622900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2ed92-b429-46d5-b98e-a5e607dbe2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:57.623140 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2ed92-b429-46d5-b98e-a5e607dbe2b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:57.623786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2ed92-b429-46d5-b98e-a5e607dbe2b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:37:57.624081 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2ed92-b429-46d5-b98e-a5e607dbe2b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:57.625663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2ed92-b429-46d5-b98e-a5e607dbe2b4 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:57.638189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1144/2264] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:37:57.643003 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35215509-e059-49ea-a1bc-2505851cabf4 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:57.653629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35215509-e059-49ea-a1bc-2505851cabf4 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:57.658446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9befc-64b5-4ad8-be1f-28108d08f829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:57.659183 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9befc-64b5-4ad8-be1f-28108d08f829 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:57.659460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9befc-64b5-4ad8-be1f-28108d08f829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:57.659730 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9befc-64b5-4ad8-be1f-28108d08f829 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:57.660357 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9befc-64b5-4ad8-be1f-28108d08f829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:57.662522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9befc-64b5-4ad8-be1f-28108d08f829 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:57.693892 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1121/2265] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:57 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:57.696863 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2ed92-b429-46d5-b98e-a5e607dbe2b4 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:57.707577 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2ed92-b429-46d5-b98e-a5e607dbe2b4 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:57.777488 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60993c-20f3-4bb0-96d4-1ef72e261f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:57.778203 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60993c-20f3-4bb0-96d4-1ef72e261f62 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:57.778557 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60993c-20f3-4bb0-96d4-1ef72e261f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:57.778928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60993c-20f3-4bb0-96d4-1ef72e261f62 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:57.779655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60993c-20f3-4bb0-96d4-1ef72e261f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:57.781687 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60993c-20f3-4bb0-96d4-1ef72e261f62 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:57.800459 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:57.810998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1145/2266] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:57 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:57.812554 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9befc-64b5-4ad8-be1f-28108d08f829 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:57.824414 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9befc-64b5-4ad8-be1f-28108d08f829 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:57.829231 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76301502-139c-4dcb-b63c-1360b8d3f2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:57.829837 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76301502-139c-4dcb-b63c-1360b8d3f2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:57.830116 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76301502-139c-4dcb-b63c-1360b8d3f2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:57.830388 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76301502-139c-4dcb-b63c-1360b8d3f2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:57.831054 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76301502-139c-4dcb-b63c-1360b8d3f2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:57.832637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76301502-139c-4dcb-b63c-1360b8d3f2e9 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:57.843184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1122/2267] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:57.847078 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60993c-20f3-4bb0-96d4-1ef72e261f62 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:57.862089 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60993c-20f3-4bb0-96d4-1ef72e261f62 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:57.867440 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a3b42-9c10-444d-b666-7c1e826e7e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:57.868054 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a3b42-9c10-444d-b666-7c1e826e7e3b admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:57.868367 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a3b42-9c10-444d-b666-7c1e826e7e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:57.868614 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a3b42-9c10-444d-b666-7c1e826e7e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:57.869290 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a3b42-9c10-444d-b666-7c1e826e7e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:57.870941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a3b42-9c10-444d-b666-7c1e826e7e3b admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:57.883065 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1146/2268] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:37:57.887261 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76301502-139c-4dcb-b63c-1360b8d3f2e9 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:57.898241 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76301502-139c-4dcb-b63c-1360b8d3f2e9 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:57.903073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b01481-fbda-4ae8-accd-a63e32ff7282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:57.903740 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b01481-fbda-4ae8-accd-a63e32ff7282 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:57.904019 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b01481-fbda-4ae8-accd-a63e32ff7282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:57.904287 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b01481-fbda-4ae8-accd-a63e32ff7282 admin admin] PATH_INFO: `/v3/projects/91d8b165e2ce41fd82c3cc660d9c9922/users/0b759b7cd18245c99955e56d054d7631/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:57.924443 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b01481-fbda-4ae8-accd-a63e32ff7282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d8b165e2ce41fd82c3cc660d9c9922, user_id=0b759b7cd18245c99955e56d054d7631, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:57.928889 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b01481-fbda-4ae8-accd-a63e32ff7282 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:57.953551 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1123/2269] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:57 2022] PUT /identity/v3/projects/91d8b165e2ce41fd82c3cc660d9c9922/users/0b759b7cd18245c99955e56d054d7631/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:57.963916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e38171-c6ad-449e-b5f5-ab007f46e818 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:57.964204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e38171-c6ad-449e-b5f5-ab007f46e818 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:57.964481 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e38171-c6ad-449e-b5f5-ab007f46e818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:57.998668 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-78e38171-c6ad-449e-b5f5-ab007f46e818 None None] MFA Rules not processed for user `0b759b7cd18245c99955e56d054d7631`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:57.999915 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-78e38171-c6ad-449e-b5f5-ab007f46e818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:58.084813 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1147/2270] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:37:58.089500 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b01481-fbda-4ae8-accd-a63e32ff7282 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:58.157279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b01481-fbda-4ae8-accd-a63e32ff7282 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:58.164452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0b106-5cb2-4fb2-90f2-2b72715ad6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:58.165393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0b106-5cb2-4fb2-90f2-2b72715ad6ab admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:58.165777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0b106-5cb2-4fb2-90f2-2b72715ad6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:58.166050 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0b106-5cb2-4fb2-90f2-2b72715ad6ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:58.166943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0b106-5cb2-4fb2-90f2-2b72715ad6ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:58.169481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0b106-5cb2-4fb2-90f2-2b72715ad6ab admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:58.199965 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1124/2271] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:37:58 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:37:58.203866 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e38171-c6ad-449e-b5f5-ab007f46e818 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:58.214551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e38171-c6ad-449e-b5f5-ab007f46e818 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:58.272798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6769fd5-245a-45c6-b00d-a548365acf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:58.273488 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6769fd5-245a-45c6-b00d-a548365acf67 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:58.273837 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6769fd5-245a-45c6-b00d-a548365acf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:58.274242 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6769fd5-245a-45c6-b00d-a548365acf67 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:58.274970 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6769fd5-245a-45c6-b00d-a548365acf67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:58.277003 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6769fd5-245a-45c6-b00d-a548365acf67 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:58.301449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1148/2272] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:37:58 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:37:58.305307 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0b106-5cb2-4fb2-90f2-2b72715ad6ab admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:58.315531 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0b106-5cb2-4fb2-90f2-2b72715ad6ab admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:58.320313 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeafa67-db7e-4e66-a80e-5eb728046b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:58.320902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeafa67-db7e-4e66-a80e-5eb728046b98 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:58.321178 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeafa67-db7e-4e66-a80e-5eb728046b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:58.321472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeafa67-db7e-4e66-a80e-5eb728046b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:58.322098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeafa67-db7e-4e66-a80e-5eb728046b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:58.323969 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeafa67-db7e-4e66-a80e-5eb728046b98 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:58.334780 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1125/2273] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:58.338733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6769fd5-245a-45c6-b00d-a548365acf67 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:58.351854 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6769fd5-245a-45c6-b00d-a548365acf67 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:58.357473 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc815fef-c2eb-4791-bf12-ae5c84c6d229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:58.358162 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc815fef-c2eb-4791-bf12-ae5c84c6d229 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:58.358446 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc815fef-c2eb-4791-bf12-ae5c84c6d229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:58.358725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc815fef-c2eb-4791-bf12-ae5c84c6d229 admin admin] PATH_INFO: `/v3/projects/d66f09521aff4517ace0bcc8fad91d1a/users/924c8b8602eb44cc9771583c51ee27df/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:58.375962 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc815fef-c2eb-4791-bf12-ae5c84c6d229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66f09521aff4517ace0bcc8fad91d1a, user_id=924c8b8602eb44cc9771583c51ee27df, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:58.378649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc815fef-c2eb-4791-bf12-ae5c84c6d229 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:58.391680 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1149/2274] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:58 2022] PUT /identity/v3/projects/d66f09521aff4517ace0bcc8fad91d1a/users/924c8b8602eb44cc9771583c51ee27df/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:58.396729 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeafa67-db7e-4e66-a80e-5eb728046b98 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:58.409792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeafa67-db7e-4e66-a80e-5eb728046b98 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:58.429195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:58.469364 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c229b-1892-42dc-be5c-dcdda4703954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:58.469970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c229b-1892-42dc-be5c-dcdda4703954 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:58.470253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c229b-1892-42dc-be5c-dcdda4703954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:58.470529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c229b-1892-42dc-be5c-dcdda4703954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:58.471192 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c229b-1892-42dc-be5c-dcdda4703954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:58.472785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c229b-1892-42dc-be5c-dcdda4703954 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:58.483216 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1126/2275] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:37:58.487342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc815fef-c2eb-4791-bf12-ae5c84c6d229 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:58.497572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc815fef-c2eb-4791-bf12-ae5c84c6d229 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:58.502172 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ced1d6-dc06-48fe-aebc-268e403d4373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:58.502812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ced1d6-dc06-48fe-aebc-268e403d4373 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:58.503114 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ced1d6-dc06-48fe-aebc-268e403d4373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:58.503388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ced1d6-dc06-48fe-aebc-268e403d4373 admin admin] PATH_INFO: `/v3/projects/d66f09521aff4517ace0bcc8fad91d1a/users/924c8b8602eb44cc9771583c51ee27df/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:58.505300 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ced1d6-dc06-48fe-aebc-268e403d4373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66f09521aff4517ace0bcc8fad91d1a, user_id=924c8b8602eb44cc9771583c51ee27df, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:58.507943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ced1d6-dc06-48fe-aebc-268e403d4373 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:58.517888 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1150/2276] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:37:58 2022] PUT /identity/v3/projects/d66f09521aff4517ace0bcc8fad91d1a/users/924c8b8602eb44cc9771583c51ee27df/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:37:58.528962 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0653bb1-6bf1-43c7-ae6a-2f9a0353337c None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:58.529247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0653bb1-6bf1-43c7-ae6a-2f9a0353337c None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:58.529523 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0653bb1-6bf1-43c7-ae6a-2f9a0353337c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:58.558134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-c0653bb1-6bf1-43c7-ae6a-2f9a0353337c None None] MFA Rules not processed for user `924c8b8602eb44cc9771583c51ee27df`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:37:58.559315 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c0653bb1-6bf1-43c7-ae6a-2f9a0353337c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:58.655615 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1127/2277] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:37:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:37:58.667169 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ced1d6-dc06-48fe-aebc-268e403d4373 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:37:58.668959 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-31ced1d6-dc06-48fe-aebc-268e403d4373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:37:58.703383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:58.734274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ced1d6-dc06-48fe-aebc-268e403d4373 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:37:58.737996 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9497d9-96e0-49f0-b7a4-4dfee627980c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:37:58.738612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9497d9-96e0-49f0-b7a4-4dfee627980c service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:37:58.738923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9497d9-96e0-49f0-b7a4-4dfee627980c service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:37:58.739200 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9497d9-96e0-49f0-b7a4-4dfee627980c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:37:58.799936 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9497d9-96e0-49f0-b7a4-4dfee627980c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:37:58.801388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9497d9-96e0-49f0-b7a4-4dfee627980c service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:37:58.814199 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1151/2278] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:37:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:38:01.373840 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0653bb1-6bf1-43c7-ae6a-2f9a0353337c None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:01.457271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0653bb1-6bf1-43c7-ae6a-2f9a0353337c None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:01.462268 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438f528-b8dc-4340-8a60-cef661061f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:01.462924 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438f528-b8dc-4340-8a60-cef661061f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:01.463204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438f528-b8dc-4340-8a60-cef661061f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:01.463587 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438f528-b8dc-4340-8a60-cef661061f71 admin admin] PATH_INFO: `/v3/users/0b759b7cd18245c99955e56d054d7631` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:01.464757 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438f528-b8dc-4340-8a60-cef661061f71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b759b7cd18245c99955e56d054d7631)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:01.466678 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438f528-b8dc-4340-8a60-cef661061f71 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:01.513037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:01.514592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0438f528-b8dc-4340-8a60-cef661061f71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b759b7cd18245c99955e56d054d7631'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:01.515357 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0438f528-b8dc-4340-8a60-cef661061f71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b759b7cd18245c99955e56d054d7631'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:01.516408 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0438f528-b8dc-4340-8a60-cef661061f71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b759b7cd18245c99955e56d054d7631'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:01.528601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0438f528-b8dc-4340-8a60-cef661061f71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b759b7cd18245c99955e56d054d7631'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:01.535474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0438f528-b8dc-4340-8a60-cef661061f71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b759b7cd18245c99955e56d054d7631'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:01.547557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1128/2279] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:38:01 2022] DELETE /identity/v3/users/0b759b7cd18245c99955e56d054d7631 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:01.553086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56721d40-75be-4d3a-a7b0-fd31bbee54bf None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:01.553720 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56721d40-75be-4d3a-a7b0-fd31bbee54bf None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:01.554045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56721d40-75be-4d3a-a7b0-fd31bbee54bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:01.577549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-56721d40-75be-4d3a-a7b0-fd31bbee54bf None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:01.579069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-56721d40-75be-4d3a-a7b0-fd31bbee54bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:01.637760 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1152/2280] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:01.647849 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438f528-b8dc-4340-8a60-cef661061f71 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:01.649247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0438f528-b8dc-4340-8a60-cef661061f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:01.707347 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438f528-b8dc-4340-8a60-cef661061f71 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:01.711271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a17f2a-bc1e-42f0-a19e-3c13fdbd9bf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:01.711880 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a17f2a-bc1e-42f0-a19e-3c13fdbd9bf1 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:01.712156 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a17f2a-bc1e-42f0-a19e-3c13fdbd9bf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:01.712426 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a17f2a-bc1e-42f0-a19e-3c13fdbd9bf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:01.722314 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a17f2a-bc1e-42f0-a19e-3c13fdbd9bf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:01.724335 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a17f2a-bc1e-42f0-a19e-3c13fdbd9bf1 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:01.733744 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1129/2281] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:38:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:38:02.124829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56721d40-75be-4d3a-a7b0-fd31bbee54bf None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:02.126286 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-56721d40-75be-4d3a-a7b0-fd31bbee54bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:02.138368 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56721d40-75be-4d3a-a7b0-fd31bbee54bf None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:02.143033 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4014fc-25e8-40d5-901f-524351e7cc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:02.143664 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4014fc-25e8-40d5-901f-524351e7cc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:02.143945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4014fc-25e8-40d5-901f-524351e7cc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:02.144220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4014fc-25e8-40d5-901f-524351e7cc37 admin admin] PATH_INFO: `/v3/projects/91d8b165e2ce41fd82c3cc660d9c9922` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:02.145500 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4014fc-25e8-40d5-901f-524351e7cc37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d8b165e2ce41fd82c3cc660d9c9922)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:02.148064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4014fc-25e8-40d5-901f-524351e7cc37 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:02.205700 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-bc4014fc-25e8-40d5-901f-524351e7cc37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d8b165e2ce41fd82c3cc660d9c9922', 'request_id': 'req-bc4014fc-25e8-40d5-901f-524351e7cc37'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:02.213134 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-bc4014fc-25e8-40d5-901f-524351e7cc37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d8b165e2ce41fd82c3cc660d9c9922', 'request_id': 'req-bc4014fc-25e8-40d5-901f-524351e7cc37'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:02.218924 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-bc4014fc-25e8-40d5-901f-524351e7cc37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d8b165e2ce41fd82c3cc660d9c9922', 'request_id': 'req-bc4014fc-25e8-40d5-901f-524351e7cc37'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:02.232535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-bc4014fc-25e8-40d5-901f-524351e7cc37 admin admin] The token cache is being invalidate because project 91d8b165e2ce41fd82c3cc660d9c9922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:38:02.232826 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-bc4014fc-25e8-40d5-901f-524351e7cc37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:02.233450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-bc4014fc-25e8-40d5-901f-524351e7cc37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:02.234934 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1153/2282] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:38:02 2022] DELETE /identity/v3/projects/91d8b165e2ce41fd82c3cc660d9c9922 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:02.238763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a17f2a-bc1e-42f0-a19e-3c13fdbd9bf1 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:02.248316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a17f2a-bc1e-42f0-a19e-3c13fdbd9bf1 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:02.306764 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f9fd8-082b-409e-9e50-fac8de5823b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:02.307426 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f9fd8-082b-409e-9e50-fac8de5823b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:02.307701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f9fd8-082b-409e-9e50-fac8de5823b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:02.307972 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f9fd8-082b-409e-9e50-fac8de5823b0 admin admin] PATH_INFO: `/v3/users/924c8b8602eb44cc9771583c51ee27df` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:02.309090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f9fd8-082b-409e-9e50-fac8de5823b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=924c8b8602eb44cc9771583c51ee27df)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:02.311037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f9fd8-082b-409e-9e50-fac8de5823b0 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:02.363722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-e42f9fd8-082b-409e-9e50-fac8de5823b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924c8b8602eb44cc9771583c51ee27df'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:02.363992 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-e42f9fd8-082b-409e-9e50-fac8de5823b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924c8b8602eb44cc9771583c51ee27df'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:02.364782 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-e42f9fd8-082b-409e-9e50-fac8de5823b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924c8b8602eb44cc9771583c51ee27df'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:02.378227 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-e42f9fd8-082b-409e-9e50-fac8de5823b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924c8b8602eb44cc9771583c51ee27df'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:02.380420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:02.388435 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-e42f9fd8-082b-409e-9e50-fac8de5823b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924c8b8602eb44cc9771583c51ee27df'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:02.421890 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1130/2283] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:38:02 2022] DELETE /identity/v3/users/924c8b8602eb44cc9771583c51ee27df => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:02.713772 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4014fc-25e8-40d5-901f-524351e7cc37 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:02.715558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-bc4014fc-25e8-40d5-901f-524351e7cc37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:02.729914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4014fc-25e8-40d5-901f-524351e7cc37 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:02.733740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:02.792917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537d0e6-5083-48e8-995c-7b09093b7689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:02.793718 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537d0e6-5083-48e8-995c-7b09093b7689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:02.793999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537d0e6-5083-48e8-995c-7b09093b7689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:02.794332 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537d0e6-5083-48e8-995c-7b09093b7689 admin admin] PATH_INFO: `/v3/projects/d66f09521aff4517ace0bcc8fad91d1a` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:02.795472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537d0e6-5083-48e8-995c-7b09093b7689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d66f09521aff4517ace0bcc8fad91d1a)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:02.797398 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537d0e6-5083-48e8-995c-7b09093b7689 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:02.845222 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b537d0e6-5083-48e8-995c-7b09093b7689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd66f09521aff4517ace0bcc8fad91d1a', 'request_id': 'req-b537d0e6-5083-48e8-995c-7b09093b7689'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:02.852728 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b537d0e6-5083-48e8-995c-7b09093b7689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd66f09521aff4517ace0bcc8fad91d1a', 'request_id': 'req-b537d0e6-5083-48e8-995c-7b09093b7689'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:02.858797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b537d0e6-5083-48e8-995c-7b09093b7689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd66f09521aff4517ace0bcc8fad91d1a', 'request_id': 'req-b537d0e6-5083-48e8-995c-7b09093b7689'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:02.871633 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b537d0e6-5083-48e8-995c-7b09093b7689 admin admin] The token cache is being invalidate because project d66f09521aff4517ace0bcc8fad91d1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:38:02.871870 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b537d0e6-5083-48e8-995c-7b09093b7689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:02.872521 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b537d0e6-5083-48e8-995c-7b09093b7689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:02.874068 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1154/2284] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:38:02 2022] DELETE /identity/v3/projects/d66f09521aff4517ace0bcc8fad91d1a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:02.879113 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e007f9f-cecd-4f7c-a5b4-84a5bba1a254 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:02.879396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e007f9f-cecd-4f7c-a5b4-84a5bba1a254 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:02.879669 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e007f9f-cecd-4f7c-a5b4-84a5bba1a254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:02.900721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-6e007f9f-cecd-4f7c-a5b4-84a5bba1a254 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:02.901993 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6e007f9f-cecd-4f7c-a5b4-84a5bba1a254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:02.964786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1131/2285] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:02.973836 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c766b-dcfe-4338-a845-7fb9a2d0324d None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:02.974060 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c766b-dcfe-4338-a845-7fb9a2d0324d None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:02.974338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c766b-dcfe-4338-a845-7fb9a2d0324d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:02.994334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-5c2c766b-dcfe-4338-a845-7fb9a2d0324d None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:02.995579 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-5c2c766b-dcfe-4338-a845-7fb9a2d0324d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:03.003582 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1155/2286] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:03.008541 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e007f9f-cecd-4f7c-a5b4-84a5bba1a254 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:03.018291 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e007f9f-cecd-4f7c-a5b4-84a5bba1a254 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:03.023120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783649d-a39d-4cf6-9b6c-b4e7d113a5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:03.023713 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783649d-a39d-4cf6-9b6c-b4e7d113a5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:03.023990 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783649d-a39d-4cf6-9b6c-b4e7d113a5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:03.024262 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783649d-a39d-4cf6-9b6c-b4e7d113a5a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:03.024902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783649d-a39d-4cf6-9b6c-b4e7d113a5a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:38:03.025200 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783649d-a39d-4cf6-9b6c-b4e7d113a5a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:03.026770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783649d-a39d-4cf6-9b6c-b4e7d113a5a7 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:03.038505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1132/2287] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:38:03.042486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c766b-dcfe-4338-a845-7fb9a2d0324d None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:03.051816 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c766b-dcfe-4338-a845-7fb9a2d0324d None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:03.057039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2eaf4-c8d9-4be6-8ecb-3af1940aef9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:03.057639 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2eaf4-c8d9-4be6-8ecb-3af1940aef9d admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:03.057914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2eaf4-c8d9-4be6-8ecb-3af1940aef9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:03.058185 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2eaf4-c8d9-4be6-8ecb-3af1940aef9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:03.058812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2eaf4-c8d9-4be6-8ecb-3af1940aef9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:03.060705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2eaf4-c8d9-4be6-8ecb-3af1940aef9d admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:03.092121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1156/2288] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:38:03 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:38:03.093370 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783649d-a39d-4cf6-9b6c-b4e7d113a5a7 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:03.103502 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783649d-a39d-4cf6-9b6c-b4e7d113a5a7 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:03.167452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee97a7-2e02-4881-a0ac-e9f4110fe138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:03.168504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee97a7-2e02-4881-a0ac-e9f4110fe138 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:03.168698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee97a7-2e02-4881-a0ac-e9f4110fe138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:03.168975 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee97a7-2e02-4881-a0ac-e9f4110fe138 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:03.169617 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee97a7-2e02-4881-a0ac-e9f4110fe138 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:03.171678 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee97a7-2e02-4881-a0ac-e9f4110fe138 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:03.194364 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1133/2289] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:38:03 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:38:03.198808 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2eaf4-c8d9-4be6-8ecb-3af1940aef9d admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:03.209360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2eaf4-c8d9-4be6-8ecb-3af1940aef9d admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:03.215357 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6424c63-900e-4e60-b8d2-af97ed573299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:03.215960 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6424c63-900e-4e60-b8d2-af97ed573299 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:03.216272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6424c63-900e-4e60-b8d2-af97ed573299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:03.216550 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6424c63-900e-4e60-b8d2-af97ed573299 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:03.217282 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6424c63-900e-4e60-b8d2-af97ed573299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:03.219004 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6424c63-900e-4e60-b8d2-af97ed573299 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:03.232615 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1157/2290] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:38:03.236905 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee97a7-2e02-4881-a0ac-e9f4110fe138 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:03.248865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee97a7-2e02-4881-a0ac-e9f4110fe138 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:03.254892 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b4f42-630e-4bc0-a854-0c0d6ff35d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:03.255090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b4f42-630e-4bc0-a854-0c0d6ff35d48 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:03.255377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b4f42-630e-4bc0-a854-0c0d6ff35d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:03.255728 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b4f42-630e-4bc0-a854-0c0d6ff35d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:03.256405 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b4f42-630e-4bc0-a854-0c0d6ff35d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:03.258143 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b4f42-630e-4bc0-a854-0c0d6ff35d48 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:03.276324 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6424c63-900e-4e60-b8d2-af97ed573299 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:03.282672 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1134/2291] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:38:03.290573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6424c63-900e-4e60-b8d2-af97ed573299 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:03.297341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9725b4c-b346-46a2-9045-413ad74fdf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:03.298143 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9725b4c-b346-46a2-9045-413ad74fdf10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:03.298595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9725b4c-b346-46a2-9045-413ad74fdf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:03.298982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9725b4c-b346-46a2-9045-413ad74fdf10 admin admin] PATH_INFO: `/v3/projects/1f618a048f9f42889c363d8670b88239/users/3cee849e5f4d4dd0860cbfc177eb716c/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:03.327579 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9725b4c-b346-46a2-9045-413ad74fdf10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f618a048f9f42889c363d8670b88239, user_id=3cee849e5f4d4dd0860cbfc177eb716c, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:03.328726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9725b4c-b346-46a2-9045-413ad74fdf10 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:03.351075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1158/2292] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:38:03 2022] PUT /identity/v3/projects/1f618a048f9f42889c363d8670b88239/users/3cee849e5f4d4dd0860cbfc177eb716c/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:38:03.365288 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bda76a-26e4-46e0-a8c6-8446a5df2bb2 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:03.365697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bda76a-26e4-46e0-a8c6-8446a5df2bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:03.366156 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bda76a-26e4-46e0-a8c6-8446a5df2bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:03.423746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-57bda76a-26e4-46e0-a8c6-8446a5df2bb2 None None] MFA Rules not processed for user `3cee849e5f4d4dd0860cbfc177eb716c`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:03.425756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-57bda76a-26e4-46e0-a8c6-8446a5df2bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:03.473060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:03.499611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1135/2293] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:03.511114 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9725b4c-b346-46a2-9045-413ad74fdf10 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:03.512699 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d9725b4c-b346-46a2-9045-413ad74fdf10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:03.552500 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:03.584361 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9725b4c-b346-46a2-9045-413ad74fdf10 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:03.589275 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e2876-fcbd-46da-8fb1-1f87a5081834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:03.589945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e2876-fcbd-46da-8fb1-1f87a5081834 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:03.590308 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e2876-fcbd-46da-8fb1-1f87a5081834 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:03.590661 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e2876-fcbd-46da-8fb1-1f87a5081834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:03.601177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e2876-fcbd-46da-8fb1-1f87a5081834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:03.602806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e2876-fcbd-46da-8fb1-1f87a5081834 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:03.611983 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1159/2294] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:38:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:38:03.704029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bda76a-26e4-46e0-a8c6-8446a5df2bb2 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:03.705473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-57bda76a-26e4-46e0-a8c6-8446a5df2bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:03.784555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bda76a-26e4-46e0-a8c6-8446a5df2bb2 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:03.789618 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddc2bb-542f-43f9-a0d6-4036291a5eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:03.790278 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddc2bb-542f-43f9-a0d6-4036291a5eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:03.790748 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddc2bb-542f-43f9-a0d6-4036291a5eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:03.791070 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddc2bb-542f-43f9-a0d6-4036291a5eca admin admin] PATH_INFO: `/v3/users/68a3c387ee6743bf910d8a5b988ff609` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:03.792258 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddc2bb-542f-43f9-a0d6-4036291a5eca admin admin] RBAC: Authorizing `identity:delete_user(user_id=68a3c387ee6743bf910d8a5b988ff609)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:03.794294 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddc2bb-542f-43f9-a0d6-4036291a5eca admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:03.848359 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-07ddc2bb-542f-43f9-a0d6-4036291a5eca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68a3c387ee6743bf910d8a5b988ff609'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:03.849053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-07ddc2bb-542f-43f9-a0d6-4036291a5eca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68a3c387ee6743bf910d8a5b988ff609'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:03.849712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-07ddc2bb-542f-43f9-a0d6-4036291a5eca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68a3c387ee6743bf910d8a5b988ff609'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:03.872389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-07ddc2bb-542f-43f9-a0d6-4036291a5eca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68a3c387ee6743bf910d8a5b988ff609'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:03.879979 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-07ddc2bb-542f-43f9-a0d6-4036291a5eca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68a3c387ee6743bf910d8a5b988ff609'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:03.898469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1136/2295] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:38:03 2022] DELETE /identity/v3/users/68a3c387ee6743bf910d8a5b988ff609 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:03.910331 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da542cd-a06b-447f-b332-07b18f2571db None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:03.910966 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da542cd-a06b-447f-b332-07b18f2571db None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:03.911052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da542cd-a06b-447f-b332-07b18f2571db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:03.933358 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-2da542cd-a06b-447f-b332-07b18f2571db None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:03.934563 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-2da542cd-a06b-447f-b332-07b18f2571db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:04.005252 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1160/2296] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:04.015746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddc2bb-542f-43f9-a0d6-4036291a5eca admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:04.017141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-07ddc2bb-542f-43f9-a0d6-4036291a5eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:04.077655 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddc2bb-542f-43f9-a0d6-4036291a5eca admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:04.081378 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237b81f-acbd-4abd-97bb-85831f4caefe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:04.081976 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237b81f-acbd-4abd-97bb-85831f4caefe service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:04.082256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237b81f-acbd-4abd-97bb-85831f4caefe service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:04.082525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237b81f-acbd-4abd-97bb-85831f4caefe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:04.092742 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237b81f-acbd-4abd-97bb-85831f4caefe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:04.094257 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237b81f-acbd-4abd-97bb-85831f4caefe service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:04.104707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1137/2297] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:38:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:38:04.387686 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da542cd-a06b-447f-b332-07b18f2571db None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:04.390061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-2da542cd-a06b-447f-b332-07b18f2571db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:04.418848 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da542cd-a06b-447f-b332-07b18f2571db None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:04.431318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4814da9-c92e-431f-80b2-b10e494eae73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:04.433205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4814da9-c92e-431f-80b2-b10e494eae73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:04.433672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4814da9-c92e-431f-80b2-b10e494eae73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:04.434232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4814da9-c92e-431f-80b2-b10e494eae73 admin admin] PATH_INFO: `/v3/projects/12c738bca7684e7080a813298f871e6b` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:04.436157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4814da9-c92e-431f-80b2-b10e494eae73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c738bca7684e7080a813298f871e6b)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:04.440994 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4814da9-c92e-431f-80b2-b10e494eae73 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:04.549798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f4814da9-c92e-431f-80b2-b10e494eae73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c738bca7684e7080a813298f871e6b', 'request_id': 'req-f4814da9-c92e-431f-80b2-b10e494eae73'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:04.557705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f4814da9-c92e-431f-80b2-b10e494eae73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c738bca7684e7080a813298f871e6b', 'request_id': 'req-f4814da9-c92e-431f-80b2-b10e494eae73'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:04.564386 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f4814da9-c92e-431f-80b2-b10e494eae73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c738bca7684e7080a813298f871e6b', 'request_id': 'req-f4814da9-c92e-431f-80b2-b10e494eae73'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:04.579844 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f4814da9-c92e-431f-80b2-b10e494eae73 admin admin] The token cache is being invalidate because project 12c738bca7684e7080a813298f871e6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:38:04.580139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f4814da9-c92e-431f-80b2-b10e494eae73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:04.581454 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f4814da9-c92e-431f-80b2-b10e494eae73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:04.586911 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1161/2298] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:38:04 2022] DELETE /identity/v3/projects/12c738bca7684e7080a813298f871e6b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:04.588031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f614c6-5918-4623-83ed-5add89128904 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:04.588515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f614c6-5918-4623-83ed-5add89128904 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:04.588606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f614c6-5918-4623-83ed-5add89128904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:04.600185 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:04.619855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-92f614c6-5918-4623-83ed-5add89128904 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:04.621058 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-92f614c6-5918-4623-83ed-5add89128904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:04.691371 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1138/2299] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:04.700947 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df1916-e249-49de-a300-08c389bff5c9 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:04.701363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df1916-e249-49de-a300-08c389bff5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:04.701686 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df1916-e249-49de-a300-08c389bff5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:04.747688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-36df1916-e249-49de-a300-08c389bff5c9 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:04.752161 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-36df1916-e249-49de-a300-08c389bff5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:04.763203 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1162/2300] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:38:04.767080 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f614c6-5918-4623-83ed-5add89128904 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:04.777317 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f614c6-5918-4623-83ed-5add89128904 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:04.782030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305702c-0175-4887-847c-000b829e4dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:04.782625 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305702c-0175-4887-847c-000b829e4dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:04.782932 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305702c-0175-4887-847c-000b829e4dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:04.783204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305702c-0175-4887-847c-000b829e4dd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:04.783847 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305702c-0175-4887-847c-000b829e4dd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:38:04.784140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305702c-0175-4887-847c-000b829e4dd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:04.785699 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305702c-0175-4887-847c-000b829e4dd9 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:04.797883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1139/2301] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:38:04.802210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df1916-e249-49de-a300-08c389bff5c9 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:04.812662 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df1916-e249-49de-a300-08c389bff5c9 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:04.817618 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0daf89f-2ce9-45ec-b330-607d39f0a88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:04.818288 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daf89f-2ce9-45ec-b330-607d39f0a88f admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:04.818638 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daf89f-2ce9-45ec-b330-607d39f0a88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:04.819105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daf89f-2ce9-45ec-b330-607d39f0a88f admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:04.820217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0daf89f-2ce9-45ec-b330-607d39f0a88f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:04.822181 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0daf89f-2ce9-45ec-b330-607d39f0a88f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:04.853499 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1163/2302] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:38:04 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:38:04.854647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305702c-0175-4887-847c-000b829e4dd9 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:04.865722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305702c-0175-4887-847c-000b829e4dd9 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:04.930692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77c64d-91e6-42ce-9941-5c8d43337be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:04.931408 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77c64d-91e6-42ce-9941-5c8d43337be4 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:04.931714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77c64d-91e6-42ce-9941-5c8d43337be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:04.931966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77c64d-91e6-42ce-9941-5c8d43337be4 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:04.932830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77c64d-91e6-42ce-9941-5c8d43337be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:04.935654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77c64d-91e6-42ce-9941-5c8d43337be4 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:04.959183 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1140/2303] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:38:04 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:38:04.978900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0daf89f-2ce9-45ec-b330-607d39f0a88f admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:05.001113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0daf89f-2ce9-45ec-b330-607d39f0a88f admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:05.006248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229fbee-729a-4984-a394-456875f3973d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:05.007568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229fbee-729a-4984-a394-456875f3973d admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:05.008091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229fbee-729a-4984-a394-456875f3973d admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:05.008398 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229fbee-729a-4984-a394-456875f3973d admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:05.009068 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229fbee-729a-4984-a394-456875f3973d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:05.010917 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229fbee-729a-4984-a394-456875f3973d admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:05.026106 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77c64d-91e6-42ce-9941-5c8d43337be4 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:05.026461 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1164/2304] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:38:05.046504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77c64d-91e6-42ce-9941-5c8d43337be4 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:05.055391 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121bd72-0a30-4a27-bb96-b20e86ee24ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:05.056869 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121bd72-0a30-4a27-bb96-b20e86ee24ea admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:05.057179 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121bd72-0a30-4a27-bb96-b20e86ee24ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:05.057489 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121bd72-0a30-4a27-bb96-b20e86ee24ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:05.058172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121bd72-0a30-4a27-bb96-b20e86ee24ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:05.059907 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121bd72-0a30-4a27-bb96-b20e86ee24ea admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:05.076320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229fbee-729a-4984-a394-456875f3973d admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:05.078290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1141/2305] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:38:05.091066 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229fbee-729a-4984-a394-456875f3973d admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:05.098474 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ce44c-21a1-4368-957d-53753c359568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:05.098474 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ce44c-21a1-4368-957d-53753c359568 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:05.098474 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ce44c-21a1-4368-957d-53753c359568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:05.098474 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ce44c-21a1-4368-957d-53753c359568 admin admin] PATH_INFO: `/v3/projects/384c953cb1be4c01bebadfadc6c3f0bc/users/2b02ef8fb6f74bf39f8f1fbb47c9bce9/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:05.114819 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ce44c-21a1-4368-957d-53753c359568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=384c953cb1be4c01bebadfadc6c3f0bc, user_id=2b02ef8fb6f74bf39f8f1fbb47c9bce9, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:05.118426 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ce44c-21a1-4368-957d-53753c359568 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:05.121700 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:05.134618 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1165/2306] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:38:05 2022] PUT /identity/v3/projects/384c953cb1be4c01bebadfadc6c3f0bc/users/2b02ef8fb6f74bf39f8f1fbb47c9bce9/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:38:05.145125 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d20188-a53c-48e3-b9da-fbd5c0d964b1 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:05.145410 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d20188-a53c-48e3-b9da-fbd5c0d964b1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:05.145684 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d20188-a53c-48e3-b9da-fbd5c0d964b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:05.182021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-75d20188-a53c-48e3-b9da-fbd5c0d964b1 None None] MFA Rules not processed for user `2b02ef8fb6f74bf39f8f1fbb47c9bce9`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:05.183517 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-75d20188-a53c-48e3-b9da-fbd5c0d964b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:05.252650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:05.264009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ce44c-21a1-4368-957d-53753c359568 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:05.266026 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1142/2307] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:05.331226 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ce44c-21a1-4368-957d-53753c359568 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:05.336493 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb070d-c027-454a-b7d6-0f175a0bd882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:05.337092 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb070d-c027-454a-b7d6-0f175a0bd882 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:05.337368 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb070d-c027-454a-b7d6-0f175a0bd882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:05.337636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb070d-c027-454a-b7d6-0f175a0bd882 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:05.338264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb070d-c027-454a-b7d6-0f175a0bd882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:05.340178 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb070d-c027-454a-b7d6-0f175a0bd882 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:05.376297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1166/2308] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:38:05 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:38:05.377686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d20188-a53c-48e3-b9da-fbd5c0d964b1 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:05.393804 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d20188-a53c-48e3-b9da-fbd5c0d964b1 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:05.466722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e002d98-da5c-4b53-9729-8172306dc611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:05.467391 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e002d98-da5c-4b53-9729-8172306dc611 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:05.467671 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e002d98-da5c-4b53-9729-8172306dc611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:05.467951 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e002d98-da5c-4b53-9729-8172306dc611 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:05.468688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e002d98-da5c-4b53-9729-8172306dc611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:05.470515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e002d98-da5c-4b53-9729-8172306dc611 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:05.497245 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1143/2309] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:38:05 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:38:05.498490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb070d-c027-454a-b7d6-0f175a0bd882 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:05.511465 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb070d-c027-454a-b7d6-0f175a0bd882 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:05.516974 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754bc40-3011-432c-91c3-00e777fb8e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:05.517572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754bc40-3011-432c-91c3-00e777fb8e89 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:05.517855 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754bc40-3011-432c-91c3-00e777fb8e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:05.518134 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754bc40-3011-432c-91c3-00e777fb8e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:05.518775 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754bc40-3011-432c-91c3-00e777fb8e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:05.520375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754bc40-3011-432c-91c3-00e777fb8e89 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:05.533553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1167/2310] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:38:05.535928 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e002d98-da5c-4b53-9729-8172306dc611 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:05.546748 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e002d98-da5c-4b53-9729-8172306dc611 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:05.553285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffff596-9ee8-4ace-a3f5-6ab95208f273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:05.554028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffff596-9ee8-4ace-a3f5-6ab95208f273 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:05.554432 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffff596-9ee8-4ace-a3f5-6ab95208f273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:05.554795 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffff596-9ee8-4ace-a3f5-6ab95208f273 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:05.555516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffff596-9ee8-4ace-a3f5-6ab95208f273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:05.557205 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffff596-9ee8-4ace-a3f5-6ab95208f273 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:05.571876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1144/2311] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:38:05.573566 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754bc40-3011-432c-91c3-00e777fb8e89 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:05.584239 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754bc40-3011-432c-91c3-00e777fb8e89 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:05.590065 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8876f2-4293-4020-a78f-1f627a1ee086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:05.590765 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8876f2-4293-4020-a78f-1f627a1ee086 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:05.591100 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8876f2-4293-4020-a78f-1f627a1ee086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:05.591380 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8876f2-4293-4020-a78f-1f627a1ee086 admin admin] PATH_INFO: `/v3/projects/7de7e36c121648b99f86decc689ffefe/users/2490d9a23c244887aa66292b177fca62/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:05.607279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8876f2-4293-4020-a78f-1f627a1ee086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de7e36c121648b99f86decc689ffefe, user_id=2490d9a23c244887aa66292b177fca62, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:05.609952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8876f2-4293-4020-a78f-1f627a1ee086 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:05.623257 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1168/2312] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:38:05 2022] PUT /identity/v3/projects/7de7e36c121648b99f86decc689ffefe/users/2490d9a23c244887aa66292b177fca62/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:05.635806 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb612a-9568-40ab-8527-4ab82d8b1b89 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:05.636321 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb612a-9568-40ab-8527-4ab82d8b1b89 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:05.636424 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb612a-9568-40ab-8527-4ab82d8b1b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:05.670482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-77bb612a-9568-40ab-8527-4ab82d8b1b89 None None] MFA Rules not processed for user `2490d9a23c244887aa66292b177fca62`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:05.671753 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-77bb612a-9568-40ab-8527-4ab82d8b1b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:05.755913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1145/2313] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:05.761209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8876f2-4293-4020-a78f-1f627a1ee086 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:05.846172 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8876f2-4293-4020-a78f-1f627a1ee086 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:05.853072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21203960-1ac4-4346-acec-de4c9a97f024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:05.853744 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21203960-1ac4-4346-acec-de4c9a97f024 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:05.854116 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21203960-1ac4-4346-acec-de4c9a97f024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:05.854305 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21203960-1ac4-4346-acec-de4c9a97f024 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:05.855207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21203960-1ac4-4346-acec-de4c9a97f024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:05.857126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21203960-1ac4-4346-acec-de4c9a97f024 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:05.903745 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1169/2314] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:38:05 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:38:05.905109 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb612a-9568-40ab-8527-4ab82d8b1b89 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:05.922947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb612a-9568-40ab-8527-4ab82d8b1b89 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:05.987714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000726d-d095-450c-b77e-84b77b3c0ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:05.988367 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000726d-d095-450c-b77e-84b77b3c0ace admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:05.988672 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000726d-d095-450c-b77e-84b77b3c0ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:05.989346 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000726d-d095-450c-b77e-84b77b3c0ace admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:05.989605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000726d-d095-450c-b77e-84b77b3c0ace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:05.992293 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000726d-d095-450c-b77e-84b77b3c0ace admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:06.005961 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:06.021054 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1146/2315] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:38:05 2022] POST /identity/v3/users => generated 295 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:38:06.026650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21203960-1ac4-4346-acec-de4c9a97f024 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:06.038480 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21203960-1ac4-4346-acec-de4c9a97f024 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:06.044736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c6ca1-c8d2-45dd-b745-5f3c3ab86d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:06.045658 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c6ca1-c8d2-45dd-b745-5f3c3ab86d40 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:06.045941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c6ca1-c8d2-45dd-b745-5f3c3ab86d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:06.046242 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c6ca1-c8d2-45dd-b745-5f3c3ab86d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:06.046950 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c6ca1-c8d2-45dd-b745-5f3c3ab86d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:06.048786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c6ca1-c8d2-45dd-b745-5f3c3ab86d40 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:06.069002 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1170/2316] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:38:06.071718 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000726d-d095-450c-b77e-84b77b3c0ace admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:06.083913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000726d-d095-450c-b77e-84b77b3c0ace admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:06.090291 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252079b-c527-4f64-bec5-ef4d905f9c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:06.091234 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252079b-c527-4f64-bec5-ef4d905f9c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:06.091511 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252079b-c527-4f64-bec5-ef4d905f9c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:06.091783 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252079b-c527-4f64-bec5-ef4d905f9c99 admin admin] PATH_INFO: `/v3/projects/79eb18af7f134d3bba3f57c5e24369f7/users/3f4b44865c85485da97dfd1b628a20f0/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:06.124894 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252079b-c527-4f64-bec5-ef4d905f9c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79eb18af7f134d3bba3f57c5e24369f7, user_id=3f4b44865c85485da97dfd1b628a20f0, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:06.127599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252079b-c527-4f64-bec5-ef4d905f9c99 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:06.145803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1147/2317] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:38:06 2022] PUT /identity/v3/projects/79eb18af7f134d3bba3f57c5e24369f7/users/3f4b44865c85485da97dfd1b628a20f0/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:06.150072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c6ca1-c8d2-45dd-b745-5f3c3ab86d40 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:06.164156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c6ca1-c8d2-45dd-b745-5f3c3ab86d40 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:06.204695 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:06.265577 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82438811-c23f-4982-8f29-27ad2217e8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:06.266317 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82438811-c23f-4982-8f29-27ad2217e8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:06.266780 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82438811-c23f-4982-8f29-27ad2217e8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:06.267423 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82438811-c23f-4982-8f29-27ad2217e8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:06.268174 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82438811-c23f-4982-8f29-27ad2217e8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:06.281731 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82438811-c23f-4982-8f29-27ad2217e8d2 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:06.299199 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1171/2318] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:38:06.303685 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252079b-c527-4f64-bec5-ef4d905f9c99 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:06.314229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252079b-c527-4f64-bec5-ef4d905f9c99 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:06.320449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336d8a9-cc9b-4124-a4e6-30563a7462f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:06.321101 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336d8a9-cc9b-4124-a4e6-30563a7462f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:06.321376 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336d8a9-cc9b-4124-a4e6-30563a7462f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:06.321645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336d8a9-cc9b-4124-a4e6-30563a7462f9 admin admin] PATH_INFO: `/v3/projects/79eb18af7f134d3bba3f57c5e24369f7/users/3f4b44865c85485da97dfd1b628a20f0/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:06.324274 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336d8a9-cc9b-4124-a4e6-30563a7462f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79eb18af7f134d3bba3f57c5e24369f7, user_id=3f4b44865c85485da97dfd1b628a20f0, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:06.327222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336d8a9-cc9b-4124-a4e6-30563a7462f9 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:06.338691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1148/2319] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:38:06 2022] PUT /identity/v3/projects/79eb18af7f134d3bba3f57c5e24369f7/users/3f4b44865c85485da97dfd1b628a20f0/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:06.348710 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21409987-7a24-4397-868a-b1a144841951 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:06.348998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21409987-7a24-4397-868a-b1a144841951 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:06.349276 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21409987-7a24-4397-868a-b1a144841951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:06.377194 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-21409987-7a24-4397-868a-b1a144841951 None None] MFA Rules not processed for user `3f4b44865c85485da97dfd1b628a20f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:06.378295 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-21409987-7a24-4397-868a-b1a144841951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:06.450391 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1172/2320] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:06.462567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336d8a9-cc9b-4124-a4e6-30563a7462f9 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:06.464442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2336d8a9-cc9b-4124-a4e6-30563a7462f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:06.524796 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336d8a9-cc9b-4124-a4e6-30563a7462f9 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:06.528518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2bee7-b003-40d2-85d4-d222ddba64a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:06.529104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2bee7-b003-40d2-85d4-d222ddba64a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:06.529377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2bee7-b003-40d2-85d4-d222ddba64a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:06.529646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2bee7-b003-40d2-85d4-d222ddba64a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:06.586917 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2bee7-b003-40d2-85d4-d222ddba64a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:06.588337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2bee7-b003-40d2-85d4-d222ddba64a0 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:06.597191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1149/2321] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:38:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:38:06.943094 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21409987-7a24-4397-868a-b1a144841951 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:06.944695 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-21409987-7a24-4397-868a-b1a144841951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:07.009714 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21409987-7a24-4397-868a-b1a144841951 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:07.014646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abd206-9432-4c7a-9d8a-a839c154b512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:07.015362 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abd206-9432-4c7a-9d8a-a839c154b512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:07.015662 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abd206-9432-4c7a-9d8a-a839c154b512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:07.015948 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abd206-9432-4c7a-9d8a-a839c154b512 admin admin] PATH_INFO: `/v3/users/3cee849e5f4d4dd0860cbfc177eb716c` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:07.017094 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abd206-9432-4c7a-9d8a-a839c154b512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cee849e5f4d4dd0860cbfc177eb716c)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:07.019126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abd206-9432-4c7a-9d8a-a839c154b512 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:07.062344 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:07.064991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-09abd206-9432-4c7a-9d8a-a839c154b512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cee849e5f4d4dd0860cbfc177eb716c'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:07.066012 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-09abd206-9432-4c7a-9d8a-a839c154b512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cee849e5f4d4dd0860cbfc177eb716c'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:07.066641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-09abd206-9432-4c7a-9d8a-a839c154b512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cee849e5f4d4dd0860cbfc177eb716c'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:07.079138 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-09abd206-9432-4c7a-9d8a-a839c154b512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cee849e5f4d4dd0860cbfc177eb716c'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:07.085926 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-09abd206-9432-4c7a-9d8a-a839c154b512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cee849e5f4d4dd0860cbfc177eb716c'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:07.098648 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1173/2322] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:38:06 2022] DELETE /identity/v3/users/3cee849e5f4d4dd0860cbfc177eb716c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:07.103819 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5afc5-e7df-4aed-abbd-9abe97cacfbb None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:07.104266 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5afc5-e7df-4aed-abbd-9abe97cacfbb None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:07.104381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5afc5-e7df-4aed-abbd-9abe97cacfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:07.123548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-ecb5afc5-e7df-4aed-abbd-9abe97cacfbb None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:07.124725 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ecb5afc5-e7df-4aed-abbd-9abe97cacfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:07.182510 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1150/2323] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:07.192282 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abd206-9432-4c7a-9d8a-a839c154b512 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:07.193671 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-09abd206-9432-4c7a-9d8a-a839c154b512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:07.251823 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abd206-9432-4c7a-9d8a-a839c154b512 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:07.255496 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d6bf8-f222-404f-b0ef-98e7fb235f2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:07.256124 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d6bf8-f222-404f-b0ef-98e7fb235f2e service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:07.256400 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d6bf8-f222-404f-b0ef-98e7fb235f2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:07.256698 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d6bf8-f222-404f-b0ef-98e7fb235f2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:07.266112 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d6bf8-f222-404f-b0ef-98e7fb235f2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:07.267257 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d6bf8-f222-404f-b0ef-98e7fb235f2e service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:07.277273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1174/2324] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:38:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:38:07.640075 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5afc5-e7df-4aed-abbd-9abe97cacfbb None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:07.641551 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ecb5afc5-e7df-4aed-abbd-9abe97cacfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:07.659197 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5afc5-e7df-4aed-abbd-9abe97cacfbb None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:07.665844 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfed569-f58c-4ef7-82e6-d7c38c3f05ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:07.666481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfed569-f58c-4ef7-82e6-d7c38c3f05ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:07.666761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfed569-f58c-4ef7-82e6-d7c38c3f05ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:07.667114 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfed569-f58c-4ef7-82e6-d7c38c3f05ab admin admin] PATH_INFO: `/v3/projects/1f618a048f9f42889c363d8670b88239` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:07.668239 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfed569-f58c-4ef7-82e6-d7c38c3f05ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f618a048f9f42889c363d8670b88239)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:07.670194 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfed569-f58c-4ef7-82e6-d7c38c3f05ab admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:07.681040 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:07.722320 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9bfed569-f58c-4ef7-82e6-d7c38c3f05ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f618a048f9f42889c363d8670b88239', 'request_id': 'req-9bfed569-f58c-4ef7-82e6-d7c38c3f05ab'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:07.728799 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9bfed569-f58c-4ef7-82e6-d7c38c3f05ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f618a048f9f42889c363d8670b88239', 'request_id': 'req-9bfed569-f58c-4ef7-82e6-d7c38c3f05ab'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:07.735632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9bfed569-f58c-4ef7-82e6-d7c38c3f05ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f618a048f9f42889c363d8670b88239', 'request_id': 'req-9bfed569-f58c-4ef7-82e6-d7c38c3f05ab'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:07.749648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9bfed569-f58c-4ef7-82e6-d7c38c3f05ab admin admin] The token cache is being invalidate because project 1f618a048f9f42889c363d8670b88239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:38:07.749934 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9bfed569-f58c-4ef7-82e6-d7c38c3f05ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:07.750678 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9bfed569-f58c-4ef7-82e6-d7c38c3f05ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:07.752142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1151/2325] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:38:07 2022] DELETE /identity/v3/projects/1f618a048f9f42889c363d8670b88239 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:07.756870 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9378bc-de53-4b2b-83b5-f0c5f7e0c8a7 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:07.757223 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9378bc-de53-4b2b-83b5-f0c5f7e0c8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:07.757564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9378bc-de53-4b2b-83b5-f0c5f7e0c8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:07.778805 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-ab9378bc-de53-4b2b-83b5-f0c5f7e0c8a7 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:07.780497 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-ab9378bc-de53-4b2b-83b5-f0c5f7e0c8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:07.845111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1175/2326] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:38:07.852905 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fa550-7253-4c69-9a3a-7ac90b731b73 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:07.853185 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fa550-7253-4c69-9a3a-7ac90b731b73 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:07.853457 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fa550-7253-4c69-9a3a-7ac90b731b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:07.874489 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-611fa550-7253-4c69-9a3a-7ac90b731b73 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:07.877244 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-611fa550-7253-4c69-9a3a-7ac90b731b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:07.885867 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1152/2327] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:38:07.890082 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9378bc-de53-4b2b-83b5-f0c5f7e0c8a7 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:07.900257 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9378bc-de53-4b2b-83b5-f0c5f7e0c8a7 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:07.906471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a56991-98f4-4f06-9ea4-643e55cc98b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:07.906920 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a56991-98f4-4f06-9ea4-643e55cc98b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:07.907199 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a56991-98f4-4f06-9ea4-643e55cc98b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:07.907469 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a56991-98f4-4f06-9ea4-643e55cc98b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:07.908104 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a56991-98f4-4f06-9ea4-643e55cc98b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:38:07.908403 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a56991-98f4-4f06-9ea4-643e55cc98b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:07.910133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a56991-98f4-4f06-9ea4-643e55cc98b0 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:07.927436 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1176/2328] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:38:07.929206 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fa550-7253-4c69-9a3a-7ac90b731b73 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:07.938733 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fa550-7253-4c69-9a3a-7ac90b731b73 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:07.945639 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ee2a5-c2c3-44b0-9591-b25b7e14862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:07.946256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ee2a5-c2c3-44b0-9591-b25b7e14862f admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:07.946539 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ee2a5-c2c3-44b0-9591-b25b7e14862f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:07.946800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ee2a5-c2c3-44b0-9591-b25b7e14862f admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:07.947465 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ee2a5-c2c3-44b0-9591-b25b7e14862f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:07.949943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ee2a5-c2c3-44b0-9591-b25b7e14862f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:07.983628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1153/2329] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:38:07 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:38:07.987890 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a56991-98f4-4f06-9ea4-643e55cc98b0 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:08.000401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a56991-98f4-4f06-9ea4-643e55cc98b0 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:08.071681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:08.093513 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea08f8-f7e1-46cd-8719-ac5a8a86477d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:08.094363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea08f8-f7e1-46cd-8719-ac5a8a86477d admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:08.094878 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea08f8-f7e1-46cd-8719-ac5a8a86477d admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:08.095460 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea08f8-f7e1-46cd-8719-ac5a8a86477d admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:08.096312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea08f8-f7e1-46cd-8719-ac5a8a86477d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:08.098630 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea08f8-f7e1-46cd-8719-ac5a8a86477d admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:08.125381 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1177/2330] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:38:07 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:38:08.129360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ee2a5-c2c3-44b0-9591-b25b7e14862f admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:08.146282 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea08f8-f7e1-46cd-8719-ac5a8a86477d admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:08.148233 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ee2a5-c2c3-44b0-9591-b25b7e14862f admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:08.148606 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0dea08f8-f7e1-46cd-8719-ac5a8a86477d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:08.153028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56f234-9df8-4911-91e8-20c865e10a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:08.153706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56f234-9df8-4911-91e8-20c865e10a8a admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:08.153986 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56f234-9df8-4911-91e8-20c865e10a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:08.154621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56f234-9df8-4911-91e8-20c865e10a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:08.155309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56f234-9df8-4911-91e8-20c865e10a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:08.157989 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56f234-9df8-4911-91e8-20c865e10a8a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:08.170882 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1154/2331] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:38:08.175576 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56f234-9df8-4911-91e8-20c865e10a8a admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:08.187579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56f234-9df8-4911-91e8-20c865e10a8a admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:08.193814 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac81bfb-568b-46c9-a876-b21efedbe3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:08.194681 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac81bfb-568b-46c9-a876-b21efedbe3ed admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:08.195643 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac81bfb-568b-46c9-a876-b21efedbe3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:08.195926 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac81bfb-568b-46c9-a876-b21efedbe3ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:08.196575 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac81bfb-568b-46c9-a876-b21efedbe3ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:08.198525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac81bfb-568b-46c9-a876-b21efedbe3ed admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:08.213275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1155/2332] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:38:08.214614 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac81bfb-568b-46c9-a876-b21efedbe3ed admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:08.219891 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea08f8-f7e1-46cd-8719-ac5a8a86477d admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:08.226270 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac81bfb-568b-46c9-a876-b21efedbe3ed admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:08.227504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be940c70-d013-4d79-a756-f322e6835fd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:08.228133 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be940c70-d013-4d79-a756-f322e6835fd5 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:08.228410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be940c70-d013-4d79-a756-f322e6835fd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:08.228678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be940c70-d013-4d79-a756-f322e6835fd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:08.230481 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-be940c70-d013-4d79-a756-f322e6835fd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:08.231852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd597d7-df72-4843-8ea3-dc1b3c3a9b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:08.232846 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd597d7-df72-4843-8ea3-dc1b3c3a9b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:08.233369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd597d7-df72-4843-8ea3-dc1b3c3a9b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:08.233746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd597d7-df72-4843-8ea3-dc1b3c3a9b32 admin admin] PATH_INFO: `/v3/projects/0b9fccaa106e4826a820e6608392f2f2/users/241f49075bdf42429a422fe90b33124d/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:08.251899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd597d7-df72-4843-8ea3-dc1b3c3a9b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b9fccaa106e4826a820e6608392f2f2, user_id=241f49075bdf42429a422fe90b33124d, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:08.254899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd597d7-df72-4843-8ea3-dc1b3c3a9b32 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:08.271351 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1156/2333] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:38:08 2022] PUT /identity/v3/projects/0b9fccaa106e4826a820e6608392f2f2/users/241f49075bdf42429a422fe90b33124d/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:08.277487 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef50de-acf2-4196-bb5f-122c31a95674 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:08.278239 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef50de-acf2-4196-bb5f-122c31a95674 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:08.278620 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef50de-acf2-4196-bb5f-122c31a95674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:08.298099 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be940c70-d013-4d79-a756-f322e6835fd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:08.299394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-17ef50de-acf2-4196-bb5f-122c31a95674 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:08.299827 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be940c70-d013-4d79-a756-f322e6835fd5 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:08.300756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-17ef50de-acf2-4196-bb5f-122c31a95674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:08.311086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1178/2334] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:38:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:38:08.399592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1157/2335] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:08.410590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be940c70-d013-4d79-a756-f322e6835fd5 service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:08.413874 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-be940c70-d013-4d79-a756-f322e6835fd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:08.490000 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be940c70-d013-4d79-a756-f322e6835fd5 service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:08.585892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05475e48-afb3-4291-bafb-fb1925e02629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:08.586502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475e48-afb3-4291-bafb-fb1925e02629 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:08.586787 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475e48-afb3-4291-bafb-fb1925e02629 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:08.587189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475e48-afb3-4291-bafb-fb1925e02629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:08.599275 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:08.609614 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05475e48-afb3-4291-bafb-fb1925e02629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:08.611225 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05475e48-afb3-4291-bafb-fb1925e02629 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:08.625765 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1179/2336] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:38:09.082864 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef50de-acf2-4196-bb5f-122c31a95674 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:09.112301 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:09.155406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef50de-acf2-4196-bb5f-122c31a95674 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:09.164794 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0487cc8-ad32-435f-a8c7-f617f406e076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:09.165432 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0487cc8-ad32-435f-a8c7-f617f406e076 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:09.165804 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0487cc8-ad32-435f-a8c7-f617f406e076 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:09.166294 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0487cc8-ad32-435f-a8c7-f617f406e076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:09.169162 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b0487cc8-ad32-435f-a8c7-f617f406e076 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:09.249482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0487cc8-ad32-435f-a8c7-f617f406e076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:09.251010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0487cc8-ad32-435f-a8c7-f617f406e076 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:09.266710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1158/2337] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:38:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:38:09.564877 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc52a9-b8d0-4da3-bbca-9ff6d28cd396 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:09.565365 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc52a9-b8d0-4da3-bbca-9ff6d28cd396 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:09.565448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc52a9-b8d0-4da3-bbca-9ff6d28cd396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:09.606841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-11cc52a9-b8d0-4da3-bbca-9ff6d28cd396 None None] MFA Rules not processed for user `241f49075bdf42429a422fe90b33124d`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:09.608470 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-11cc52a9-b8d0-4da3-bbca-9ff6d28cd396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:09.692396 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1180/2338] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:09.704075 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0487cc8-ad32-435f-a8c7-f617f406e076 service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:09.705722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b0487cc8-ad32-435f-a8c7-f617f406e076 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:09.733538 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0487cc8-ad32-435f-a8c7-f617f406e076 service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:09.744775 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74227d0c-5923-4c34-86d1-c0a80b0ea302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:09.745641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74227d0c-5923-4c34-86d1-c0a80b0ea302 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:09.746009 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74227d0c-5923-4c34-86d1-c0a80b0ea302 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:09.746607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74227d0c-5923-4c34-86d1-c0a80b0ea302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:09.750636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc52a9-b8d0-4da3-bbca-9ff6d28cd396 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:09.752140 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-11cc52a9-b8d0-4da3-bbca-9ff6d28cd396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:09.759808 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74227d0c-5923-4c34-86d1-c0a80b0ea302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:09.761451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74227d0c-5923-4c34-86d1-c0a80b0ea302 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:09.768499 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc52a9-b8d0-4da3-bbca-9ff6d28cd396 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:09.774556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613f98a-2b2e-42e5-864c-b3fb691f31b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:09.775374 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613f98a-2b2e-42e5-864c-b3fb691f31b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:09.775753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613f98a-2b2e-42e5-864c-b3fb691f31b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:09.776130 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613f98a-2b2e-42e5-864c-b3fb691f31b0 admin admin] PATH_INFO: `/v3/users/e95e3c5e21c441aea07cccfdfc3bbb1b` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:09.777417 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613f98a-2b2e-42e5-864c-b3fb691f31b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e95e3c5e21c441aea07cccfdfc3bbb1b)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:09.777761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1159/2339] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:38:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:38:09.779930 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613f98a-2b2e-42e5-864c-b3fb691f31b0 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:09.836168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6613f98a-2b2e-42e5-864c-b3fb691f31b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e95e3c5e21c441aea07cccfdfc3bbb1b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:09.837046 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6613f98a-2b2e-42e5-864c-b3fb691f31b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e95e3c5e21c441aea07cccfdfc3bbb1b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:09.837682 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6613f98a-2b2e-42e5-864c-b3fb691f31b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e95e3c5e21c441aea07cccfdfc3bbb1b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:09.853844 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6613f98a-2b2e-42e5-864c-b3fb691f31b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e95e3c5e21c441aea07cccfdfc3bbb1b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:09.872059 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6613f98a-2b2e-42e5-864c-b3fb691f31b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e95e3c5e21c441aea07cccfdfc3bbb1b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:09.906884 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1181/2340] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:38:09 2022] DELETE /identity/v3/users/e95e3c5e21c441aea07cccfdfc3bbb1b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:38:09.912278 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940e240-fca6-4d6b-ac0c-3c122a7c2c24 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:09.912559 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940e240-fca6-4d6b-ac0c-3c122a7c2c24 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:09.913375 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940e240-fca6-4d6b-ac0c-3c122a7c2c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:09.933964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2940e240-fca6-4d6b-ac0c-3c122a7c2c24 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:09.935224 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2940e240-fca6-4d6b-ac0c-3c122a7c2c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:10.014899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1160/2341] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:10.024579 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613f98a-2b2e-42e5-864c-b3fb691f31b0 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:10.026068 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6613f98a-2b2e-42e5-864c-b3fb691f31b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:10.110119 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613f98a-2b2e-42e5-864c-b3fb691f31b0 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:10.114385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33314b-175e-4207-b1c7-034db4d9b309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:10.115410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33314b-175e-4207-b1c7-034db4d9b309 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:10.116625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33314b-175e-4207-b1c7-034db4d9b309 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:10.117146 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33314b-175e-4207-b1c7-034db4d9b309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:10.131542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33314b-175e-4207-b1c7-034db4d9b309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:10.133810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33314b-175e-4207-b1c7-034db4d9b309 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:10.139360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:10.188002 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1182/2342] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:38:10.492177 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940e240-fca6-4d6b-ac0c-3c122a7c2c24 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:10.495066 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2940e240-fca6-4d6b-ac0c-3c122a7c2c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:10.508718 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940e240-fca6-4d6b-ac0c-3c122a7c2c24 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:10.513943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cf6ba-93e2-4940-b45c-5deaf5063815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:10.515236 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cf6ba-93e2-4940-b45c-5deaf5063815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:10.515668 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cf6ba-93e2-4940-b45c-5deaf5063815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:10.516088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cf6ba-93e2-4940-b45c-5deaf5063815 admin admin] PATH_INFO: `/v3/projects/d95b60b8694f408b876f39d7efaaca54` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:10.517421 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cf6ba-93e2-4940-b45c-5deaf5063815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d95b60b8694f408b876f39d7efaaca54)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:10.519554 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cf6ba-93e2-4940-b45c-5deaf5063815 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:10.582803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6a0cf6ba-93e2-4940-b45c-5deaf5063815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd95b60b8694f408b876f39d7efaaca54', 'request_id': 'req-6a0cf6ba-93e2-4940-b45c-5deaf5063815'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:10.587819 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:10.592297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6a0cf6ba-93e2-4940-b45c-5deaf5063815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd95b60b8694f408b876f39d7efaaca54', 'request_id': 'req-6a0cf6ba-93e2-4940-b45c-5deaf5063815'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:10.610438 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6a0cf6ba-93e2-4940-b45c-5deaf5063815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd95b60b8694f408b876f39d7efaaca54', 'request_id': 'req-6a0cf6ba-93e2-4940-b45c-5deaf5063815'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:10.631061 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6a0cf6ba-93e2-4940-b45c-5deaf5063815 admin admin] The token cache is being invalidate because project d95b60b8694f408b876f39d7efaaca54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:38:10.632077 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6a0cf6ba-93e2-4940-b45c-5deaf5063815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:10.633272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-6a0cf6ba-93e2-4940-b45c-5deaf5063815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:10.635430 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1161/2343] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:38:10 2022] DELETE /identity/v3/projects/d95b60b8694f408b876f39d7efaaca54 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:10.640528 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1d314-945c-4fbe-9774-5ca6d50e6c48 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:10.641137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1d314-945c-4fbe-9774-5ca6d50e6c48 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:10.641518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1d314-945c-4fbe-9774-5ca6d50e6c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:10.667978 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-02d1d314-945c-4fbe-9774-5ca6d50e6c48 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:10.670122 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-02d1d314-945c-4fbe-9774-5ca6d50e6c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:10.797524 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1183/2344] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:38:10.798530 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f207df1-22f6-49bf-8b97-2ede93e05b6d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:10.798910 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f207df1-22f6-49bf-8b97-2ede93e05b6d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:10.799136 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f207df1-22f6-49bf-8b97-2ede93e05b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:10.820366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-1f207df1-22f6-49bf-8b97-2ede93e05b6d None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:10.821678 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1f207df1-22f6-49bf-8b97-2ede93e05b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:10.831319 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1162/2345] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:10.835412 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1d314-945c-4fbe-9774-5ca6d50e6c48 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:10.845218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1d314-945c-4fbe-9774-5ca6d50e6c48 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:10.850025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f3026-8943-4c73-adee-1d0e4a4a085d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:10.851250 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f3026-8943-4c73-adee-1d0e4a4a085d admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:10.851529 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f3026-8943-4c73-adee-1d0e4a4a085d admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:10.851801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f3026-8943-4c73-adee-1d0e4a4a085d admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:10.852500 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f3026-8943-4c73-adee-1d0e4a4a085d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:38:10.852806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f3026-8943-4c73-adee-1d0e4a4a085d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:10.854445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f3026-8943-4c73-adee-1d0e4a4a085d admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:10.867493 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1184/2346] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:38:10.871991 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f207df1-22f6-49bf-8b97-2ede93e05b6d None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:10.881225 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f207df1-22f6-49bf-8b97-2ede93e05b6d None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:10.886191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b562736-27cd-4d69-be39-e4b54cb20e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:10.886967 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b562736-27cd-4d69-be39-e4b54cb20e06 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:10.887242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b562736-27cd-4d69-be39-e4b54cb20e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:10.887513 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b562736-27cd-4d69-be39-e4b54cb20e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:10.888148 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b562736-27cd-4d69-be39-e4b54cb20e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:10.890013 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b562736-27cd-4d69-be39-e4b54cb20e06 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:10.923027 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1163/2347] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:38:10 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:38:10.924105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f3026-8943-4c73-adee-1d0e4a4a085d admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:10.934854 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f3026-8943-4c73-adee-1d0e4a4a085d admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:10.995866 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcfb75-a036-434d-8521-2fdea815ed7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:10.996473 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcfb75-a036-434d-8521-2fdea815ed7f admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:10.996750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcfb75-a036-434d-8521-2fdea815ed7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:10.997021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcfb75-a036-434d-8521-2fdea815ed7f admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:10.997664 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcfb75-a036-434d-8521-2fdea815ed7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:10.999610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcfb75-a036-434d-8521-2fdea815ed7f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:11.021930 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1185/2348] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:38:10 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:38:11.026494 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b562736-27cd-4d69-be39-e4b54cb20e06 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:11.037216 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b562736-27cd-4d69-be39-e4b54cb20e06 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:11.042167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3b22c-b1df-4e9e-a0b6-b72ef71541c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:11.042774 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3b22c-b1df-4e9e-a0b6-b72ef71541c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:11.043149 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3b22c-b1df-4e9e-a0b6-b72ef71541c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:11.043426 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3b22c-b1df-4e9e-a0b6-b72ef71541c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:11.044069 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3b22c-b1df-4e9e-a0b6-b72ef71541c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:11.045669 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3b22c-b1df-4e9e-a0b6-b72ef71541c1 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:11.058977 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1164/2349] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:38:11.060800 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcfb75-a036-434d-8521-2fdea815ed7f admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:11.071179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcfb75-a036-434d-8521-2fdea815ed7f admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:11.076217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d46db8-89cc-4815-9598-21aebc364a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:11.076870 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d46db8-89cc-4815-9598-21aebc364a29 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:11.077080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d46db8-89cc-4815-9598-21aebc364a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:11.077353 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d46db8-89cc-4815-9598-21aebc364a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:11.077991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d46db8-89cc-4815-9598-21aebc364a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:11.079673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d46db8-89cc-4815-9598-21aebc364a29 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:11.091160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1186/2350] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:38:11.095441 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3b22c-b1df-4e9e-a0b6-b72ef71541c1 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:11.106019 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3b22c-b1df-4e9e-a0b6-b72ef71541c1 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:11.110629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031370d-df45-4418-a4ca-b97549a69e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:11.111312 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031370d-df45-4418-a4ca-b97549a69e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:11.111570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031370d-df45-4418-a4ca-b97549a69e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:11.111842 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031370d-df45-4418-a4ca-b97549a69e76 admin admin] PATH_INFO: `/v3/projects/a89f027f39634bc9a074fc95e5b3ed20/users/9a738d9259154f36be759e8557d044b2/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:11.126120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031370d-df45-4418-a4ca-b97549a69e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a89f027f39634bc9a074fc95e5b3ed20, user_id=9a738d9259154f36be759e8557d044b2, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:11.128764 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031370d-df45-4418-a4ca-b97549a69e76 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:11.141759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1165/2351] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:38:11 2022] PUT /identity/v3/projects/a89f027f39634bc9a074fc95e5b3ed20/users/9a738d9259154f36be759e8557d044b2/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:11.152722 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecb6b6-f3b4-475e-b2b3-59d7585cd2e6 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:11.153031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecb6b6-f3b4-475e-b2b3-59d7585cd2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:11.153331 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecb6b6-f3b4-475e-b2b3-59d7585cd2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:11.182961 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-b6ecb6b6-f3b4-475e-b2b3-59d7585cd2e6 None None] MFA Rules not processed for user `9a738d9259154f36be759e8557d044b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:11.184198 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b6ecb6b6-f3b4-475e-b2b3-59d7585cd2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:11.248178 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:11.264931 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1187/2352] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:11.277082 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031370d-df45-4418-a4ca-b97549a69e76 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:11.279214 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2031370d-df45-4418-a4ca-b97549a69e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:11.346917 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031370d-df45-4418-a4ca-b97549a69e76 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:11.351090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593da623-4db9-4944-add7-a4ffbe0039ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:11.351694 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593da623-4db9-4944-add7-a4ffbe0039ab service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:11.351974 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593da623-4db9-4944-add7-a4ffbe0039ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:11.352248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593da623-4db9-4944-add7-a4ffbe0039ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:11.360337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593da623-4db9-4944-add7-a4ffbe0039ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:11.361754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593da623-4db9-4944-add7-a4ffbe0039ab service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:11.370555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1166/2353] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:38:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:38:12.360329 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d01b12-d51f-4fb3-a585-beeb2a8db0ac None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:12.360770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d01b12-d51f-4fb3-a585-beeb2a8db0ac None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:12.360922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d01b12-d51f-4fb3-a585-beeb2a8db0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:12.383602 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-73d01b12-d51f-4fb3-a585-beeb2a8db0ac None None] MFA Rules not processed for user `241f49075bdf42429a422fe90b33124d`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:12.384862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-73d01b12-d51f-4fb3-a585-beeb2a8db0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:12.452515 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1188/2354] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:13.268461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593da623-4db9-4944-add7-a4ffbe0039ab service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:13.271179 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-593da623-4db9-4944-add7-a4ffbe0039ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:13.342937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593da623-4db9-4944-add7-a4ffbe0039ab service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:13.348016 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f194c5-c2b8-4152-8950-96eabd9bdefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:13.348657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f194c5-c2b8-4152-8950-96eabd9bdefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:13.349046 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f194c5-c2b8-4152-8950-96eabd9bdefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:13.349330 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f194c5-c2b8-4152-8950-96eabd9bdefa admin admin] PATH_INFO: `/v3/users/2b02ef8fb6f74bf39f8f1fbb47c9bce9` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:13.350470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f194c5-c2b8-4152-8950-96eabd9bdefa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b02ef8fb6f74bf39f8f1fbb47c9bce9)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:13.353039 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f194c5-c2b8-4152-8950-96eabd9bdefa admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:13.375776 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:13.409947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-43f194c5-c2b8-4152-8950-96eabd9bdefa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b02ef8fb6f74bf39f8f1fbb47c9bce9'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:13.410676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-43f194c5-c2b8-4152-8950-96eabd9bdefa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b02ef8fb6f74bf39f8f1fbb47c9bce9'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:13.411373 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-43f194c5-c2b8-4152-8950-96eabd9bdefa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b02ef8fb6f74bf39f8f1fbb47c9bce9'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:13.425473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-43f194c5-c2b8-4152-8950-96eabd9bdefa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b02ef8fb6f74bf39f8f1fbb47c9bce9'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:13.434052 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-43f194c5-c2b8-4152-8950-96eabd9bdefa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b02ef8fb6f74bf39f8f1fbb47c9bce9'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:13.447739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1167/2355] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:38:13 2022] DELETE /identity/v3/users/2b02ef8fb6f74bf39f8f1fbb47c9bce9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:13.452567 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8b9af-65db-44a9-bd5b-f8a49069fdc2 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:13.453053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8b9af-65db-44a9-bd5b-f8a49069fdc2 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:13.453151 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8b9af-65db-44a9-bd5b-f8a49069fdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:13.472322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-e7e8b9af-65db-44a9-bd5b-f8a49069fdc2 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:13.473501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e7e8b9af-65db-44a9-bd5b-f8a49069fdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:13.531192 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1189/2356] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:38:13.541601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f194c5-c2b8-4152-8950-96eabd9bdefa admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:13.543195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-43f194c5-c2b8-4152-8950-96eabd9bdefa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:13.607835 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f194c5-c2b8-4152-8950-96eabd9bdefa admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:13.613629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577f985-8edf-4520-b4d3-6fcc35ca8720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:13.613629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577f985-8edf-4520-b4d3-6fcc35ca8720 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:13.613629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577f985-8edf-4520-b4d3-6fcc35ca8720 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:13.613966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577f985-8edf-4520-b4d3-6fcc35ca8720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:13.625512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577f985-8edf-4520-b4d3-6fcc35ca8720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:13.627317 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577f985-8edf-4520-b4d3-6fcc35ca8720 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:13.641038 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1168/2357] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:38:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:38:13.946247 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8b9af-65db-44a9-bd5b-f8a49069fdc2 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:13.948392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e7e8b9af-65db-44a9-bd5b-f8a49069fdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:13.961319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8b9af-65db-44a9-bd5b-f8a49069fdc2 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:13.966634 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f282cf6-53a2-44c3-832f-b5d520691e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:13.967297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f282cf6-53a2-44c3-832f-b5d520691e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:13.967737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f282cf6-53a2-44c3-832f-b5d520691e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:13.968014 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f282cf6-53a2-44c3-832f-b5d520691e32 admin admin] PATH_INFO: `/v3/projects/384c953cb1be4c01bebadfadc6c3f0bc` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:13.969172 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f282cf6-53a2-44c3-832f-b5d520691e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=384c953cb1be4c01bebadfadc6c3f0bc)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:13.971093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f282cf6-53a2-44c3-832f-b5d520691e32 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:14.028404 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4f282cf6-53a2-44c3-832f-b5d520691e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384c953cb1be4c01bebadfadc6c3f0bc', 'request_id': 'req-4f282cf6-53a2-44c3-832f-b5d520691e32'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:14.036773 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4f282cf6-53a2-44c3-832f-b5d520691e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384c953cb1be4c01bebadfadc6c3f0bc', 'request_id': 'req-4f282cf6-53a2-44c3-832f-b5d520691e32'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:14.043353 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4f282cf6-53a2-44c3-832f-b5d520691e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384c953cb1be4c01bebadfadc6c3f0bc', 'request_id': 'req-4f282cf6-53a2-44c3-832f-b5d520691e32'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:14.055979 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4f282cf6-53a2-44c3-832f-b5d520691e32 admin admin] The token cache is being invalidate because project 384c953cb1be4c01bebadfadc6c3f0bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:38:14.056276 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4f282cf6-53a2-44c3-832f-b5d520691e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:14.056993 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4f282cf6-53a2-44c3-832f-b5d520691e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:14.058623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1190/2358] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:38:13 2022] DELETE /identity/v3/projects/384c953cb1be4c01bebadfadc6c3f0bc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:14.062943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577f985-8edf-4520-b4d3-6fcc35ca8720 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:14.075120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577f985-8edf-4520-b4d3-6fcc35ca8720 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:14.161922 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8696b-2ccb-44e4-90dc-d1660694d6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:14.162632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8696b-2ccb-44e4-90dc-d1660694d6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:14.163253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8696b-2ccb-44e4-90dc-d1660694d6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:14.163442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8696b-2ccb-44e4-90dc-d1660694d6ba admin admin] PATH_INFO: `/v3/users/2490d9a23c244887aa66292b177fca62` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:14.167055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8696b-2ccb-44e4-90dc-d1660694d6ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=2490d9a23c244887aa66292b177fca62)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:14.167640 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8696b-2ccb-44e4-90dc-d1660694d6ba admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:14.216156 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:14.218037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-aaf8696b-2ccb-44e4-90dc-d1660694d6ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2490d9a23c244887aa66292b177fca62'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:14.218977 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-aaf8696b-2ccb-44e4-90dc-d1660694d6ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2490d9a23c244887aa66292b177fca62'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:14.220047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-aaf8696b-2ccb-44e4-90dc-d1660694d6ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2490d9a23c244887aa66292b177fca62'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:14.233761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-aaf8696b-2ccb-44e4-90dc-d1660694d6ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2490d9a23c244887aa66292b177fca62'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:14.240590 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-aaf8696b-2ccb-44e4-90dc-d1660694d6ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2490d9a23c244887aa66292b177fca62'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:14.253020 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1169/2359] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:38:14 2022] DELETE /identity/v3/users/2490d9a23c244887aa66292b177fca62 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:14.662873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f282cf6-53a2-44c3-832f-b5d520691e32 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:14.665129 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4f282cf6-53a2-44c3-832f-b5d520691e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:14.691783 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f282cf6-53a2-44c3-832f-b5d520691e32 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:14.716214 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:14.759648 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8904efe-97aa-49ff-a207-d7950bfb5e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:14.760265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8904efe-97aa-49ff-a207-d7950bfb5e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:14.760541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8904efe-97aa-49ff-a207-d7950bfb5e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:14.760812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8904efe-97aa-49ff-a207-d7950bfb5e5a admin admin] PATH_INFO: `/v3/projects/7de7e36c121648b99f86decc689ffefe` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:14.761903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8904efe-97aa-49ff-a207-d7950bfb5e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7de7e36c121648b99f86decc689ffefe)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:14.763835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8904efe-97aa-49ff-a207-d7950bfb5e5a admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:14.823068 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f8904efe-97aa-49ff-a207-d7950bfb5e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7de7e36c121648b99f86decc689ffefe', 'request_id': 'req-f8904efe-97aa-49ff-a207-d7950bfb5e5a'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:14.831522 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f8904efe-97aa-49ff-a207-d7950bfb5e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7de7e36c121648b99f86decc689ffefe', 'request_id': 'req-f8904efe-97aa-49ff-a207-d7950bfb5e5a'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:14.843491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f8904efe-97aa-49ff-a207-d7950bfb5e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7de7e36c121648b99f86decc689ffefe', 'request_id': 'req-f8904efe-97aa-49ff-a207-d7950bfb5e5a'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:14.859833 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f8904efe-97aa-49ff-a207-d7950bfb5e5a admin admin] The token cache is being invalidate because project 7de7e36c121648b99f86decc689ffefe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:38:14.860308 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f8904efe-97aa-49ff-a207-d7950bfb5e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:14.861044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f8904efe-97aa-49ff-a207-d7950bfb5e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:14.865661 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1191/2360] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:38:14 2022] DELETE /identity/v3/projects/7de7e36c121648b99f86decc689ffefe => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:14.868619 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8696b-2ccb-44e4-90dc-d1660694d6ba admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:14.870472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-aaf8696b-2ccb-44e4-90dc-d1660694d6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:14.897996 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8696b-2ccb-44e4-90dc-d1660694d6ba admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:14.990659 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2309c-655b-4f62-bb40-481789959368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:14.991221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2309c-655b-4f62-bb40-481789959368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:14.992047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2309c-655b-4f62-bb40-481789959368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:14.992467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2309c-655b-4f62-bb40-481789959368 admin admin] PATH_INFO: `/v3/users/3f4b44865c85485da97dfd1b628a20f0` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:14.993676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2309c-655b-4f62-bb40-481789959368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f4b44865c85485da97dfd1b628a20f0)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:14.995810 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2309c-655b-4f62-bb40-481789959368 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:15.050710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-31b2309c-655b-4f62-bb40-481789959368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f4b44865c85485da97dfd1b628a20f0'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:15.051766 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-31b2309c-655b-4f62-bb40-481789959368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f4b44865c85485da97dfd1b628a20f0'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:15.052404 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-31b2309c-655b-4f62-bb40-481789959368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f4b44865c85485da97dfd1b628a20f0'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:15.066531 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-31b2309c-655b-4f62-bb40-481789959368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f4b44865c85485da97dfd1b628a20f0'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:15.078327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-31b2309c-655b-4f62-bb40-481789959368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f4b44865c85485da97dfd1b628a20f0'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:15.098346 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1170/2361] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:38:14 2022] DELETE /identity/v3/users/3f4b44865c85485da97dfd1b628a20f0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:15.512584 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8904efe-97aa-49ff-a207-d7950bfb5e5a admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:15.515054 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f8904efe-97aa-49ff-a207-d7950bfb5e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:15.532225 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8904efe-97aa-49ff-a207-d7950bfb5e5a admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:15.604155 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182e364-ac42-4fb5-a367-3efa410a1a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:15.604794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182e364-ac42-4fb5-a367-3efa410a1a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:15.605085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182e364-ac42-4fb5-a367-3efa410a1a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:15.605341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182e364-ac42-4fb5-a367-3efa410a1a4a admin admin] PATH_INFO: `/v3/projects/79eb18af7f134d3bba3f57c5e24369f7` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:15.606492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182e364-ac42-4fb5-a367-3efa410a1a4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=79eb18af7f134d3bba3f57c5e24369f7)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:15.608566 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182e364-ac42-4fb5-a367-3efa410a1a4a admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:15.665362 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-a182e364-ac42-4fb5-a367-3efa410a1a4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79eb18af7f134d3bba3f57c5e24369f7', 'request_id': 'req-a182e364-ac42-4fb5-a367-3efa410a1a4a'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:15.675996 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-a182e364-ac42-4fb5-a367-3efa410a1a4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79eb18af7f134d3bba3f57c5e24369f7', 'request_id': 'req-a182e364-ac42-4fb5-a367-3efa410a1a4a'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:15.677294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:15.684872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-a182e364-ac42-4fb5-a367-3efa410a1a4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79eb18af7f134d3bba3f57c5e24369f7', 'request_id': 'req-a182e364-ac42-4fb5-a367-3efa410a1a4a'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:15.699496 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-a182e364-ac42-4fb5-a367-3efa410a1a4a admin admin] The token cache is being invalidate because project 79eb18af7f134d3bba3f57c5e24369f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:38:15.699970 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-a182e364-ac42-4fb5-a367-3efa410a1a4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:15.700759 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-a182e364-ac42-4fb5-a367-3efa410a1a4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:15.702700 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1192/2362] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:38:15 2022] DELETE /identity/v3/projects/79eb18af7f134d3bba3f57c5e24369f7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:15.707331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fd7ec-6050-4052-bb92-079a286e4525 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:15.707586 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fd7ec-6050-4052-bb92-079a286e4525 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:15.707836 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fd7ec-6050-4052-bb92-079a286e4525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:15.729265 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-858fd7ec-6050-4052-bb92-079a286e4525 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:15.730575 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-858fd7ec-6050-4052-bb92-079a286e4525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:15.784339 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:15.808041 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1171/2363] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:38:15.815984 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb664020-11d7-4a17-a031-6fb941d6be7b None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:15.816267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb664020-11d7-4a17-a031-6fb941d6be7b None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:15.816539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb664020-11d7-4a17-a031-6fb941d6be7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:15.840062 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-cb664020-11d7-4a17-a031-6fb941d6be7b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:15.841300 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-cb664020-11d7-4a17-a031-6fb941d6be7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:15.850184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1193/2364] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:15.855659 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fd7ec-6050-4052-bb92-079a286e4525 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:15.867898 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fd7ec-6050-4052-bb92-079a286e4525 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:15.873971 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9dea9-31a1-4568-b4de-d61bd3d148bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:15.874590 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9dea9-31a1-4568-b4de-d61bd3d148bb admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:15.874922 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9dea9-31a1-4568-b4de-d61bd3d148bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:15.875395 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9dea9-31a1-4568-b4de-d61bd3d148bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:15.876289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9dea9-31a1-4568-b4de-d61bd3d148bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:38:15.876821 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9dea9-31a1-4568-b4de-d61bd3d148bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:15.878924 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9dea9-31a1-4568-b4de-d61bd3d148bb admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:15.894104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1172/2365] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:38:15.901060 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb664020-11d7-4a17-a031-6fb941d6be7b None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:15.918352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb664020-11d7-4a17-a031-6fb941d6be7b None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:15.943597 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf2d30-c7c2-4e3d-b1ca-4616958b6b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:15.950690 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf2d30-c7c2-4e3d-b1ca-4616958b6b89 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:15.951002 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf2d30-c7c2-4e3d-b1ca-4616958b6b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:15.951549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf2d30-c7c2-4e3d-b1ca-4616958b6b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:15.952227 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf2d30-c7c2-4e3d-b1ca-4616958b6b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:15.954210 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf2d30-c7c2-4e3d-b1ca-4616958b6b89 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:15.988902 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1194/2366] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:38:15 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:38:15.996256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9dea9-31a1-4568-b4de-d61bd3d148bb admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:16.008296 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9dea9-31a1-4568-b4de-d61bd3d148bb admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:16.074768 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c37e6f-b8a8-4942-864e-7eb21c920a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:16.075404 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c37e6f-b8a8-4942-864e-7eb21c920a03 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:16.075681 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c37e6f-b8a8-4942-864e-7eb21c920a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:16.075950 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c37e6f-b8a8-4942-864e-7eb21c920a03 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:16.076776 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c37e6f-b8a8-4942-864e-7eb21c920a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:16.078677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c37e6f-b8a8-4942-864e-7eb21c920a03 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:16.114473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1173/2367] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:38:15 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:38:16.119533 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf2d30-c7c2-4e3d-b1ca-4616958b6b89 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:16.129861 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf2d30-c7c2-4e3d-b1ca-4616958b6b89 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:16.136457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214bc13-9163-412f-8484-fcc59c25b13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:16.137038 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214bc13-9163-412f-8484-fcc59c25b13e admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:16.137372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214bc13-9163-412f-8484-fcc59c25b13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:16.137582 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214bc13-9163-412f-8484-fcc59c25b13e admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:16.138226 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214bc13-9163-412f-8484-fcc59c25b13e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:16.139848 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214bc13-9163-412f-8484-fcc59c25b13e admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:16.150672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1195/2368] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:38:16.154403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c37e6f-b8a8-4942-864e-7eb21c920a03 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:16.166092 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c37e6f-b8a8-4942-864e-7eb21c920a03 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:16.171686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bbe7f-404a-476a-9ddc-fd8043ad4e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:16.172122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bbe7f-404a-476a-9ddc-fd8043ad4e10 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:16.172403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bbe7f-404a-476a-9ddc-fd8043ad4e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:16.172742 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bbe7f-404a-476a-9ddc-fd8043ad4e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:16.173897 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bbe7f-404a-476a-9ddc-fd8043ad4e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:16.175188 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bbe7f-404a-476a-9ddc-fd8043ad4e10 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:16.188714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1174/2369] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:38:16.192861 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214bc13-9163-412f-8484-fcc59c25b13e admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:16.208564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214bc13-9163-412f-8484-fcc59c25b13e admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:16.216733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164ef7f-c308-4cd6-a1f8-6e003a25d7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:16.217822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164ef7f-c308-4cd6-a1f8-6e003a25d7c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:16.218232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164ef7f-c308-4cd6-a1f8-6e003a25d7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:16.218542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164ef7f-c308-4cd6-a1f8-6e003a25d7c1 admin admin] PATH_INFO: `/v3/projects/9490ad917f3d46698bd04b77b30ff7e5/users/968d3791f1dd468592916a2cf8353717/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:16.235621 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164ef7f-c308-4cd6-a1f8-6e003a25d7c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9490ad917f3d46698bd04b77b30ff7e5, user_id=968d3791f1dd468592916a2cf8353717, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:16.238953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164ef7f-c308-4cd6-a1f8-6e003a25d7c1 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:16.255726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1196/2370] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:38:16 2022] PUT /identity/v3/projects/9490ad917f3d46698bd04b77b30ff7e5/users/968d3791f1dd468592916a2cf8353717/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:38:16.344632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb9ff7-3b4c-4af0-b286-b00e0e78fbd9 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:16.344921 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb9ff7-3b4c-4af0-b286-b00e0e78fbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:16.345201 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb9ff7-3b4c-4af0-b286-b00e0e78fbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:16.423639 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-13bb9ff7-3b4c-4af0-b286-b00e0e78fbd9 None None] MFA Rules not processed for user `968d3791f1dd468592916a2cf8353717`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:16.424924 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-13bb9ff7-3b4c-4af0-b286-b00e0e78fbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:16.574564 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1175/2371] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:16.582324 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164ef7f-c308-4cd6-a1f8-6e003a25d7c1 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:16.584121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-8164ef7f-c308-4cd6-a1f8-6e003a25d7c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:16.678584 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164ef7f-c308-4cd6-a1f8-6e003a25d7c1 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:16.682991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b2bb2-019e-4cf0-b179-e9990a4df12e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:16.683683 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2bb2-019e-4cf0-b179-e9990a4df12e service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:16.684033 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2bb2-019e-4cf0-b179-e9990a4df12e service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:16.684378 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2bb2-019e-4cf0-b179-e9990a4df12e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:16.694009 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b2bb2-019e-4cf0-b179-e9990a4df12e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:16.696581 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b2bb2-019e-4cf0-b179-e9990a4df12e service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:16.706300 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1197/2372] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:38:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:38:16.739397 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb9ff7-3b4c-4af0-b286-b00e0e78fbd9 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:16.876287 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:16.952054 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb9ff7-3b4c-4af0-b286-b00e0e78fbd9 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:16.963045 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3416e6-5a1d-4c2a-b766-f5fd4acb8aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:16.963803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3416e6-5a1d-4c2a-b766-f5fd4acb8aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:16.964157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3416e6-5a1d-4c2a-b766-f5fd4acb8aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:16.964507 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3416e6-5a1d-4c2a-b766-f5fd4acb8aa2 admin admin] PATH_INFO: `/v3/users/968d3791f1dd468592916a2cf8353717` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:16.972356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3416e6-5a1d-4c2a-b766-f5fd4acb8aa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=968d3791f1dd468592916a2cf8353717)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:16.980035 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3416e6-5a1d-4c2a-b766-f5fd4acb8aa2 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:17.077666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7d3416e6-5a1d-4c2a-b766-f5fd4acb8aa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '968d3791f1dd468592916a2cf8353717'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:17.078898 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7d3416e6-5a1d-4c2a-b766-f5fd4acb8aa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '968d3791f1dd468592916a2cf8353717'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:17.079538 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7d3416e6-5a1d-4c2a-b766-f5fd4acb8aa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '968d3791f1dd468592916a2cf8353717'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:17.108813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7d3416e6-5a1d-4c2a-b766-f5fd4acb8aa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '968d3791f1dd468592916a2cf8353717'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:17.117787 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-7d3416e6-5a1d-4c2a-b766-f5fd4acb8aa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '968d3791f1dd468592916a2cf8353717'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:17.171620 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1176/2373] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:38:16 2022] DELETE /identity/v3/users/968d3791f1dd468592916a2cf8353717 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:17.177211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f86d1-3237-4ca5-99ae-b0630f4f257f None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:17.177707 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f86d1-3237-4ca5-99ae-b0630f4f257f None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:17.178276 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f86d1-3237-4ca5-99ae-b0630f4f257f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:17.203031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-053f86d1-3237-4ca5-99ae-b0630f4f257f None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:17.204195 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-053f86d1-3237-4ca5-99ae-b0630f4f257f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:17.315879 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1198/2374] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:17.549835 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3416e6-5a1d-4c2a-b766-f5fd4acb8aa2 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:17.551448 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7d3416e6-5a1d-4c2a-b766-f5fd4acb8aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:17.610859 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3416e6-5a1d-4c2a-b766-f5fd4acb8aa2 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:17.615974 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcce416-5a83-4662-82f1-b1b5bf913aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:17.617519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcce416-5a83-4662-82f1-b1b5bf913aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:17.617784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcce416-5a83-4662-82f1-b1b5bf913aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:17.618137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcce416-5a83-4662-82f1-b1b5bf913aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:17.632642 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcce416-5a83-4662-82f1-b1b5bf913aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:17.634778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcce416-5a83-4662-82f1-b1b5bf913aa5 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:17.653122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1177/2375] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:38:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:38:18.155714 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f86d1-3237-4ca5-99ae-b0630f4f257f None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:18.157375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-053f86d1-3237-4ca5-99ae-b0630f4f257f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:18.174961 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f86d1-3237-4ca5-99ae-b0630f4f257f None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:18.186091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e784e38-2e8d-4c7e-9f88-0d51a1ce07f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:18.186694 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e784e38-2e8d-4c7e-9f88-0d51a1ce07f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:18.186965 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e784e38-2e8d-4c7e-9f88-0d51a1ce07f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:18.187385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e784e38-2e8d-4c7e-9f88-0d51a1ce07f1 admin admin] PATH_INFO: `/v3/projects/9490ad917f3d46698bd04b77b30ff7e5` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:18.188524 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e784e38-2e8d-4c7e-9f88-0d51a1ce07f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9490ad917f3d46698bd04b77b30ff7e5)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:18.190512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e784e38-2e8d-4c7e-9f88-0d51a1ce07f1 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:18.208312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:18.240447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8e784e38-2e8d-4c7e-9f88-0d51a1ce07f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9490ad917f3d46698bd04b77b30ff7e5', 'request_id': 'req-8e784e38-2e8d-4c7e-9f88-0d51a1ce07f1'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:18.248793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8e784e38-2e8d-4c7e-9f88-0d51a1ce07f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9490ad917f3d46698bd04b77b30ff7e5', 'request_id': 'req-8e784e38-2e8d-4c7e-9f88-0d51a1ce07f1'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:18.256685 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8e784e38-2e8d-4c7e-9f88-0d51a1ce07f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9490ad917f3d46698bd04b77b30ff7e5', 'request_id': 'req-8e784e38-2e8d-4c7e-9f88-0d51a1ce07f1'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:18.271901 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8e784e38-2e8d-4c7e-9f88-0d51a1ce07f1 admin admin] The token cache is being invalidate because project 9490ad917f3d46698bd04b77b30ff7e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:38:18.272059 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8e784e38-2e8d-4c7e-9f88-0d51a1ce07f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:18.272840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8e784e38-2e8d-4c7e-9f88-0d51a1ce07f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:18.275227 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1199/2376] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:38:18 2022] DELETE /identity/v3/projects/9490ad917f3d46698bd04b77b30ff7e5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:21.916474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcce416-5a83-4662-82f1-b1b5bf913aa5 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:21.917932 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ddcce416-5a83-4662-82f1-b1b5bf913aa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:21.931215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcce416-5a83-4662-82f1-b1b5bf913aa5 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:21.992620 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ad8e8-f8bf-4cea-a84a-29ee2c7a65cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:21.993232 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ad8e8-f8bf-4cea-a84a-29ee2c7a65cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:21.993505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ad8e8-f8bf-4cea-a84a-29ee2c7a65cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:21.993769 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ad8e8-f8bf-4cea-a84a-29ee2c7a65cf admin admin] PATH_INFO: `/v3/users/9a738d9259154f36be759e8557d044b2` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:21.994884 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ad8e8-f8bf-4cea-a84a-29ee2c7a65cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a738d9259154f36be759e8557d044b2)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:21.996785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ad8e8-f8bf-4cea-a84a-29ee2c7a65cf admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:21.998278 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:22.044039 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-180ad8e8-f8bf-4cea-a84a-29ee2c7a65cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a738d9259154f36be759e8557d044b2'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:22.044677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-180ad8e8-f8bf-4cea-a84a-29ee2c7a65cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a738d9259154f36be759e8557d044b2'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:22.045282 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-180ad8e8-f8bf-4cea-a84a-29ee2c7a65cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a738d9259154f36be759e8557d044b2'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:22.057020 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-180ad8e8-f8bf-4cea-a84a-29ee2c7a65cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a738d9259154f36be759e8557d044b2'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:22.063746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-180ad8e8-f8bf-4cea-a84a-29ee2c7a65cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a738d9259154f36be759e8557d044b2'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:22.077210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1178/2377] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:38:21 2022] DELETE /identity/v3/users/9a738d9259154f36be759e8557d044b2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:22.081595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aacbf-6a17-4a3a-8a62-bc43fbe0b231 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:22.082098 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aacbf-6a17-4a3a-8a62-bc43fbe0b231 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:22.082376 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aacbf-6a17-4a3a-8a62-bc43fbe0b231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:22.102924 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-f04aacbf-6a17-4a3a-8a62-bc43fbe0b231 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:22.104121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f04aacbf-6a17-4a3a-8a62-bc43fbe0b231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:22.166134 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1200/2378] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:22.175723 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ad8e8-f8bf-4cea-a84a-29ee2c7a65cf admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:22.177183 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-180ad8e8-f8bf-4cea-a84a-29ee2c7a65cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:22.242809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ad8e8-f8bf-4cea-a84a-29ee2c7a65cf admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:22.247243 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdd735-2153-491e-9772-44f8575c52d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:22.247869 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdd735-2153-491e-9772-44f8575c52d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:22.248280 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdd735-2153-491e-9772-44f8575c52d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:22.248558 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdd735-2153-491e-9772-44f8575c52d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:22.259802 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdd735-2153-491e-9772-44f8575c52d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:22.261275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdd735-2153-491e-9772-44f8575c52d8 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:22.271275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1179/2379] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:38:22.713957 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04aacbf-6a17-4a3a-8a62-bc43fbe0b231 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:22.715938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f04aacbf-6a17-4a3a-8a62-bc43fbe0b231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:22.742922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04aacbf-6a17-4a3a-8a62-bc43fbe0b231 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:22.747943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37a799-1813-4033-9173-d94313549315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:22.748925 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37a799-1813-4033-9173-d94313549315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:22.749280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37a799-1813-4033-9173-d94313549315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:22.749629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37a799-1813-4033-9173-d94313549315 admin admin] PATH_INFO: `/v3/projects/a89f027f39634bc9a074fc95e5b3ed20` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:22.750971 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37a799-1813-4033-9173-d94313549315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a89f027f39634bc9a074fc95e5b3ed20)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:22.752861 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37a799-1813-4033-9173-d94313549315 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:22.805302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-2b37a799-1813-4033-9173-d94313549315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a89f027f39634bc9a074fc95e5b3ed20', 'request_id': 'req-2b37a799-1813-4033-9173-d94313549315'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:22.811784 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-2b37a799-1813-4033-9173-d94313549315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a89f027f39634bc9a074fc95e5b3ed20', 'request_id': 'req-2b37a799-1813-4033-9173-d94313549315'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:22.817995 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-2b37a799-1813-4033-9173-d94313549315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a89f027f39634bc9a074fc95e5b3ed20', 'request_id': 'req-2b37a799-1813-4033-9173-d94313549315'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:22.831745 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-2b37a799-1813-4033-9173-d94313549315 admin admin] The token cache is being invalidate because project a89f027f39634bc9a074fc95e5b3ed20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:38:22.832037 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-2b37a799-1813-4033-9173-d94313549315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:22.832668 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-2b37a799-1813-4033-9173-d94313549315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:38:22.834152 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1201/2380] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:38:22 2022] DELETE /identity/v3/projects/a89f027f39634bc9a074fc95e5b3ed20 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:38:23.496322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a10022-67d1-4790-adf1-b5202ebb0c62 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:23.496777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a10022-67d1-4790-adf1-b5202ebb0c62 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:23.496886 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a10022-67d1-4790-adf1-b5202ebb0c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:23.516312 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-87a10022-67d1-4790-adf1-b5202ebb0c62 None None] MFA Rules not processed for user `c52e611cab734987bea6b2c5cc48a21f`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:23.517532 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-87a10022-67d1-4790-adf1-b5202ebb0c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:23.572201 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1180/2381] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:32.828487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=71,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:33.564649 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=77,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:38.032939 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37a799-1813-4033-9173-d94313549315 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:38.034428 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-2b37a799-1813-4033-9173-d94313549315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:38.097923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37a799-1813-4033-9173-d94313549315 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:38.102221 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1771aed-f3fd-43e0-a31c-768a3381c670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:38.103013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1771aed-f3fd-43e0-a31c-768a3381c670 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:38.103291 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1771aed-f3fd-43e0-a31c-768a3381c670 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:38.103563 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1771aed-f3fd-43e0-a31c-768a3381c670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:38.105437 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c1771aed-f3fd-43e0-a31c-768a3381c670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:38.171764 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1771aed-f3fd-43e0-a31c-768a3381c670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:38.173398 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1771aed-f3fd-43e0-a31c-768a3381c670 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:38.185363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1202/2382] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:38:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:38:39.045852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d6e7f-de7f-469d-b4d2-f7a170c971ec None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:39.046399 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d6e7f-de7f-469d-b4d2-f7a170c971ec None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:39.046399 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d6e7f-de7f-469d-b4d2-f7a170c971ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:39.065573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-4e1d6e7f-de7f-469d-b4d2-f7a170c971ec None None] MFA Rules not processed for user `241f49075bdf42429a422fe90b33124d`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:39.066795 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4e1d6e7f-de7f-469d-b4d2-f7a170c971ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:39.126921 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1181/2383] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:38:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:48.180725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=50 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:49.119962 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=25 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:58.821213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13a47b-e9a4-4586-816b-da613adba1a6 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:58.821662 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13a47b-e9a4-4586-816b-da613adba1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:58.821762 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13a47b-e9a4-4586-816b-da613adba1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:58.843649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-0e13a47b-e9a4-4586-816b-da613adba1a6 None None] MFA Rules not processed for user `6f4696c410f343709be200dee463bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:38:58.844843 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0e13a47b-e9a4-4586-816b-da613adba1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:58.900880 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1203/2384] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 26 01:38:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:38:58.943212 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d6e7f-de7f-469d-b4d2-f7a170c971ec None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:38:58.944659 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4e1d6e7f-de7f-469d-b4d2-f7a170c971ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:38:59.014031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d6e7f-de7f-469d-b4d2-f7a170c971ec None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:38:59.019073 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3573602-e7e1-482a-b127-2d2fa133df37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c924da83d1a94c49814d2e7b5969c8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:38:59.019710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3573602-e7e1-482a-b127-2d2fa133df37 service swift] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:38:59.019992 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3573602-e7e1-482a-b127-2d2fa133df37 service swift] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:38:59.020265 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3573602-e7e1-482a-b127-2d2fa133df37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:38:59.029043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3573602-e7e1-482a-b127-2d2fa133df37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:38:59.030633 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3573602-e7e1-482a-b127-2d2fa133df37 service swift] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:38:59.038730 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1182/2385] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 26 01:38:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 01:39:08.893529 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=25 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:09.035443 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=32 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:14.462853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badac3f4-0aa1-451d-a693-4daf3e4309ef None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:39:14.463364 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badac3f4-0aa1-451d-a693-4daf3e4309ef None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:39:14.463464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badac3f4-0aa1-451d-a693-4daf3e4309ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:39:14.482659 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-badac3f4-0aa1-451d-a693-4daf3e4309ef None None] MFA Rules not processed for user `6f4696c410f343709be200dee463bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:39:14.483891 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-badac3f4-0aa1-451d-a693-4daf3e4309ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:39:14.490795 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1204/2386] 10.222.0.26 () {58 vars in 967 bytes} [Mon Sep 26 01:39:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:39:14.503132 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3573602-e7e1-482a-b127-2d2fa133df37 service swift] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:39:14.514204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3573602-e7e1-482a-b127-2d2fa133df37 service swift] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:39:14.519231 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e295a-f130-4dbb-865b-10cb61c7ee22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c924da83d1a94c49814d2e7b5969c8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:39:14.519819 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e295a-f130-4dbb-865b-10cb61c7ee22 service swift] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:39:14.520097 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e295a-f130-4dbb-865b-10cb61c7ee22 service swift] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:39:14.520372 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e295a-f130-4dbb-865b-10cb61c7ee22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:39:14.528766 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e295a-f130-4dbb-865b-10cb61c7ee22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:39:14.530331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e295a-f130-4dbb-865b-10cb61c7ee22 service swift] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:39:14.538122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1183/2387] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 26 01:39:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 01:39:16.547115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badac3f4-0aa1-451d-a693-4daf3e4309ef None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:39:16.548737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-badac3f4-0aa1-451d-a693-4daf3e4309ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:39:16.618218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badac3f4-0aa1-451d-a693-4daf3e4309ef None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:39:16.622999 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1a65d-0f19-4e65-9d5c-3fe0d07aabf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:39:16.623607 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1a65d-0f19-4e65-9d5c-3fe0d07aabf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:39:16.623885 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1a65d-0f19-4e65-9d5c-3fe0d07aabf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:39:16.624154 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1a65d-0f19-4e65-9d5c-3fe0d07aabf6 admin admin] PATH_INFO: `/v3/users/241f49075bdf42429a422fe90b33124d` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:39:16.625273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1a65d-0f19-4e65-9d5c-3fe0d07aabf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=241f49075bdf42429a422fe90b33124d)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:39:16.627204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1a65d-0f19-4e65-9d5c-3fe0d07aabf6 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:39:16.672886 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-35f1a65d-0f19-4e65-9d5c-3fe0d07aabf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '241f49075bdf42429a422fe90b33124d'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:16.673542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-35f1a65d-0f19-4e65-9d5c-3fe0d07aabf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '241f49075bdf42429a422fe90b33124d'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:16.674153 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-35f1a65d-0f19-4e65-9d5c-3fe0d07aabf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '241f49075bdf42429a422fe90b33124d'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:16.687389 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-35f1a65d-0f19-4e65-9d5c-3fe0d07aabf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '241f49075bdf42429a422fe90b33124d'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:16.694141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-35f1a65d-0f19-4e65-9d5c-3fe0d07aabf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '241f49075bdf42429a422fe90b33124d'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:16.707886 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1205/2388] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:39:16 2022] DELETE /identity/v3/users/241f49075bdf42429a422fe90b33124d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:39:16.882369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e295a-f130-4dbb-865b-10cb61c7ee22 service swift] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:39:16.896383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e295a-f130-4dbb-865b-10cb61c7ee22 service swift] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:39:16.954799 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3f132-bc59-48cd-86c9-69cb27eb4af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:39:16.955458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3f132-bc59-48cd-86c9-69cb27eb4af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:39:16.955816 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3f132-bc59-48cd-86c9-69cb27eb4af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:39:16.956112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3f132-bc59-48cd-86c9-69cb27eb4af8 admin admin] PATH_INFO: `/v3/projects/0b9fccaa106e4826a820e6608392f2f2` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:39:16.957224 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3f132-bc59-48cd-86c9-69cb27eb4af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b9fccaa106e4826a820e6608392f2f2)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:39:16.959158 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3f132-bc59-48cd-86c9-69cb27eb4af8 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:39:17.005733 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f7e3f132-bc59-48cd-86c9-69cb27eb4af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b9fccaa106e4826a820e6608392f2f2', 'request_id': 'req-f7e3f132-bc59-48cd-86c9-69cb27eb4af8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:17.011525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f7e3f132-bc59-48cd-86c9-69cb27eb4af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b9fccaa106e4826a820e6608392f2f2', 'request_id': 'req-f7e3f132-bc59-48cd-86c9-69cb27eb4af8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:17.017944 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f7e3f132-bc59-48cd-86c9-69cb27eb4af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b9fccaa106e4826a820e6608392f2f2', 'request_id': 'req-f7e3f132-bc59-48cd-86c9-69cb27eb4af8'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:17.030207 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f7e3f132-bc59-48cd-86c9-69cb27eb4af8 admin admin] The token cache is being invalidate because project 0b9fccaa106e4826a820e6608392f2f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:39:17.030521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f7e3f132-bc59-48cd-86c9-69cb27eb4af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:17.031158 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f7e3f132-bc59-48cd-86c9-69cb27eb4af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:17.032632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1184/2389] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:39:16 2022] DELETE /identity/v3/projects/0b9fccaa106e4826a820e6608392f2f2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:39:17.037561 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c493951-1f5b-4e52-9c89-7bc355823393 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:39:17.037846 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c493951-1f5b-4e52-9c89-7bc355823393 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:39:17.038121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c493951-1f5b-4e52-9c89-7bc355823393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:39:17.058429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-2c493951-1f5b-4e52-9c89-7bc355823393 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:39:17.059733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-2c493951-1f5b-4e52-9c89-7bc355823393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:39:17.119735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1206/2390] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:39:17.127504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167e306-0423-4967-8f78-728692b6b192 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:39:17.127784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167e306-0423-4967-8f78-728692b6b192 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:39:17.128052 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167e306-0423-4967-8f78-728692b6b192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:39:17.147780 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-0167e306-0423-4967-8f78-728692b6b192 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:39:17.148899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0167e306-0423-4967-8f78-728692b6b192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:39:17.157204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1185/2391] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:39:17.161631 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c493951-1f5b-4e52-9c89-7bc355823393 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:39:17.172472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c493951-1f5b-4e52-9c89-7bc355823393 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:39:17.184137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b8d26-53c7-40fc-b93b-1099bc90b186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:39:17.184760 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b8d26-53c7-40fc-b93b-1099bc90b186 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:39:17.185041 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b8d26-53c7-40fc-b93b-1099bc90b186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:39:17.185316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b8d26-53c7-40fc-b93b-1099bc90b186 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:39:17.185973 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b8d26-53c7-40fc-b93b-1099bc90b186 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:39:17.186281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b8d26-53c7-40fc-b93b-1099bc90b186 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:39:17.187905 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b8d26-53c7-40fc-b93b-1099bc90b186 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:39:17.196899 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:17.204410 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1207/2392] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:39:17.206033 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167e306-0423-4967-8f78-728692b6b192 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:39:17.215447 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167e306-0423-4967-8f78-728692b6b192 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:39:17.220274 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d22b4-50c3-47bf-9074-7861085308f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:39:17.220869 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d22b4-50c3-47bf-9074-7861085308f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:39:17.221142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d22b4-50c3-47bf-9074-7861085308f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:39:17.221410 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d22b4-50c3-47bf-9074-7861085308f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:39:17.222033 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d22b4-50c3-47bf-9074-7861085308f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:39:17.223935 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d22b4-50c3-47bf-9074-7861085308f3 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:39:17.253132 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1186/2393] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:39:17 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:39:17.257446 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b8d26-53c7-40fc-b93b-1099bc90b186 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:39:17.267855 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b8d26-53c7-40fc-b93b-1099bc90b186 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:39:17.325916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d083a12-759a-4701-8b2a-3752d803d558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:39:17.326519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d083a12-759a-4701-8b2a-3752d803d558 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:39:17.326796 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d083a12-759a-4701-8b2a-3752d803d558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:39:17.327099 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d083a12-759a-4701-8b2a-3752d803d558 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:39:17.327726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d083a12-759a-4701-8b2a-3752d803d558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:39:17.329622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d083a12-759a-4701-8b2a-3752d803d558 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:39:17.353732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1208/2394] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:39:17 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:39:17.355248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d22b4-50c3-47bf-9074-7861085308f3 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:39:17.365798 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d22b4-50c3-47bf-9074-7861085308f3 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:39:17.371088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cc2e6-89b0-4a73-9aaa-04f862cb3a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:39:17.371684 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cc2e6-89b0-4a73-9aaa-04f862cb3a9d admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:39:17.371967 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cc2e6-89b0-4a73-9aaa-04f862cb3a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:39:17.372242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cc2e6-89b0-4a73-9aaa-04f862cb3a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:39:17.372876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cc2e6-89b0-4a73-9aaa-04f862cb3a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:39:17.374471 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cc2e6-89b0-4a73-9aaa-04f862cb3a9d admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:39:17.385301 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1187/2395] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:39:17.389132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d083a12-759a-4701-8b2a-3752d803d558 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:39:17.399308 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d083a12-759a-4701-8b2a-3752d803d558 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:39:17.404035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b78e40-7c2b-4377-b2c2-081c5ed86745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:39:17.404631 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b78e40-7c2b-4377-b2c2-081c5ed86745 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:39:17.404940 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b78e40-7c2b-4377-b2c2-081c5ed86745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:39:17.405216 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b78e40-7c2b-4377-b2c2-081c5ed86745 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:39:17.405854 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b78e40-7c2b-4377-b2c2-081c5ed86745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:39:17.407540 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b78e40-7c2b-4377-b2c2-081c5ed86745 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:39:17.418618 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1209/2396] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:39:17.422756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cc2e6-89b0-4a73-9aaa-04f862cb3a9d admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:39:17.433408 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cc2e6-89b0-4a73-9aaa-04f862cb3a9d admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:39:17.438055 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73098a17-0b76-4058-b855-3972d3b8cf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:39:17.438712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73098a17-0b76-4058-b855-3972d3b8cf3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:39:17.439027 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73098a17-0b76-4058-b855-3972d3b8cf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:39:17.439303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73098a17-0b76-4058-b855-3972d3b8cf3e admin admin] PATH_INFO: `/v3/projects/e23b9538141042d6898e12e6d17eecb7/users/765050817ba647178e1745f8137d285e/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:39:17.456183 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73098a17-0b76-4058-b855-3972d3b8cf3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23b9538141042d6898e12e6d17eecb7, user_id=765050817ba647178e1745f8137d285e, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:39:17.458884 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73098a17-0b76-4058-b855-3972d3b8cf3e admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:39:17.471418 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1188/2397] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:39:17 2022] PUT /identity/v3/projects/e23b9538141042d6898e12e6d17eecb7/users/765050817ba647178e1745f8137d285e/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:39:17.482549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997b2e9-9663-4f80-a21f-fb4cfc12d0c3 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:39:17.482850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997b2e9-9663-4f80-a21f-fb4cfc12d0c3 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:39:17.483141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997b2e9-9663-4f80-a21f-fb4cfc12d0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:39:17.511093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-e997b2e9-9663-4f80-a21f-fb4cfc12d0c3 None None] MFA Rules not processed for user `765050817ba647178e1745f8137d285e`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:39:17.512318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e997b2e9-9663-4f80-a21f-fb4cfc12d0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:39:17.577871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1210/2398] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:39:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:39:17.589553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73098a17-0b76-4058-b855-3972d3b8cf3e admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:39:17.591263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-73098a17-0b76-4058-b855-3972d3b8cf3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:39:17.605414 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:17.649485 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73098a17-0b76-4058-b855-3972d3b8cf3e admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:39:17.653105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7170e-9ea2-49a4-b0e2-a7443fcf1de4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15538b95acef435798ff7651fc1710cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:39:17.653701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7170e-9ea2-49a4-b0e2-a7443fcf1de4 service glance] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:39:17.653976 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7170e-9ea2-49a4-b0e2-a7443fcf1de4 service glance] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:39:17.654247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7170e-9ea2-49a4-b0e2-a7443fcf1de4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:39:17.662675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7170e-9ea2-49a4-b0e2-a7443fcf1de4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:39:17.664181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7170e-9ea2-49a4-b0e2-a7443fcf1de4 service glance] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:39:17.673146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1189/2399] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:39:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:39:18.138632 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997b2e9-9663-4f80-a21f-fb4cfc12d0c3 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:39:18.140057 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e997b2e9-9663-4f80-a21f-fb4cfc12d0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:39:18.217432 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997b2e9-9663-4f80-a21f-fb4cfc12d0c3 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:39:18.223456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730daf9-6124-4328-b342-27436ffee67b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7a1b839a6f4bdb9870217fa4d2527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:39:18.223605 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730daf9-6124-4328-b342-27436ffee67b service placement] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:39:18.223866 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730daf9-6124-4328-b342-27436ffee67b service placement] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:39:18.224117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730daf9-6124-4328-b342-27436ffee67b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:39:18.225905 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6730daf9-6124-4328-b342-27436ffee67b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:39:18.238554 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730daf9-6124-4328-b342-27436ffee67b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:39:18.240243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730daf9-6124-4328-b342-27436ffee67b service placement] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:39:18.245116 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:18.255537 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1211/2400] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:39:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:39:27.669226 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=20 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:28.256359 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:47.794179 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7170e-9ea2-49a4-b0e2-a7443fcf1de4 service glance] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:39:47.856937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7170e-9ea2-49a4-b0e2-a7443fcf1de4 service glance] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:39:47.861381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9bc7e-6901-4d22-88ec-55d1e3d9a77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:39:47.861998 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9bc7e-6901-4d22-88ec-55d1e3d9a77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:39:47.862459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9bc7e-6901-4d22-88ec-55d1e3d9a77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:39:47.862575 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9bc7e-6901-4d22-88ec-55d1e3d9a77f admin admin] PATH_INFO: `/v3/users/765050817ba647178e1745f8137d285e` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:39:47.863664 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9bc7e-6901-4d22-88ec-55d1e3d9a77f admin admin] RBAC: Authorizing `identity:delete_user(user_id=765050817ba647178e1745f8137d285e)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:39:47.865546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9bc7e-6901-4d22-88ec-55d1e3d9a77f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:39:47.910175 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-1bf9bc7e-6901-4d22-88ec-55d1e3d9a77f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765050817ba647178e1745f8137d285e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:47.910820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-1bf9bc7e-6901-4d22-88ec-55d1e3d9a77f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765050817ba647178e1745f8137d285e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:47.911457 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-1bf9bc7e-6901-4d22-88ec-55d1e3d9a77f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765050817ba647178e1745f8137d285e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:47.923569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-1bf9bc7e-6901-4d22-88ec-55d1e3d9a77f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765050817ba647178e1745f8137d285e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:47.930601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-1bf9bc7e-6901-4d22-88ec-55d1e3d9a77f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765050817ba647178e1745f8137d285e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:47.943521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1190/2401] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:39:47 2022] DELETE /identity/v3/users/765050817ba647178e1745f8137d285e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:39:47.948027 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c1931-6ed2-47e3-8077-007deeadccd1 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:39:47.948506 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c1931-6ed2-47e3-8077-007deeadccd1 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:39:47.948652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c1931-6ed2-47e3-8077-007deeadccd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:39:47.967753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-270c1931-6ed2-47e3-8077-007deeadccd1 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:39:47.969023 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-270c1931-6ed2-47e3-8077-007deeadccd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:39:48.026775 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1212/2402] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:39:48.036305 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9bc7e-6901-4d22-88ec-55d1e3d9a77f admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:39:48.037700 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1bf9bc7e-6901-4d22-88ec-55d1e3d9a77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:39:48.094331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9bc7e-6901-4d22-88ec-55d1e3d9a77f admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:39:48.098032 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fa2e4-dc5f-47c8-a7b8-edc24e49680f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:39:48.098630 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fa2e4-dc5f-47c8-a7b8-edc24e49680f service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:39:48.098942 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fa2e4-dc5f-47c8-a7b8-edc24e49680f service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:39:48.099217 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fa2e4-dc5f-47c8-a7b8-edc24e49680f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:39:48.108154 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fa2e4-dc5f-47c8-a7b8-edc24e49680f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:39:48.109560 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fa2e4-dc5f-47c8-a7b8-edc24e49680f service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:39:48.118753 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1191/2403] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:39:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:39:48.384548 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c1931-6ed2-47e3-8077-007deeadccd1 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:39:48.386914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-270c1931-6ed2-47e3-8077-007deeadccd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:39:48.402130 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c1931-6ed2-47e3-8077-007deeadccd1 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:39:48.407201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06962d76-4a80-458b-a781-0a2feccc4b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:39:48.414735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06962d76-4a80-458b-a781-0a2feccc4b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:39:48.415050 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06962d76-4a80-458b-a781-0a2feccc4b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:39:48.415359 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06962d76-4a80-458b-a781-0a2feccc4b91 admin admin] PATH_INFO: `/v3/projects/e23b9538141042d6898e12e6d17eecb7` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:39:48.416615 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06962d76-4a80-458b-a781-0a2feccc4b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e23b9538141042d6898e12e6d17eecb7)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:39:48.418547 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06962d76-4a80-458b-a781-0a2feccc4b91 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:39:48.464491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-06962d76-4a80-458b-a781-0a2feccc4b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e23b9538141042d6898e12e6d17eecb7', 'request_id': 'req-06962d76-4a80-458b-a781-0a2feccc4b91'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:48.470465 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-06962d76-4a80-458b-a781-0a2feccc4b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e23b9538141042d6898e12e6d17eecb7', 'request_id': 'req-06962d76-4a80-458b-a781-0a2feccc4b91'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:48.475905 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-06962d76-4a80-458b-a781-0a2feccc4b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e23b9538141042d6898e12e6d17eecb7', 'request_id': 'req-06962d76-4a80-458b-a781-0a2feccc4b91'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:48.488242 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-06962d76-4a80-458b-a781-0a2feccc4b91 admin admin] The token cache is being invalidate because project e23b9538141042d6898e12e6d17eecb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:39:48.488526 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-06962d76-4a80-458b-a781-0a2feccc4b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:48.489157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-06962d76-4a80-458b-a781-0a2feccc4b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:39:48.490603 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1213/2404] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:39:48 2022] DELETE /identity/v3/projects/e23b9538141042d6898e12e6d17eecb7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:39:58.114637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:58.485297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:40:13.028290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c511e84-2fbb-4832-b2e3-c78433b2df26 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:40:13.028831 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c511e84-2fbb-4832-b2e3-c78433b2df26 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:40:13.029135 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c511e84-2fbb-4832-b2e3-c78433b2df26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:40:13.049095 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-9c511e84-2fbb-4832-b2e3-c78433b2df26 None None] MFA Rules not processed for user `6f4696c410f343709be200dee463bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:40:13.050294 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-9c511e84-2fbb-4832-b2e3-c78433b2df26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:40:13.106388 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1192/2405] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 26 01:40:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:40:13.128199 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06962d76-4a80-458b-a781-0a2feccc4b91 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:40:13.129655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-06962d76-4a80-458b-a781-0a2feccc4b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:40:13.203753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06962d76-4a80-458b-a781-0a2feccc4b91 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:40:13.208644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548dc94-0bc4-4e3c-a242-db2118fc2e71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c924da83d1a94c49814d2e7b5969c8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:40:13.209246 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548dc94-0bc4-4e3c-a242-db2118fc2e71 service swift] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:40:13.209524 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548dc94-0bc4-4e3c-a242-db2118fc2e71 service swift] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:40:13.209798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548dc94-0bc4-4e3c-a242-db2118fc2e71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:40:13.218068 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548dc94-0bc4-4e3c-a242-db2118fc2e71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:40:13.219660 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548dc94-0bc4-4e3c-a242-db2118fc2e71 service swift] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:40:13.227800 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1214/2406] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 26 01:40:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 01:40:23.099323 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=25 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:40:23.224991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=32 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:40:29.144228 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7139d-f75f-43a8-84ed-5247278ecca7 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:40:29.144830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7139d-f75f-43a8-84ed-5247278ecca7 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:40:29.144830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7139d-f75f-43a8-84ed-5247278ecca7 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:40:29.146130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1193/2407] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 26 01:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 01:40:29.153188 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752cad4-979d-4ba1-b23a-dcaa8a510aa6 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:40:29.153701 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752cad4-979d-4ba1-b23a-dcaa8a510aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:40:29.153886 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752cad4-979d-4ba1-b23a-dcaa8a510aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:40:29.173925 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-1752cad4-979d-4ba1-b23a-dcaa8a510aa6 None None] MFA Rules not processed for user `3d6eaeb6bced49afabc7bdaa5e7cecfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:40:29.175273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-1752cad4-979d-4ba1-b23a-dcaa8a510aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:40:29.243926 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1215/2408] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 26 01:40:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:40:29.256812 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7139d-f75f-43a8-84ed-5247278ecca7 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:40:29.258629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6aa7139d-f75f-43a8-84ed-5247278ecca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:40:29.320320 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7139d-f75f-43a8-84ed-5247278ecca7 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:40:29.324450 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efea622-040c-4a5e-a383-c336d8805404 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15538b95acef435798ff7651fc1710cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:40:29.325300 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efea622-040c-4a5e-a383-c336d8805404 service glance] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:40:29.325570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efea622-040c-4a5e-a383-c336d8805404 service glance] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:40:29.325834 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efea622-040c-4a5e-a383-c336d8805404 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:40:29.335670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efea622-040c-4a5e-a383-c336d8805404 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:40:29.337070 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efea622-040c-4a5e-a383-c336d8805404 service glance] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:40:29.347422 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1194/2409] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:40:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:40:29.423713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7d122-cbc7-4f35-a92c-31c9bd2f77f8 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:40:29.424000 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7d122-cbc7-4f35-a92c-31c9bd2f77f8 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:40:29.424278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7d122-cbc7-4f35-a92c-31c9bd2f77f8 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:40:29.425796 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1216/2410] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 26 01:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:40:29.431120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024f73c-da2d-4afb-b275-b8de8fba15cb None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:40:29.431411 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024f73c-da2d-4afb-b275-b8de8fba15cb None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:40:29.431689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024f73c-da2d-4afb-b275-b8de8fba15cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:40:29.454051 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2024f73c-da2d-4afb-b275-b8de8fba15cb None None] MFA Rules not processed for user `80c1005979d04c55b8746c25b0994086`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:40:29.455319 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2024f73c-da2d-4afb-b275-b8de8fba15cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:40:29.507643 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1195/2411] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 26 01:40:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:40:29.520061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7d122-cbc7-4f35-a92c-31c9bd2f77f8 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:40:29.521795 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-61b7d122-cbc7-4f35-a92c-31c9bd2f77f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:40:29.535001 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7d122-cbc7-4f35-a92c-31c9bd2f77f8 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:40:29.538478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cba17-6f97-478f-b6ad-096253a5e4f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:40:29.539088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cba17-6f97-478f-b6ad-096253a5e4f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:40:29.539367 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cba17-6f97-478f-b6ad-096253a5e4f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:40:29.539640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cba17-6f97-478f-b6ad-096253a5e4f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:40:29.546525 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cba17-6f97-478f-b6ad-096253a5e4f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:40:29.547950 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cba17-6f97-478f-b6ad-096253a5e4f7 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:40:29.555832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1217/2412] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:40:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:40:29.643536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6ee40-c1df-4ceb-b9dd-3a902a47fa9a None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:40:29.643820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6ee40-c1df-4ceb-b9dd-3a902a47fa9a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:40:29.644093 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6ee40-c1df-4ceb-b9dd-3a902a47fa9a None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:40:29.645435 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1196/2413] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 26 01:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:40:29.650646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb5f8c-cd98-4e69-9bde-352128efb3dd None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:40:29.651102 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb5f8c-cd98-4e69-9bde-352128efb3dd None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:40:29.651483 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb5f8c-cd98-4e69-9bde-352128efb3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:40:29.672257 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-66cb5f8c-cd98-4e69-9bde-352128efb3dd None None] MFA Rules not processed for user `3d6eaeb6bced49afabc7bdaa5e7cecfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:40:29.673460 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-66cb5f8c-cd98-4e69-9bde-352128efb3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:40:29.683292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1218/2414] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 26 01:40:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:40:29.693965 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6ee40-c1df-4ceb-b9dd-3a902a47fa9a None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:40:29.695729 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6ae6ee40-c1df-4ceb-b9dd-3a902a47fa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:40:29.709681 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6ee40-c1df-4ceb-b9dd-3a902a47fa9a None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:40:29.713350 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49663c5b-664b-4f94-aaa9-0b7ecbdc8132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:40:29.714229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49663c5b-664b-4f94-aaa9-0b7ecbdc8132 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:40:29.714517 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49663c5b-664b-4f94-aaa9-0b7ecbdc8132 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:40:29.714796 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49663c5b-664b-4f94-aaa9-0b7ecbdc8132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:40:29.724842 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49663c5b-664b-4f94-aaa9-0b7ecbdc8132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:40:29.726260 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49663c5b-664b-4f94-aaa9-0b7ecbdc8132 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:40:29.737593 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1197/2415] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:40:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:40:31.970668 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2a90b-180d-4db7-990c-ea59e8ad5b40 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:40:31.971147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2a90b-180d-4db7-990c-ea59e8ad5b40 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:40:31.971263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2a90b-180d-4db7-990c-ea59e8ad5b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:40:31.990571 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-58e2a90b-180d-4db7-990c-ea59e8ad5b40 None None] MFA Rules not processed for user `6f4696c410f343709be200dee463bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:40:31.991786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-58e2a90b-180d-4db7-990c-ea59e8ad5b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:40:31.999471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1219/2416] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 26 01:40:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:40:32.011177 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49663c5b-664b-4f94-aaa9-0b7ecbdc8132 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:40:32.022164 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49663c5b-664b-4f94-aaa9-0b7ecbdc8132 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:40:32.027310 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893afd77-a950-48e3-8683-ec1b7000fb94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c924da83d1a94c49814d2e7b5969c8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:40:32.027842 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893afd77-a950-48e3-8683-ec1b7000fb94 service swift] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:40:32.028119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893afd77-a950-48e3-8683-ec1b7000fb94 service swift] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:40:32.028390 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893afd77-a950-48e3-8683-ec1b7000fb94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:40:32.036142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893afd77-a950-48e3-8683-ec1b7000fb94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:40:32.037702 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893afd77-a950-48e3-8683-ec1b7000fb94 service swift] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:40:32.046351 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1198/2417] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 26 01:40:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 01:40:41.985340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=43 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:40:42.043525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=61 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:40:51.340712 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ec700-9ff9-4f7d-9b9d-c6f7f519c241 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:40:51.341202 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ec700-9ff9-4f7d-9b9d-c6f7f519c241 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:40:51.341325 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ec700-9ff9-4f7d-9b9d-c6f7f519c241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:40:51.360643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-4d9ec700-9ff9-4f7d-9b9d-c6f7f519c241 None None] MFA Rules not processed for user `c52e611cab734987bea6b2c5cc48a21f`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:40:51.361765 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4d9ec700-9ff9-4f7d-9b9d-c6f7f519c241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:40:51.416940 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1220/2418] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:40:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:40:53.270520 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edd99a-b931-48b1-a9c6-e48f25c7e8da None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:40:53.271035 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edd99a-b931-48b1-a9c6-e48f25c7e8da None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:40:53.271139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edd99a-b931-48b1-a9c6-e48f25c7e8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:40:53.289982 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-26edd99a-b931-48b1-a9c6-e48f25c7e8da None None] MFA Rules not processed for user `6f4696c410f343709be200dee463bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:40:53.291264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-26edd99a-b931-48b1-a9c6-e48f25c7e8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:40:53.298489 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1199/2419] 10.222.0.26 () {58 vars in 967 bytes} [Mon Sep 26 01:40:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:40:53.311573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ec700-9ff9-4f7d-9b9d-c6f7f519c241 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:40:53.324578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ec700-9ff9-4f7d-9b9d-c6f7f519c241 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:40:53.329942 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ec302-d6f1-4c51-8472-f79470afbb0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c924da83d1a94c49814d2e7b5969c8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:40:53.330542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ec302-d6f1-4c51-8472-f79470afbb0d service swift] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:40:53.330849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ec302-d6f1-4c51-8472-f79470afbb0d service swift] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:40:53.331128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ec302-d6f1-4c51-8472-f79470afbb0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:40:53.339208 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ec302-d6f1-4c51-8472-f79470afbb0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:40:53.340832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ec302-d6f1-4c51-8472-f79470afbb0d service swift] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:40:53.349101 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1221/2420] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 26 01:40:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 01:41:03.285179 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:03.345665 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=31 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:32.198611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edd99a-b931-48b1-a9c6-e48f25c7e8da None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:41:32.208379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edd99a-b931-48b1-a9c6-e48f25c7e8da None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:41:32.211943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcabf9-54e7-40f5-857f-982ab59ca021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:41:32.212534 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcabf9-54e7-40f5-857f-982ab59ca021 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:41:32.212810 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcabf9-54e7-40f5-857f-982ab59ca021 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:41:32.213116 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcabf9-54e7-40f5-857f-982ab59ca021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:41:32.215487 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8cbcabf9-54e7-40f5-857f-982ab59ca021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:41:32.228497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcabf9-54e7-40f5-857f-982ab59ca021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:41:32.230646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcabf9-54e7-40f5-857f-982ab59ca021 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:41:32.241470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1200/2421] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:41:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:41:33.419591 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ec302-d6f1-4c51-8472-f79470afbb0d service swift] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:41:33.428826 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ec302-d6f1-4c51-8472-f79470afbb0d service swift] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:41:33.433064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad875f1-a66b-42b2-933c-6970bf945103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:41:33.433646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad875f1-a66b-42b2-933c-6970bf945103 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:41:33.433952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad875f1-a66b-42b2-933c-6970bf945103 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:41:33.434225 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad875f1-a66b-42b2-933c-6970bf945103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:41:33.435956 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4ad875f1-a66b-42b2-933c-6970bf945103 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:41:33.449241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad875f1-a66b-42b2-933c-6970bf945103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:41:33.450648 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad875f1-a66b-42b2-933c-6970bf945103 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:41:33.461651 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1222/2422] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:41:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:41:42.236659 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=6 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:42.347143 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcabf9-54e7-40f5-857f-982ab59ca021 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:41:42.356583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcabf9-54e7-40f5-857f-982ab59ca021 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:41:42.360189 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caebbec-2f20-4a4c-956f-5bb0c86c0a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:41:42.360777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caebbec-2f20-4a4c-956f-5bb0c86c0a6f service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:41:42.361051 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caebbec-2f20-4a4c-956f-5bb0c86c0a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:41:42.361319 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caebbec-2f20-4a4c-956f-5bb0c86c0a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:41:42.363068 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8caebbec-2f20-4a4c-956f-5bb0c86c0a6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:41:42.373019 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caebbec-2f20-4a4c-956f-5bb0c86c0a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:41:42.374443 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caebbec-2f20-4a4c-956f-5bb0c86c0a6f service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:41:42.382380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1201/2423] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:41:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:41:43.456879 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=6 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:45.476952 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507659e-1947-470a-9300-fce5638ce2a9 None None] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:41:45.477603 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507659e-1947-470a-9300-fce5638ce2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:41:45.477603 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507659e-1947-470a-9300-fce5638ce2a9 None None] PATH_INFO: `/` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:41:45.479402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1223/2424] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 26 01:41:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:41:45.485720 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7c809-35c9-45de-a182-3459cb5b613c None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:41:45.486190 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7c809-35c9-45de-a182-3459cb5b613c None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:41:45.486392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7c809-35c9-45de-a182-3459cb5b613c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:41:45.506360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-3bd7c809-35c9-45de-a182-3459cb5b613c None None] MFA Rules not processed for user `80c1005979d04c55b8746c25b0994086`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:41:45.507607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3bd7c809-35c9-45de-a182-3459cb5b613c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:41:45.514696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1202/2425] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 26 01:41:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:41:45.528558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507659e-1947-470a-9300-fce5638ce2a9 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:41:45.540025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507659e-1947-470a-9300-fce5638ce2a9 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:41:45.543703 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734410e-eae6-4254-9ac3-a6222df6d825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:41:45.544293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734410e-eae6-4254-9ac3-a6222df6d825 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:41:45.544571 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734410e-eae6-4254-9ac3-a6222df6d825 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:41:45.544841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734410e-eae6-4254-9ac3-a6222df6d825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:41:45.552094 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734410e-eae6-4254-9ac3-a6222df6d825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:41:45.553491 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734410e-eae6-4254-9ac3-a6222df6d825 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:41:45.561411 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1224/2426] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:41:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:41:45.644458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35137135-869d-4bb3-abaf-f5947a119580 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:41:45.644740 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35137135-869d-4bb3-abaf-f5947a119580 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:41:45.645012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35137135-869d-4bb3-abaf-f5947a119580 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:41:45.646393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1203/2427] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 26 01:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 01:41:45.652520 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a413ef-dfba-4ed0-8dd1-6620330fe888 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:41:45.652802 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a413ef-dfba-4ed0-8dd1-6620330fe888 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:41:45.653099 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a413ef-dfba-4ed0-8dd1-6620330fe888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:41:45.673745 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-57a413ef-dfba-4ed0-8dd1-6620330fe888 None None] MFA Rules not processed for user `3d6eaeb6bced49afabc7bdaa5e7cecfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:41:45.674920 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-57a413ef-dfba-4ed0-8dd1-6620330fe888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:41:45.684250 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1225/2428] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 26 01:41:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:41:45.694537 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35137135-869d-4bb3-abaf-f5947a119580 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:41:45.706507 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35137135-869d-4bb3-abaf-f5947a119580 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:41:45.710035 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3489b2-1603-482c-be3a-36c9fff3a53e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:41:45.710618 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3489b2-1603-482c-be3a-36c9fff3a53e service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:41:45.710937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3489b2-1603-482c-be3a-36c9fff3a53e service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:41:45.711210 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3489b2-1603-482c-be3a-36c9fff3a53e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:41:45.722321 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3489b2-1603-482c-be3a-36c9fff3a53e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:41:45.723783 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3489b2-1603-482c-be3a-36c9fff3a53e service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:41:45.734725 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1204/2429] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:41:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:41:45.796811 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a413ef-dfba-4ed0-8dd1-6620330fe888 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:41:45.797730 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-57a413ef-dfba-4ed0-8dd1-6620330fe888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:41:45.867288 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a413ef-dfba-4ed0-8dd1-6620330fe888 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:41:45.873049 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af48236-ca4f-4bcf-bcdc-d3bb088b3ceb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7a1b839a6f4bdb9870217fa4d2527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:41:45.873678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af48236-ca4f-4bcf-bcdc-d3bb088b3ceb service placement] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:41:45.873954 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af48236-ca4f-4bcf-bcdc-d3bb088b3ceb service placement] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:41:45.874226 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af48236-ca4f-4bcf-bcdc-d3bb088b3ceb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:41:45.875969 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0af48236-ca4f-4bcf-bcdc-d3bb088b3ceb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:41:45.887816 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af48236-ca4f-4bcf-bcdc-d3bb088b3ceb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:41:45.889413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af48236-ca4f-4bcf-bcdc-d3bb088b3ceb service placement] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:41:45.899126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1226/2430] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:41:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:41:55.730137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=15 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:55.895004 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=41 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:03.522884 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3489b2-1603-482c-be3a-36c9fff3a53e service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:03.524305 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-cb3489b2-1603-482c-be3a-36c9fff3a53e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:03.585881 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3489b2-1603-482c-be3a-36c9fff3a53e service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:03.589527 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7004a-88a5-42e0-8f8f-5be16cac86eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:03.590637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7004a-88a5-42e0-8f8f-5be16cac86eb service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:03.590935 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7004a-88a5-42e0-8f8f-5be16cac86eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:03.591199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7004a-88a5-42e0-8f8f-5be16cac86eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:03.592903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8ad7004a-88a5-42e0-8f8f-5be16cac86eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:03.603410 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7004a-88a5-42e0-8f8f-5be16cac86eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:03.604813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7004a-88a5-42e0-8f8f-5be16cac86eb service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:03.615285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1205/2431] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:42:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:42:05.277775 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af48236-ca4f-4bcf-bcdc-d3bb088b3ceb service placement] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:05.279200 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0af48236-ca4f-4bcf-bcdc-d3bb088b3ceb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:05.290283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af48236-ca4f-4bcf-bcdc-d3bb088b3ceb service placement] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:05.293991 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21f150-47a7-4445-84a7-33d612bf72f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:05.294573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21f150-47a7-4445-84a7-33d612bf72f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:05.294886 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21f150-47a7-4445-84a7-33d612bf72f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:05.295160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21f150-47a7-4445-84a7-33d612bf72f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:05.296810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-1d21f150-47a7-4445-84a7-33d612bf72f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:05.354989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21f150-47a7-4445-84a7-33d612bf72f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:05.356664 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21f150-47a7-4445-84a7-33d612bf72f8 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:05.365540 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1227/2432] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:42:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:42:09.003378 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7004a-88a5-42e0-8f8f-5be16cac86eb service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:09.004875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8ad7004a-88a5-42e0-8f8f-5be16cac86eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:09.024270 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7004a-88a5-42e0-8f8f-5be16cac86eb service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:09.031535 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f8f2b-13b4-43cf-9601-ce660a2933c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:09.032498 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f8f2b-13b4-43cf-9601-ce660a2933c3 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:09.032989 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f8f2b-13b4-43cf-9601-ce660a2933c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:09.033480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f8f2b-13b4-43cf-9601-ce660a2933c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:09.035760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-749f8f2b-13b4-43cf-9601-ce660a2933c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:09.050089 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f8f2b-13b4-43cf-9601-ce660a2933c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:09.052045 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f8f2b-13b4-43cf-9601-ce660a2933c3 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:09.064991 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1206/2433] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:42:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:42:15.361501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=28 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:15.405076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000b76a-1651-45fd-8565-88da950f2ac6 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:15.405358 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000b76a-1651-45fd-8565-88da950f2ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:15.405634 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000b76a-1651-45fd-8565-88da950f2ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:15.425105 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-2000b76a-1651-45fd-8565-88da950f2ac6 None None] MFA Rules not processed for user `148b0d6aee584ecab139cf93e8d32578`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:15.426308 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-2000b76a-1651-45fd-8565-88da950f2ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:15.482723 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1228/2434] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:16.117157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f8f2b-13b4-43cf-9601-ce660a2933c3 service nova] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:16.126811 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f8f2b-13b4-43cf-9601-ce660a2933c3 service nova] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:16.130923 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc35df8-5aa1-4e3e-a49f-c947618cab93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:16.131536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc35df8-5aa1-4e3e-a49f-c947618cab93 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:16.131818 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc35df8-5aa1-4e3e-a49f-c947618cab93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:16.132099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc35df8-5aa1-4e3e-a49f-c947618cab93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:16.133871 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7fc35df8-5aa1-4e3e-a49f-c947618cab93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:16.144191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc35df8-5aa1-4e3e-a49f-c947618cab93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:16.145604 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc35df8-5aa1-4e3e-a49f-c947618cab93 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:16.161200 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1207/2435] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:42:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:42:16.580227 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbd09a-8df3-4c38-a534-9c70eb8e7b3d None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:16.580798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbd09a-8df3-4c38-a534-9c70eb8e7b3d None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:16.580798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbd09a-8df3-4c38-a534-9c70eb8e7b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:16.603097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-6dcbd09a-8df3-4c38-a534-9c70eb8e7b3d None None] MFA Rules not processed for user `5b5c8f664d1c4b4599c1d459782e02d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:16.604395 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6dcbd09a-8df3-4c38-a534-9c70eb8e7b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:16.612193 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1229/2436] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:20.888456 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc35df8-5aa1-4e3e-a49f-c947618cab93 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:20.911228 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc35df8-5aa1-4e3e-a49f-c947618cab93 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:20.924430 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e60fc-db97-4513-bd27-db860208872c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:20.925127 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e60fc-db97-4513-bd27-db860208872c service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:20.926061 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e60fc-db97-4513-bd27-db860208872c service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:20.926410 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e60fc-db97-4513-bd27-db860208872c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:20.933661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8f1e60fc-db97-4513-bd27-db860208872c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:20.966980 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e60fc-db97-4513-bd27-db860208872c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:20.969011 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e60fc-db97-4513-bd27-db860208872c service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:20.985469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1208/2437] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:42:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:42:26.596185 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=28 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:28.867507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbd09a-8df3-4c38-a534-9c70eb8e7b3d None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:28.868923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6dcbd09a-8df3-4c38-a534-9c70eb8e7b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:28.886512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbd09a-8df3-4c38-a534-9c70eb8e7b3d None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:28.892313 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d447be-9ad1-4d7b-bb17-72c1a68b6736 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:28.892911 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d447be-9ad1-4d7b-bb17-72c1a68b6736 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:28.893187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d447be-9ad1-4d7b-bb17-72c1a68b6736 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:28.893455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d447be-9ad1-4d7b-bb17-72c1a68b6736 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:28.895179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-18d447be-9ad1-4d7b-bb17-72c1a68b6736 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:28.908270 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d447be-9ad1-4d7b-bb17-72c1a68b6736 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:28.909829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d447be-9ad1-4d7b-bb17-72c1a68b6736 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:28.921319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1230/2438] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:42:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:42:30.977603 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=44 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:32.168118 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e60fc-db97-4513-bd27-db860208872c service nova] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:32.179391 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e60fc-db97-4513-bd27-db860208872c service nova] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:32.183188 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef90bc-097d-4915-9f44-3f31638ec121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:32.183805 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef90bc-097d-4915-9f44-3f31638ec121 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:32.184084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef90bc-097d-4915-9f44-3f31638ec121 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:32.184364 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef90bc-097d-4915-9f44-3f31638ec121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:32.186268 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-73ef90bc-097d-4915-9f44-3f31638ec121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:32.255842 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef90bc-097d-4915-9f44-3f31638ec121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:32.257452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef90bc-097d-4915-9f44-3f31638ec121 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:32.269654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1209/2439] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:42:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:42:35.548063 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d447be-9ad1-4d7b-bb17-72c1a68b6736 service nova] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:35.549500 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-18d447be-9ad1-4d7b-bb17-72c1a68b6736 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:35.573151 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d447be-9ad1-4d7b-bb17-72c1a68b6736 service nova] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:35.582950 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07915cf9-4097-4143-ad94-8eb48c8446c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7a1b839a6f4bdb9870217fa4d2527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:35.583851 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07915cf9-4097-4143-ad94-8eb48c8446c5 service placement] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:35.584476 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07915cf9-4097-4143-ad94-8eb48c8446c5 service placement] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:35.584701 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07915cf9-4097-4143-ad94-8eb48c8446c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:35.586544 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-07915cf9-4097-4143-ad94-8eb48c8446c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:35.600019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07915cf9-4097-4143-ad94-8eb48c8446c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:35.602305 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07915cf9-4097-4143-ad94-8eb48c8446c5 service placement] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:35.614987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1231/2440] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:42:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:42:35.615522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef90bc-097d-4915-9f44-3f31638ec121 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:35.617170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-73ef90bc-097d-4915-9f44-3f31638ec121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:35.634721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef90bc-097d-4915-9f44-3f31638ec121 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:35.640441 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa873017-0532-45d7-8eb5-5fdb745222b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:35.641080 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa873017-0532-45d7-8eb5-5fdb745222b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:35.641357 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa873017-0532-45d7-8eb5-5fdb745222b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:35.641627 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa873017-0532-45d7-8eb5-5fdb745222b1 admin admin] PATH_INFO: `/v3/users/c52e611cab734987bea6b2c5cc48a21f` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:35.642754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa873017-0532-45d7-8eb5-5fdb745222b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c52e611cab734987bea6b2c5cc48a21f)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:35.644695 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa873017-0532-45d7-8eb5-5fdb745222b1 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:35.693297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-fa873017-0532-45d7-8eb5-5fdb745222b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c52e611cab734987bea6b2c5cc48a21f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:35.694015 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-fa873017-0532-45d7-8eb5-5fdb745222b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c52e611cab734987bea6b2c5cc48a21f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:35.694622 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-fa873017-0532-45d7-8eb5-5fdb745222b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c52e611cab734987bea6b2c5cc48a21f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:35.707404 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-fa873017-0532-45d7-8eb5-5fdb745222b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c52e611cab734987bea6b2c5cc48a21f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:35.714143 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-fa873017-0532-45d7-8eb5-5fdb745222b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c52e611cab734987bea6b2c5cc48a21f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:35.727698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1210/2441] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:42:35 2022] DELETE /identity/v3/users/c52e611cab734987bea6b2c5cc48a21f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:42:35.895654 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07915cf9-4097-4143-ad94-8eb48c8446c5 service placement] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:35.906902 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07915cf9-4097-4143-ad94-8eb48c8446c5 service placement] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:35.968306 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec3061-0ad9-4a2d-873a-ba81588110fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:35.969028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec3061-0ad9-4a2d-873a-ba81588110fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:35.969351 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec3061-0ad9-4a2d-873a-ba81588110fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:35.969667 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec3061-0ad9-4a2d-873a-ba81588110fe admin admin] PATH_INFO: `/v3/projects/8e8b37c0a2c74cfe8a371ef123de87aa` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:35.971006 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec3061-0ad9-4a2d-873a-ba81588110fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e8b37c0a2c74cfe8a371ef123de87aa)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:35.973423 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec3061-0ad9-4a2d-873a-ba81588110fe admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:36.020284 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-baec3061-0ad9-4a2d-873a-ba81588110fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e8b37c0a2c74cfe8a371ef123de87aa', 'request_id': 'req-baec3061-0ad9-4a2d-873a-ba81588110fe'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:36.026273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-baec3061-0ad9-4a2d-873a-ba81588110fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e8b37c0a2c74cfe8a371ef123de87aa', 'request_id': 'req-baec3061-0ad9-4a2d-873a-ba81588110fe'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:36.032000 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-baec3061-0ad9-4a2d-873a-ba81588110fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e8b37c0a2c74cfe8a371ef123de87aa', 'request_id': 'req-baec3061-0ad9-4a2d-873a-ba81588110fe'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:36.043621 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-baec3061-0ad9-4a2d-873a-ba81588110fe admin admin] The token cache is being invalidate because project 8e8b37c0a2c74cfe8a371ef123de87aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:42:36.043906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-baec3061-0ad9-4a2d-873a-ba81588110fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:36.044552 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-baec3061-0ad9-4a2d-873a-ba81588110fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:36.046079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1232/2442] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:42:35 2022] DELETE /identity/v3/projects/8e8b37c0a2c74cfe8a371ef123de87aa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:36.051100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0125ca-ee38-4567-9bb9-bd4ac8e5309e None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:36.051385 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0125ca-ee38-4567-9bb9-bd4ac8e5309e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:36.051655 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0125ca-ee38-4567-9bb9-bd4ac8e5309e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:36.071561 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-ab0125ca-ee38-4567-9bb9-bd4ac8e5309e None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:36.072741 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ab0125ca-ee38-4567-9bb9-bd4ac8e5309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:36.135912 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1211/2443] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:36.143940 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b4461-312c-44a3-9f49-e44dad522bed None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:36.144230 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b4461-312c-44a3-9f49-e44dad522bed None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:36.144504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b4461-312c-44a3-9f49-e44dad522bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:36.163835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-6d5b4461-312c-44a3-9f49-e44dad522bed None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:36.165040 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6d5b4461-312c-44a3-9f49-e44dad522bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:36.173219 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1233/2444] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:36.177241 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0125ca-ee38-4567-9bb9-bd4ac8e5309e None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:36.188368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0125ca-ee38-4567-9bb9-bd4ac8e5309e None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:36.193667 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fee51e-2737-4c48-a3b2-404b0b3e19ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:36.194374 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fee51e-2737-4c48-a3b2-404b0b3e19ba admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:36.194674 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fee51e-2737-4c48-a3b2-404b0b3e19ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:36.196293 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fee51e-2737-4c48-a3b2-404b0b3e19ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:36.196293 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fee51e-2737-4c48-a3b2-404b0b3e19ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:42:36.196293 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fee51e-2737-4c48-a3b2-404b0b3e19ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:36.197748 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fee51e-2737-4c48-a3b2-404b0b3e19ba admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:36.199438 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:36.216168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1212/2445] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:42:36.217667 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b4461-312c-44a3-9f49-e44dad522bed None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:36.226853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b4461-312c-44a3-9f49-e44dad522bed None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:36.231501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b0572-447c-427e-9701-be8368392d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:36.232614 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b0572-447c-427e-9701-be8368392d11 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:36.232900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b0572-447c-427e-9701-be8368392d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:36.233167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b0572-447c-427e-9701-be8368392d11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:36.233794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b0572-447c-427e-9701-be8368392d11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:36.235705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b0572-447c-427e-9701-be8368392d11 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:36.266532 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1234/2446] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:42:36 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:42:36.267783 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fee51e-2737-4c48-a3b2-404b0b3e19ba admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:36.278184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fee51e-2737-4c48-a3b2-404b0b3e19ba admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:36.338547 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e17be6-e5bc-407e-8f67-6819625b5189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:36.339203 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e17be6-e5bc-407e-8f67-6819625b5189 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:36.339487 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e17be6-e5bc-407e-8f67-6819625b5189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:36.339760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e17be6-e5bc-407e-8f67-6819625b5189 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:36.340393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e17be6-e5bc-407e-8f67-6819625b5189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:36.343408 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e17be6-e5bc-407e-8f67-6819625b5189 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:36.368621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1213/2447] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:42:36 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:42:36.369696 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b0572-447c-427e-9701-be8368392d11 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:36.380631 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b0572-447c-427e-9701-be8368392d11 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:36.385641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436929c0-7bd5-4935-911d-6fd453323561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:36.386299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436929c0-7bd5-4935-911d-6fd453323561 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:36.386589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436929c0-7bd5-4935-911d-6fd453323561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:36.386964 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436929c0-7bd5-4935-911d-6fd453323561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:36.387620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436929c0-7bd5-4935-911d-6fd453323561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:36.390284 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436929c0-7bd5-4935-911d-6fd453323561 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:36.400894 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1235/2448] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:42:36.405472 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e17be6-e5bc-407e-8f67-6819625b5189 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:36.417212 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e17be6-e5bc-407e-8f67-6819625b5189 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:36.423047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3465f2-167d-4dd0-ba0a-75b7161abfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:36.423659 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3465f2-167d-4dd0-ba0a-75b7161abfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:36.423943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3465f2-167d-4dd0-ba0a-75b7161abfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:36.424222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3465f2-167d-4dd0-ba0a-75b7161abfd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:36.424866 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3465f2-167d-4dd0-ba0a-75b7161abfd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:36.426468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3465f2-167d-4dd0-ba0a-75b7161abfd6 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:36.438377 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1214/2449] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:42:36.442671 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436929c0-7bd5-4935-911d-6fd453323561 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:36.454670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436929c0-7bd5-4935-911d-6fd453323561 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:36.457920 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fba6e-2088-47ca-9d41-29ecfc04c220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:36.458569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fba6e-2088-47ca-9d41-29ecfc04c220 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:36.458881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fba6e-2088-47ca-9d41-29ecfc04c220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:36.459163 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fba6e-2088-47ca-9d41-29ecfc04c220 admin admin] PATH_INFO: `/v3/projects/3d02f10e1b13483aa96ab6591ce4d6fe/users/a57f378f957a4760a52dda38d24034a0/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:36.474025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461fba6e-2088-47ca-9d41-29ecfc04c220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d02f10e1b13483aa96ab6591ce4d6fe, user_id=a57f378f957a4760a52dda38d24034a0, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:36.476700 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461fba6e-2088-47ca-9d41-29ecfc04c220 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:36.486612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:36.491793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1236/2450] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:42:36 2022] PUT /identity/v3/projects/3d02f10e1b13483aa96ab6591ce4d6fe/users/a57f378f957a4760a52dda38d24034a0/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:36.502747 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07909dea-c1c2-4730-8721-229ff8da747f None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:36.503186 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07909dea-c1c2-4730-8721-229ff8da747f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:36.503668 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07909dea-c1c2-4730-8721-229ff8da747f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:36.531891 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-07909dea-c1c2-4730-8721-229ff8da747f None None] MFA Rules not processed for user `a57f378f957a4760a52dda38d24034a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:36.533197 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-07909dea-c1c2-4730-8721-229ff8da747f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:36.601327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1215/2451] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:36.612578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fba6e-2088-47ca-9d41-29ecfc04c220 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:36.614784 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-461fba6e-2088-47ca-9d41-29ecfc04c220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:36.692950 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fba6e-2088-47ca-9d41-29ecfc04c220 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:36.698902 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8d05c-a187-478e-be26-dcbace29b03d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:36.699508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8d05c-a187-478e-be26-dcbace29b03d service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:36.699789 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8d05c-a187-478e-be26-dcbace29b03d service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:36.700071 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8d05c-a187-478e-be26-dcbace29b03d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:36.708261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8d05c-a187-478e-be26-dcbace29b03d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:36.709849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8d05c-a187-478e-be26-dcbace29b03d service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:36.719691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1237/2452] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:42:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:42:39.440452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07909dea-c1c2-4730-8721-229ff8da747f None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:39.502457 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07909dea-c1c2-4730-8721-229ff8da747f None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:39.507471 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b706c4-7089-4ac1-b34c-77d4a8181cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:39.507650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b706c4-7089-4ac1-b34c-77d4a8181cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:39.507927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b706c4-7089-4ac1-b34c-77d4a8181cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:39.508198 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b706c4-7089-4ac1-b34c-77d4a8181cd7 admin admin] PATH_INFO: `/v3/users/a57f378f957a4760a52dda38d24034a0` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:39.509315 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b706c4-7089-4ac1-b34c-77d4a8181cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a57f378f957a4760a52dda38d24034a0)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:39.511250 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b706c4-7089-4ac1-b34c-77d4a8181cd7 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:39.513682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:39.559012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-75b706c4-7089-4ac1-b34c-77d4a8181cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a57f378f957a4760a52dda38d24034a0'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:39.559671 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-75b706c4-7089-4ac1-b34c-77d4a8181cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a57f378f957a4760a52dda38d24034a0'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:39.561085 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-75b706c4-7089-4ac1-b34c-77d4a8181cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a57f378f957a4760a52dda38d24034a0'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:39.579783 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-75b706c4-7089-4ac1-b34c-77d4a8181cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a57f378f957a4760a52dda38d24034a0'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:39.587295 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-75b706c4-7089-4ac1-b34c-77d4a8181cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a57f378f957a4760a52dda38d24034a0'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:39.599724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1216/2453] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:42:39 2022] DELETE /identity/v3/users/a57f378f957a4760a52dda38d24034a0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:39.604251 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b86fad-993a-424c-a4bf-a686aef96601 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:39.604779 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b86fad-993a-424c-a4bf-a686aef96601 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:39.604779 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b86fad-993a-424c-a4bf-a686aef96601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:39.625869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-86b86fad-993a-424c-a4bf-a686aef96601 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:39.627032 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-86b86fad-993a-424c-a4bf-a686aef96601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:39.687014 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1238/2454] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:39.696686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b706c4-7089-4ac1-b34c-77d4a8181cd7 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:39.698061 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-75b706c4-7089-4ac1-b34c-77d4a8181cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:39.755130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b706c4-7089-4ac1-b34c-77d4a8181cd7 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:39.758759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fead82-c659-4ad5-98a5-3252c0bbd9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:39.759387 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fead82-c659-4ad5-98a5-3252c0bbd9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:39.759665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fead82-c659-4ad5-98a5-3252c0bbd9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:39.759938 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fead82-c659-4ad5-98a5-3252c0bbd9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:39.768917 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fead82-c659-4ad5-98a5-3252c0bbd9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:39.770328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fead82-c659-4ad5-98a5-3252c0bbd9f8 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:39.780457 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1217/2455] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:42:40.048653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b86fad-993a-424c-a4bf-a686aef96601 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:40.050091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-86b86fad-993a-424c-a4bf-a686aef96601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:40.064074 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b86fad-993a-424c-a4bf-a686aef96601 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:40.069220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf7524-5bbe-49b2-b3cd-b339bc4f101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:40.069383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf7524-5bbe-49b2-b3cd-b339bc4f101d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:40.069618 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf7524-5bbe-49b2-b3cd-b339bc4f101d admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:40.069888 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf7524-5bbe-49b2-b3cd-b339bc4f101d admin admin] PATH_INFO: `/v3/projects/3d02f10e1b13483aa96ab6591ce4d6fe` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:40.071034 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf7524-5bbe-49b2-b3cd-b339bc4f101d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d02f10e1b13483aa96ab6591ce4d6fe)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:40.072921 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf7524-5bbe-49b2-b3cd-b339bc4f101d admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:40.121794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6bdf7524-5bbe-49b2-b3cd-b339bc4f101d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d02f10e1b13483aa96ab6591ce4d6fe', 'request_id': 'req-6bdf7524-5bbe-49b2-b3cd-b339bc4f101d'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:40.128736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6bdf7524-5bbe-49b2-b3cd-b339bc4f101d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d02f10e1b13483aa96ab6591ce4d6fe', 'request_id': 'req-6bdf7524-5bbe-49b2-b3cd-b339bc4f101d'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:40.134327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6bdf7524-5bbe-49b2-b3cd-b339bc4f101d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d02f10e1b13483aa96ab6591ce4d6fe', 'request_id': 'req-6bdf7524-5bbe-49b2-b3cd-b339bc4f101d'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:40.146914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6bdf7524-5bbe-49b2-b3cd-b339bc4f101d admin admin] The token cache is being invalidate because project 3d02f10e1b13483aa96ab6591ce4d6fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:42:40.147202 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6bdf7524-5bbe-49b2-b3cd-b339bc4f101d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:40.147822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6bdf7524-5bbe-49b2-b3cd-b339bc4f101d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:40.149281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1239/2456] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:42:40 2022] DELETE /identity/v3/projects/3d02f10e1b13483aa96ab6591ce4d6fe => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:40.154315 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2926c0-a9ef-4127-87d2-25e07e05c46e None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:40.154628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2926c0-a9ef-4127-87d2-25e07e05c46e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:40.154958 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2926c0-a9ef-4127-87d2-25e07e05c46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:40.176111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-0f2926c0-a9ef-4127-87d2-25e07e05c46e None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:40.177239 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0f2926c0-a9ef-4127-87d2-25e07e05c46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:40.240214 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1218/2457] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:40.249908 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eebc3-78b7-4399-b783-4aff88244bf4 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:40.250192 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eebc3-78b7-4399-b783-4aff88244bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:40.250466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eebc3-78b7-4399-b783-4aff88244bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:40.270693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-008eebc3-78b7-4399-b783-4aff88244bf4 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:40.271911 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-008eebc3-78b7-4399-b783-4aff88244bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:40.279623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1240/2458] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:40.283768 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2926c0-a9ef-4127-87d2-25e07e05c46e None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:40.293474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2926c0-a9ef-4127-87d2-25e07e05c46e None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:40.300616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03198c4f-986a-4c0c-8688-749d48ab9d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:40.301624 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03198c4f-986a-4c0c-8688-749d48ab9d46 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:40.302108 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03198c4f-986a-4c0c-8688-749d48ab9d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:40.302605 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03198c4f-986a-4c0c-8688-749d48ab9d46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:40.303685 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03198c4f-986a-4c0c-8688-749d48ab9d46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:42:40.303996 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03198c4f-986a-4c0c-8688-749d48ab9d46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:40.305639 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03198c4f-986a-4c0c-8688-749d48ab9d46 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:40.319274 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1219/2459] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:42:40.323806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008eebc3-78b7-4399-b783-4aff88244bf4 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:40.328748 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:40.335441 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008eebc3-78b7-4399-b783-4aff88244bf4 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:40.341081 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccaf98-764b-4fec-9239-dc8b39b626d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:40.341727 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccaf98-764b-4fec-9239-dc8b39b626d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:40.342003 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccaf98-764b-4fec-9239-dc8b39b626d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:40.342272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccaf98-764b-4fec-9239-dc8b39b626d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:40.342936 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccaf98-764b-4fec-9239-dc8b39b626d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:40.344836 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccaf98-764b-4fec-9239-dc8b39b626d2 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:40.371982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1241/2460] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:42:40 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:42:40.377017 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03198c4f-986a-4c0c-8688-749d48ab9d46 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:40.387016 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03198c4f-986a-4c0c-8688-749d48ab9d46 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:40.395034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:40.448036 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02763b3-bc55-464f-a1b3-d342e20fa64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:40.448613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02763b3-bc55-464f-a1b3-d342e20fa64a admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:40.448833 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02763b3-bc55-464f-a1b3-d342e20fa64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:40.449107 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02763b3-bc55-464f-a1b3-d342e20fa64a admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:40.449755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02763b3-bc55-464f-a1b3-d342e20fa64a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:40.451744 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02763b3-bc55-464f-a1b3-d342e20fa64a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:40.472762 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1220/2461] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:42:40 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:42:40.477232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccaf98-764b-4fec-9239-dc8b39b626d2 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:40.488317 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccaf98-764b-4fec-9239-dc8b39b626d2 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:40.492944 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215b36d-b23a-4afb-86cc-3e7cc36801f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:40.493536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215b36d-b23a-4afb-86cc-3e7cc36801f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:40.493819 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215b36d-b23a-4afb-86cc-3e7cc36801f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:40.494089 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215b36d-b23a-4afb-86cc-3e7cc36801f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:40.494720 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215b36d-b23a-4afb-86cc-3e7cc36801f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:40.496320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215b36d-b23a-4afb-86cc-3e7cc36801f2 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:40.506268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1242/2462] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:42:40.510264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02763b3-bc55-464f-a1b3-d342e20fa64a admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:40.520258 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02763b3-bc55-464f-a1b3-d342e20fa64a admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:40.524925 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11012f65-9dab-4811-a382-811a99b2753e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:40.525515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11012f65-9dab-4811-a382-811a99b2753e admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:40.525795 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11012f65-9dab-4811-a382-811a99b2753e admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:40.526067 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11012f65-9dab-4811-a382-811a99b2753e admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:40.526701 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11012f65-9dab-4811-a382-811a99b2753e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:40.528362 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11012f65-9dab-4811-a382-811a99b2753e admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:40.539709 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1221/2463] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:42:40.543645 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215b36d-b23a-4afb-86cc-3e7cc36801f2 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:40.554341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215b36d-b23a-4afb-86cc-3e7cc36801f2 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:40.559077 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd860032-e25f-498a-9046-e13b6d9fb0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:40.559713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd860032-e25f-498a-9046-e13b6d9fb0f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:40.559995 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd860032-e25f-498a-9046-e13b6d9fb0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:40.560346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd860032-e25f-498a-9046-e13b6d9fb0f5 admin admin] PATH_INFO: `/v3/projects/cf081bd3235148d981962c7b1ceebfc0/users/80bc6be81acc4bf6879c513673d50acd/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:40.574815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd860032-e25f-498a-9046-e13b6d9fb0f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf081bd3235148d981962c7b1ceebfc0, user_id=80bc6be81acc4bf6879c513673d50acd, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:40.578095 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd860032-e25f-498a-9046-e13b6d9fb0f5 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:40.591015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1243/2464] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:42:40 2022] PUT /identity/v3/projects/cf081bd3235148d981962c7b1ceebfc0/users/80bc6be81acc4bf6879c513673d50acd/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:40.601835 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca27eef-dbb0-4b2d-a5c0-20e9745e9098 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:40.602118 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca27eef-dbb0-4b2d-a5c0-20e9745e9098 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:40.602527 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca27eef-dbb0-4b2d-a5c0-20e9745e9098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:40.630691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-7ca27eef-dbb0-4b2d-a5c0-20e9745e9098 None None] MFA Rules not processed for user `80bc6be81acc4bf6879c513673d50acd`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:40.631964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7ca27eef-dbb0-4b2d-a5c0-20e9745e9098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:40.695794 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1222/2465] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:40.707556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd860032-e25f-498a-9046-e13b6d9fb0f5 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:40.709274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-cd860032-e25f-498a-9046-e13b6d9fb0f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:40.783841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd860032-e25f-498a-9046-e13b6d9fb0f5 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:40.789265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1b882-3c6f-472d-a374-4b4b02ceb349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:40.789857 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1b882-3c6f-472d-a374-4b4b02ceb349 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:40.790134 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1b882-3c6f-472d-a374-4b4b02ceb349 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:40.790407 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1b882-3c6f-472d-a374-4b4b02ceb349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:40.799278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1b882-3c6f-472d-a374-4b4b02ceb349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:40.800901 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1b882-3c6f-472d-a374-4b4b02ceb349 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:40.809832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1244/2466] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:42:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:42:41.023098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca27eef-dbb0-4b2d-a5c0-20e9745e9098 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:41.084755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca27eef-dbb0-4b2d-a5c0-20e9745e9098 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:41.089359 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c8789-71c8-4438-9c01-76e99dda0f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:41.089982 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c8789-71c8-4438-9c01-76e99dda0f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:41.090292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c8789-71c8-4438-9c01-76e99dda0f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:41.090669 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c8789-71c8-4438-9c01-76e99dda0f16 admin admin] PATH_INFO: `/v3/users/80bc6be81acc4bf6879c513673d50acd` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:41.092415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c8789-71c8-4438-9c01-76e99dda0f16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80bc6be81acc4bf6879c513673d50acd)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:41.094305 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c8789-71c8-4438-9c01-76e99dda0f16 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:41.115575 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:41.142930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-002c8789-71c8-4438-9c01-76e99dda0f16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80bc6be81acc4bf6879c513673d50acd'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:41.143581 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-002c8789-71c8-4438-9c01-76e99dda0f16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80bc6be81acc4bf6879c513673d50acd'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:41.144179 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-002c8789-71c8-4438-9c01-76e99dda0f16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80bc6be81acc4bf6879c513673d50acd'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:41.155899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-002c8789-71c8-4438-9c01-76e99dda0f16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80bc6be81acc4bf6879c513673d50acd'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:41.162573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-002c8789-71c8-4438-9c01-76e99dda0f16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80bc6be81acc4bf6879c513673d50acd'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:41.174639 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1223/2467] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:42:41 2022] DELETE /identity/v3/users/80bc6be81acc4bf6879c513673d50acd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:41.179116 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d01ee5-ef00-4163-9555-e5c59d6478a0 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:41.179490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d01ee5-ef00-4163-9555-e5c59d6478a0 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:41.179883 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d01ee5-ef00-4163-9555-e5c59d6478a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:41.200301 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-b7d01ee5-ef00-4163-9555-e5c59d6478a0 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:41.202657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b7d01ee5-ef00-4163-9555-e5c59d6478a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:41.260032 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1245/2468] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:41.270365 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c8789-71c8-4438-9c01-76e99dda0f16 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:41.271742 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-002c8789-71c8-4438-9c01-76e99dda0f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:41.330083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c8789-71c8-4438-9c01-76e99dda0f16 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:41.332047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade4d15-16b9-4c5d-8354-e409047d1362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:41.332649 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade4d15-16b9-4c5d-8354-e409047d1362 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:41.332927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade4d15-16b9-4c5d-8354-e409047d1362 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:41.333197 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade4d15-16b9-4c5d-8354-e409047d1362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:41.342278 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade4d15-16b9-4c5d-8354-e409047d1362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:41.343753 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade4d15-16b9-4c5d-8354-e409047d1362 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:41.353022 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1224/2469] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:42:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:42:41.619885 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d01ee5-ef00-4163-9555-e5c59d6478a0 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:41.621295 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b7d01ee5-ef00-4163-9555-e5c59d6478a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:41.635996 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d01ee5-ef00-4163-9555-e5c59d6478a0 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:41.641191 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c59a5f-e2c4-4d21-8129-d81e35400fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:41.642349 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c59a5f-e2c4-4d21-8129-d81e35400fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:41.642628 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c59a5f-e2c4-4d21-8129-d81e35400fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:41.642928 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c59a5f-e2c4-4d21-8129-d81e35400fd0 admin admin] PATH_INFO: `/v3/projects/cf081bd3235148d981962c7b1ceebfc0` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:41.644252 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c59a5f-e2c4-4d21-8129-d81e35400fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf081bd3235148d981962c7b1ceebfc0)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:41.646257 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c59a5f-e2c4-4d21-8129-d81e35400fd0 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:41.677093 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:41.695919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-86c59a5f-e2c4-4d21-8129-d81e35400fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf081bd3235148d981962c7b1ceebfc0', 'request_id': 'req-86c59a5f-e2c4-4d21-8129-d81e35400fd0'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:41.702889 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-86c59a5f-e2c4-4d21-8129-d81e35400fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf081bd3235148d981962c7b1ceebfc0', 'request_id': 'req-86c59a5f-e2c4-4d21-8129-d81e35400fd0'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:41.708664 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-86c59a5f-e2c4-4d21-8129-d81e35400fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf081bd3235148d981962c7b1ceebfc0', 'request_id': 'req-86c59a5f-e2c4-4d21-8129-d81e35400fd0'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:41.720681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-86c59a5f-e2c4-4d21-8129-d81e35400fd0 admin admin] The token cache is being invalidate because project cf081bd3235148d981962c7b1ceebfc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:42:41.720968 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-86c59a5f-e2c4-4d21-8129-d81e35400fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:41.721579 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-86c59a5f-e2c4-4d21-8129-d81e35400fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:41.723081 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1246/2470] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:42:41 2022] DELETE /identity/v3/projects/cf081bd3235148d981962c7b1ceebfc0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:41.728022 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f943c90-7a04-4c28-ae08-48641f216835 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:41.728464 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f943c90-7a04-4c28-ae08-48641f216835 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:41.728597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f943c90-7a04-4c28-ae08-48641f216835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:41.749489 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2f943c90-7a04-4c28-ae08-48641f216835 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:41.750685 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2f943c90-7a04-4c28-ae08-48641f216835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:41.809553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1225/2471] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:41.817938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88952a7-9c97-4fc4-8353-160b8649bda7 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:41.818228 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88952a7-9c97-4fc4-8353-160b8649bda7 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:41.818510 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88952a7-9c97-4fc4-8353-160b8649bda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:41.838515 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-c88952a7-9c97-4fc4-8353-160b8649bda7 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:41.839772 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c88952a7-9c97-4fc4-8353-160b8649bda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:41.847738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1247/2472] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:41.851906 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f943c90-7a04-4c28-ae08-48641f216835 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:41.862059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f943c90-7a04-4c28-ae08-48641f216835 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:41.866576 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc6352-832c-4181-8988-957b0a9f1bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:41.867195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc6352-832c-4181-8988-957b0a9f1bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:41.867471 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc6352-832c-4181-8988-957b0a9f1bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:41.867761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc6352-832c-4181-8988-957b0a9f1bb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:41.868372 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc6352-832c-4181-8988-957b0a9f1bb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:42:41.868674 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc6352-832c-4181-8988-957b0a9f1bb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:41.870262 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc6352-832c-4181-8988-957b0a9f1bb9 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:41.882235 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1226/2473] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:42:41.886343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88952a7-9c97-4fc4-8353-160b8649bda7 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:41.895538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88952a7-9c97-4fc4-8353-160b8649bda7 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:41.900246 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592db6b-bd5e-4a81-a0e0-ba4d5c977a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:41.900860 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592db6b-bd5e-4a81-a0e0-ba4d5c977a32 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:41.901140 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592db6b-bd5e-4a81-a0e0-ba4d5c977a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:41.901413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592db6b-bd5e-4a81-a0e0-ba4d5c977a32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:41.902043 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592db6b-bd5e-4a81-a0e0-ba4d5c977a32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:41.904567 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592db6b-bd5e-4a81-a0e0-ba4d5c977a32 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:41.932313 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1248/2474] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:42:41 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:42:41.936453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc6352-832c-4181-8988-957b0a9f1bb9 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:41.946314 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc6352-832c-4181-8988-957b0a9f1bb9 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:41.972269 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:42.004315 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83289b8d-64ed-412b-8e1c-5648dfa42dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:42.004913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83289b8d-64ed-412b-8e1c-5648dfa42dcf admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:42.005191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83289b8d-64ed-412b-8e1c-5648dfa42dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:42.005462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83289b8d-64ed-412b-8e1c-5648dfa42dcf admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:42.006077 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83289b8d-64ed-412b-8e1c-5648dfa42dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:42.008009 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83289b8d-64ed-412b-8e1c-5648dfa42dcf admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:42.029459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1227/2475] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:42:41 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:42:42.033538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592db6b-bd5e-4a81-a0e0-ba4d5c977a32 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:42.043800 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592db6b-bd5e-4a81-a0e0-ba4d5c977a32 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:42.048587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940ded8-0e04-45ac-8f37-495e64100995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:42.049175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940ded8-0e04-45ac-8f37-495e64100995 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:42.049454 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940ded8-0e04-45ac-8f37-495e64100995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:42.049725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940ded8-0e04-45ac-8f37-495e64100995 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:42.050357 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940ded8-0e04-45ac-8f37-495e64100995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:42.051941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940ded8-0e04-45ac-8f37-495e64100995 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:42.062375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1249/2476] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:42:42.066264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83289b8d-64ed-412b-8e1c-5648dfa42dcf admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:42.076698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83289b8d-64ed-412b-8e1c-5648dfa42dcf admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:42.081780 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcbbda-4059-4673-bd68-f452819a20aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:42.082366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcbbda-4059-4673-bd68-f452819a20aa admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:42.082649 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcbbda-4059-4673-bd68-f452819a20aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:42.083034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcbbda-4059-4673-bd68-f452819a20aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:42.083710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcbbda-4059-4673-bd68-f452819a20aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:42.085251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcbbda-4059-4673-bd68-f452819a20aa admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:42.096922 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1228/2477] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:42:42.101055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940ded8-0e04-45ac-8f37-495e64100995 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:42.111069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940ded8-0e04-45ac-8f37-495e64100995 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:42.115680 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f75b0-678b-40c6-b404-7e57a5e2821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:42.116303 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f75b0-678b-40c6-b404-7e57a5e2821d admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:42.116580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f75b0-678b-40c6-b404-7e57a5e2821d admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:42.116850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f75b0-678b-40c6-b404-7e57a5e2821d admin admin] PATH_INFO: `/v3/projects/be240932123f4f55902ed47cde118d75/users/8f5e546b29494d17bd56906e14eb8456/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:42.132398 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f75b0-678b-40c6-b404-7e57a5e2821d admin admin] RBAC: Authorizing `identity:create_grant(project_id=be240932123f4f55902ed47cde118d75, user_id=8f5e546b29494d17bd56906e14eb8456, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:42.135031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f75b0-678b-40c6-b404-7e57a5e2821d admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:42.147850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1250/2478] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:42:42 2022] PUT /identity/v3/projects/be240932123f4f55902ed47cde118d75/users/8f5e546b29494d17bd56906e14eb8456/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:42:42.159409 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cdab0-9091-4e42-8a02-5b48c613d48d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:42.159786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cdab0-9091-4e42-8a02-5b48c613d48d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:42.160064 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cdab0-9091-4e42-8a02-5b48c613d48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:42.188877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-492cdab0-9091-4e42-8a02-5b48c613d48d None None] MFA Rules not processed for user `8f5e546b29494d17bd56906e14eb8456`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:42.190094 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-492cdab0-9091-4e42-8a02-5b48c613d48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:42.255443 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1229/2479] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:42.260037 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f75b0-678b-40c6-b404-7e57a5e2821d admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:42.322342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f75b0-678b-40c6-b404-7e57a5e2821d admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:42.327241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23fe87-63f0-4757-aad9-9b7384d49883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:42.327836 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23fe87-63f0-4757-aad9-9b7384d49883 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:42.328118 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23fe87-63f0-4757-aad9-9b7384d49883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:42.328389 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23fe87-63f0-4757-aad9-9b7384d49883 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:42.329020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23fe87-63f0-4757-aad9-9b7384d49883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:42.330932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23fe87-63f0-4757-aad9-9b7384d49883 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:42.356501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1251/2480] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:42:42 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:42:42.361213 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cdab0-9091-4e42-8a02-5b48c613d48d None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:42.372173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cdab0-9091-4e42-8a02-5b48c613d48d None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:42.442379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c133e7-c6d3-438a-9122-914d52b76add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:42.443026 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c133e7-c6d3-438a-9122-914d52b76add admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:42.443310 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c133e7-c6d3-438a-9122-914d52b76add admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:42.443587 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c133e7-c6d3-438a-9122-914d52b76add admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:42.444237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c133e7-c6d3-438a-9122-914d52b76add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:42.446142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c133e7-c6d3-438a-9122-914d52b76add admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:42.466266 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1230/2481] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:42:42 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:42:42.470685 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23fe87-63f0-4757-aad9-9b7384d49883 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:42.480921 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23fe87-63f0-4757-aad9-9b7384d49883 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:42.486494 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568c13c-9f64-4627-bfe7-a6f176a4c655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:42.487121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568c13c-9f64-4627-bfe7-a6f176a4c655 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:42.487430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568c13c-9f64-4627-bfe7-a6f176a4c655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:42.487705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568c13c-9f64-4627-bfe7-a6f176a4c655 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:42.488338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568c13c-9f64-4627-bfe7-a6f176a4c655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:42.489912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568c13c-9f64-4627-bfe7-a6f176a4c655 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:42.501113 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1252/2482] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:42:42.505194 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c133e7-c6d3-438a-9122-914d52b76add admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:42.515124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c133e7-c6d3-438a-9122-914d52b76add admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:42.519762 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9ab3e-ec7c-4efe-983d-334be8c8b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:42.520411 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9ab3e-ec7c-4efe-983d-334be8c8b850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:42.520676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9ab3e-ec7c-4efe-983d-334be8c8b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:42.520952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9ab3e-ec7c-4efe-983d-334be8c8b850 admin admin] PATH_INFO: `/v3/projects/76b310476e9b480193a35fee4bfccc44/users/371ff505a8fb41f5901652061adbf7f1/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:42.535477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9ab3e-ec7c-4efe-983d-334be8c8b850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b310476e9b480193a35fee4bfccc44, user_id=371ff505a8fb41f5901652061adbf7f1, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:42.538108 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9ab3e-ec7c-4efe-983d-334be8c8b850 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:42.551529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1231/2483] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:42:42 2022] PUT /identity/v3/projects/76b310476e9b480193a35fee4bfccc44/users/371ff505a8fb41f5901652061adbf7f1/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:42:42.555518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568c13c-9f64-4627-bfe7-a6f176a4c655 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:42.566108 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568c13c-9f64-4627-bfe7-a6f176a4c655 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:42.586126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:42.625137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b44955-1088-46e3-8801-51e0b4b03fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:42.625738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b44955-1088-46e3-8801-51e0b4b03fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:42.626015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b44955-1088-46e3-8801-51e0b4b03fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:42.626289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b44955-1088-46e3-8801-51e0b4b03fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:42.626968 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b44955-1088-46e3-8801-51e0b4b03fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:42.628536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b44955-1088-46e3-8801-51e0b4b03fa8 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:42.638084 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1253/2484] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:42:42.642408 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9ab3e-ec7c-4efe-983d-334be8c8b850 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:42.647943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:42.655087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9ab3e-ec7c-4efe-983d-334be8c8b850 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:42.660136 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61618ba-5e90-40ed-bee2-ebed32315137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:42.660798 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61618ba-5e90-40ed-bee2-ebed32315137 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:42.661069 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61618ba-5e90-40ed-bee2-ebed32315137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:42.661342 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61618ba-5e90-40ed-bee2-ebed32315137 admin admin] PATH_INFO: `/v3/projects/76b310476e9b480193a35fee4bfccc44/users/371ff505a8fb41f5901652061adbf7f1/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:42.663353 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61618ba-5e90-40ed-bee2-ebed32315137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b310476e9b480193a35fee4bfccc44, user_id=371ff505a8fb41f5901652061adbf7f1, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:42.665985 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61618ba-5e90-40ed-bee2-ebed32315137 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:42.677019 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1232/2485] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:42:42 2022] PUT /identity/v3/projects/76b310476e9b480193a35fee4bfccc44/users/371ff505a8fb41f5901652061adbf7f1/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:42.687876 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b97cd-6712-40cb-80c9-61e35585b5bc None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:42.688195 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b97cd-6712-40cb-80c9-61e35585b5bc None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:42.688469 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b97cd-6712-40cb-80c9-61e35585b5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:42.721827 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-0c2b97cd-6712-40cb-80c9-61e35585b5bc None None] MFA Rules not processed for user `371ff505a8fb41f5901652061adbf7f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:42.723081 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0c2b97cd-6712-40cb-80c9-61e35585b5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:42.789372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1254/2486] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:42.801587 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61618ba-5e90-40ed-bee2-ebed32315137 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:42.803485 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d61618ba-5e90-40ed-bee2-ebed32315137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:42.860854 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61618ba-5e90-40ed-bee2-ebed32315137 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:42.864322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fbc72-46c2-4011-8d39-721ee77758e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:42.864912 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fbc72-46c2-4011-8d39-721ee77758e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:42.865186 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fbc72-46c2-4011-8d39-721ee77758e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:42.865455 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fbc72-46c2-4011-8d39-721ee77758e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:42.874260 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fbc72-46c2-4011-8d39-721ee77758e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:42.875726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fbc72-46c2-4011-8d39-721ee77758e1 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:42.885248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1233/2487] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:42:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:42:42.963036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b97cd-6712-40cb-80c9-61e35585b5bc None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:42.973175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b97cd-6712-40cb-80c9-61e35585b5bc None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:42.976795 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945e7f0-91e9-41e8-89cb-1b7cb16b3d7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:42.977411 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945e7f0-91e9-41e8-89cb-1b7cb16b3d7b service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:42.977686 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945e7f0-91e9-41e8-89cb-1b7cb16b3d7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:42.977953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945e7f0-91e9-41e8-89cb-1b7cb16b3d7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:43.034936 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945e7f0-91e9-41e8-89cb-1b7cb16b3d7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:43.036373 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945e7f0-91e9-41e8-89cb-1b7cb16b3d7b service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:43.045342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1255/2488] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:42:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:42:49.827562 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fbc72-46c2-4011-8d39-721ee77758e1 service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:49.887682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fbc72-46c2-4011-8d39-721ee77758e1 service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:49.892727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdc1fa-5405-4a74-9f06-0f551d0261ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:49.893343 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdc1fa-5405-4a74-9f06-0f551d0261ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:49.893621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdc1fa-5405-4a74-9f06-0f551d0261ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:49.893892 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdc1fa-5405-4a74-9f06-0f551d0261ef admin admin] PATH_INFO: `/v3/users/8f5e546b29494d17bd56906e14eb8456` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:49.895119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdc1fa-5405-4a74-9f06-0f551d0261ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f5e546b29494d17bd56906e14eb8456)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:49.897052 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdc1fa-5405-4a74-9f06-0f551d0261ef admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:49.942315 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9ebdc1fa-5405-4a74-9f06-0f551d0261ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f5e546b29494d17bd56906e14eb8456'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:49.942934 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9ebdc1fa-5405-4a74-9f06-0f551d0261ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f5e546b29494d17bd56906e14eb8456'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:49.943546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9ebdc1fa-5405-4a74-9f06-0f551d0261ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f5e546b29494d17bd56906e14eb8456'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:49.956059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9ebdc1fa-5405-4a74-9f06-0f551d0261ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f5e546b29494d17bd56906e14eb8456'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:49.962788 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9ebdc1fa-5405-4a74-9f06-0f551d0261ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f5e546b29494d17bd56906e14eb8456'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:49.975750 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1234/2489] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:42:49 2022] DELETE /identity/v3/users/8f5e546b29494d17bd56906e14eb8456 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:49.980340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93c4bb-4aaa-4fb8-931d-9d207bca0635 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:49.980833 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93c4bb-4aaa-4fb8-931d-9d207bca0635 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:49.980929 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93c4bb-4aaa-4fb8-931d-9d207bca0635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:49.999964 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-bb93c4bb-4aaa-4fb8-931d-9d207bca0635 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:50.001148 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-bb93c4bb-4aaa-4fb8-931d-9d207bca0635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:50.040961 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:50.060250 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1256/2490] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:50.069844 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdc1fa-5405-4a74-9f06-0f551d0261ef admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:50.071296 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-9ebdc1fa-5405-4a74-9f06-0f551d0261ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:50.085254 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:50.130980 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdc1fa-5405-4a74-9f06-0f551d0261ef admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:50.134557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856c97f-9207-4d4d-be79-0a94499d2f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:50.135175 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856c97f-9207-4d4d-be79-0a94499d2f0c service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:50.135452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856c97f-9207-4d4d-be79-0a94499d2f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:50.135726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856c97f-9207-4d4d-be79-0a94499d2f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:50.145125 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856c97f-9207-4d4d-be79-0a94499d2f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:50.146532 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856c97f-9207-4d4d-be79-0a94499d2f0c service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:50.159889 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1235/2491] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:42:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:42:50.419354 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93c4bb-4aaa-4fb8-931d-9d207bca0635 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:50.421161 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-bb93c4bb-4aaa-4fb8-931d-9d207bca0635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:50.435111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93c4bb-4aaa-4fb8-931d-9d207bca0635 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:50.441044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e44f3-b6f2-4ae8-965a-2dd63dee5be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:50.441882 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e44f3-b6f2-4ae8-965a-2dd63dee5be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:50.442163 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e44f3-b6f2-4ae8-965a-2dd63dee5be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:50.442486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e44f3-b6f2-4ae8-965a-2dd63dee5be7 admin admin] PATH_INFO: `/v3/projects/be240932123f4f55902ed47cde118d75` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:50.443652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e44f3-b6f2-4ae8-965a-2dd63dee5be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be240932123f4f55902ed47cde118d75)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:50.445480 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e44f3-b6f2-4ae8-965a-2dd63dee5be7 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:50.492902 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-172e44f3-b6f2-4ae8-965a-2dd63dee5be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be240932123f4f55902ed47cde118d75', 'request_id': 'req-172e44f3-b6f2-4ae8-965a-2dd63dee5be7'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:50.499556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-172e44f3-b6f2-4ae8-965a-2dd63dee5be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be240932123f4f55902ed47cde118d75', 'request_id': 'req-172e44f3-b6f2-4ae8-965a-2dd63dee5be7'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:50.505151 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-172e44f3-b6f2-4ae8-965a-2dd63dee5be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be240932123f4f55902ed47cde118d75', 'request_id': 'req-172e44f3-b6f2-4ae8-965a-2dd63dee5be7'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:50.517196 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-172e44f3-b6f2-4ae8-965a-2dd63dee5be7 admin admin] The token cache is being invalidate because project be240932123f4f55902ed47cde118d75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:42:50.517485 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-172e44f3-b6f2-4ae8-965a-2dd63dee5be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:50.518100 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-172e44f3-b6f2-4ae8-965a-2dd63dee5be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:50.519598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1257/2492] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:42:50 2022] DELETE /identity/v3/projects/be240932123f4f55902ed47cde118d75 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:50.523545 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856c97f-9207-4d4d-be79-0a94499d2f0c service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:50.533275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856c97f-9207-4d4d-be79-0a94499d2f0c service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:50.588503 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737e9cd-9b65-4fab-bf01-e2f9437b630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:50.589124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737e9cd-9b65-4fab-bf01-e2f9437b630d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:50.589411 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737e9cd-9b65-4fab-bf01-e2f9437b630d admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:50.589667 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737e9cd-9b65-4fab-bf01-e2f9437b630d admin admin] PATH_INFO: `/v3/users/371ff505a8fb41f5901652061adbf7f1` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:50.590769 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737e9cd-9b65-4fab-bf01-e2f9437b630d admin admin] RBAC: Authorizing `identity:delete_user(user_id=371ff505a8fb41f5901652061adbf7f1)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:50.592863 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737e9cd-9b65-4fab-bf01-e2f9437b630d admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:50.638396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0737e9cd-9b65-4fab-bf01-e2f9437b630d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '371ff505a8fb41f5901652061adbf7f1'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:50.639079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0737e9cd-9b65-4fab-bf01-e2f9437b630d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '371ff505a8fb41f5901652061adbf7f1'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:50.639696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0737e9cd-9b65-4fab-bf01-e2f9437b630d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '371ff505a8fb41f5901652061adbf7f1'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:50.651458 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0737e9cd-9b65-4fab-bf01-e2f9437b630d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '371ff505a8fb41f5901652061adbf7f1'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:50.658409 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0737e9cd-9b65-4fab-bf01-e2f9437b630d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '371ff505a8fb41f5901652061adbf7f1'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:50.671439 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1236/2493] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:42:50 2022] DELETE /identity/v3/users/371ff505a8fb41f5901652061adbf7f1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:50.939982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e44f3-b6f2-4ae8-965a-2dd63dee5be7 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:50.941639 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-172e44f3-b6f2-4ae8-965a-2dd63dee5be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:50.957120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e44f3-b6f2-4ae8-965a-2dd63dee5be7 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:51.015123 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191ea4a-f34b-4850-9cfa-d3511e1fd2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:51.015905 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191ea4a-f34b-4850-9cfa-d3511e1fd2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:51.016005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191ea4a-f34b-4850-9cfa-d3511e1fd2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:51.016193 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191ea4a-f34b-4850-9cfa-d3511e1fd2ef admin admin] PATH_INFO: `/v3/projects/76b310476e9b480193a35fee4bfccc44` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:51.017341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191ea4a-f34b-4850-9cfa-d3511e1fd2ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b310476e9b480193a35fee4bfccc44)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:51.019324 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191ea4a-f34b-4850-9cfa-d3511e1fd2ef admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:51.064692 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-5191ea4a-f34b-4850-9cfa-d3511e1fd2ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b310476e9b480193a35fee4bfccc44', 'request_id': 'req-5191ea4a-f34b-4850-9cfa-d3511e1fd2ef'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:51.070729 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-5191ea4a-f34b-4850-9cfa-d3511e1fd2ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b310476e9b480193a35fee4bfccc44', 'request_id': 'req-5191ea4a-f34b-4850-9cfa-d3511e1fd2ef'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:51.076354 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-5191ea4a-f34b-4850-9cfa-d3511e1fd2ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b310476e9b480193a35fee4bfccc44', 'request_id': 'req-5191ea4a-f34b-4850-9cfa-d3511e1fd2ef'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:51.085686 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:51.090722 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-5191ea4a-f34b-4850-9cfa-d3511e1fd2ef admin admin] The token cache is being invalidate because project 76b310476e9b480193a35fee4bfccc44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:42:51.091280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-5191ea4a-f34b-4850-9cfa-d3511e1fd2ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:51.092429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-5191ea4a-f34b-4850-9cfa-d3511e1fd2ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:51.094240 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1258/2494] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:42:50 2022] DELETE /identity/v3/projects/76b310476e9b480193a35fee4bfccc44 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:51.099108 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a27930-6c77-46b5-811c-fedb72829b54 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:51.099623 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a27930-6c77-46b5-811c-fedb72829b54 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:51.099718 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a27930-6c77-46b5-811c-fedb72829b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:51.120452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-80a27930-6c77-46b5-811c-fedb72829b54 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:51.121649 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-80a27930-6c77-46b5-811c-fedb72829b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:51.151724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:51.183333 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1237/2495] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:51.193440 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dae41e-c5fc-4351-8557-6c2406df2e17 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:51.193881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dae41e-c5fc-4351-8557-6c2406df2e17 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:51.194249 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dae41e-c5fc-4351-8557-6c2406df2e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:51.218611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-c0dae41e-c5fc-4351-8557-6c2406df2e17 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:51.219925 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c0dae41e-c5fc-4351-8557-6c2406df2e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:51.227918 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1259/2496] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:51.232395 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a27930-6c77-46b5-811c-fedb72829b54 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:51.242807 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a27930-6c77-46b5-811c-fedb72829b54 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:51.247414 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54a745-7c23-42ab-87dc-b5cbc49f79f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:51.248008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54a745-7c23-42ab-87dc-b5cbc49f79f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:51.248290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54a745-7c23-42ab-87dc-b5cbc49f79f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:51.249204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54a745-7c23-42ab-87dc-b5cbc49f79f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:51.249938 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54a745-7c23-42ab-87dc-b5cbc49f79f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:42:51.250243 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54a745-7c23-42ab-87dc-b5cbc49f79f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:51.251853 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54a745-7c23-42ab-87dc-b5cbc49f79f2 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:51.263143 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1238/2497] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:42:51.267669 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dae41e-c5fc-4351-8557-6c2406df2e17 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:51.276795 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dae41e-c5fc-4351-8557-6c2406df2e17 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:51.281636 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f8c24-aa2c-4b48-a557-7bd2f146aac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:51.282205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f8c24-aa2c-4b48-a557-7bd2f146aac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:51.282488 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f8c24-aa2c-4b48-a557-7bd2f146aac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:51.282760 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f8c24-aa2c-4b48-a557-7bd2f146aac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:51.283424 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f8c24-aa2c-4b48-a557-7bd2f146aac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:51.285303 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f8c24-aa2c-4b48-a557-7bd2f146aac1 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:51.312699 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1260/2498] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:42:51 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:42:51.316825 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54a745-7c23-42ab-87dc-b5cbc49f79f2 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:51.326655 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54a745-7c23-42ab-87dc-b5cbc49f79f2 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:51.386792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223f6b4-63a7-463f-8071-9e1c1e8ee12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:51.387422 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223f6b4-63a7-463f-8071-9e1c1e8ee12f admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:51.387702 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223f6b4-63a7-463f-8071-9e1c1e8ee12f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:51.387973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223f6b4-63a7-463f-8071-9e1c1e8ee12f admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:51.388602 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223f6b4-63a7-463f-8071-9e1c1e8ee12f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:51.390529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223f6b4-63a7-463f-8071-9e1c1e8ee12f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:51.412700 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1239/2499] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:42:51 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:42:51.416935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f8c24-aa2c-4b48-a557-7bd2f146aac1 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:51.427886 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f8c24-aa2c-4b48-a557-7bd2f146aac1 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:51.432550 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbed4a0-13b0-4ebe-a2a3-14f095617b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:51.433146 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbed4a0-13b0-4ebe-a2a3-14f095617b56 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:51.433427 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbed4a0-13b0-4ebe-a2a3-14f095617b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:51.433698 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbed4a0-13b0-4ebe-a2a3-14f095617b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:51.434339 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbed4a0-13b0-4ebe-a2a3-14f095617b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:51.435953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbed4a0-13b0-4ebe-a2a3-14f095617b56 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:51.447100 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1261/2500] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:42:51.451042 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223f6b4-63a7-463f-8071-9e1c1e8ee12f admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:51.461418 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223f6b4-63a7-463f-8071-9e1c1e8ee12f admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:51.465990 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802ea8b-bdd2-4373-9b0a-22b41fe2e4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:51.466578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802ea8b-bdd2-4373-9b0a-22b41fe2e4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:51.466880 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802ea8b-bdd2-4373-9b0a-22b41fe2e4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:51.467159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802ea8b-bdd2-4373-9b0a-22b41fe2e4d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:51.468090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802ea8b-bdd2-4373-9b0a-22b41fe2e4d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:51.469678 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802ea8b-bdd2-4373-9b0a-22b41fe2e4d8 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:51.480027 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1240/2501] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:42:51.484624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbed4a0-13b0-4ebe-a2a3-14f095617b56 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:51.494393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbed4a0-13b0-4ebe-a2a3-14f095617b56 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:51.499616 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06a8ca-6018-4b7e-8b72-d5418383bf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:51.500240 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06a8ca-6018-4b7e-8b72-d5418383bf82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:51.500515 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06a8ca-6018-4b7e-8b72-d5418383bf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:51.500786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06a8ca-6018-4b7e-8b72-d5418383bf82 admin admin] PATH_INFO: `/v3/projects/3221e59c83914066aa1dfd205a89f554/users/1bb6d69fb12f44118eea8b42e7e4b2c6/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:51.515264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06a8ca-6018-4b7e-8b72-d5418383bf82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3221e59c83914066aa1dfd205a89f554, user_id=1bb6d69fb12f44118eea8b42e7e4b2c6, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:51.517947 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06a8ca-6018-4b7e-8b72-d5418383bf82 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:51.530502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1262/2502] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:42:51 2022] PUT /identity/v3/projects/3221e59c83914066aa1dfd205a89f554/users/1bb6d69fb12f44118eea8b42e7e4b2c6/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:42:51.540898 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7fb40-6f70-463a-b9cd-f00841368fe6 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:51.541179 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7fb40-6f70-463a-b9cd-f00841368fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:51.541475 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7fb40-6f70-463a-b9cd-f00841368fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:51.569564 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-c8d7fb40-6f70-463a-b9cd-f00841368fe6 None None] MFA Rules not processed for user `1bb6d69fb12f44118eea8b42e7e4b2c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:51.570778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c8d7fb40-6f70-463a-b9cd-f00841368fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:51.634815 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1241/2503] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:51.640466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06a8ca-6018-4b7e-8b72-d5418383bf82 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:51.700782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06a8ca-6018-4b7e-8b72-d5418383bf82 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:51.706350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca0daa-62a9-41ab-9ba8-2df7c8c09a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:51.706980 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca0daa-62a9-41ab-9ba8-2df7c8c09a2f admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:51.707260 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca0daa-62a9-41ab-9ba8-2df7c8c09a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:51.707533 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca0daa-62a9-41ab-9ba8-2df7c8c09a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:51.708163 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca0daa-62a9-41ab-9ba8-2df7c8c09a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:51.710034 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca0daa-62a9-41ab-9ba8-2df7c8c09a2f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:51.740003 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1263/2504] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:42:51 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:42:51.744065 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7fb40-6f70-463a-b9cd-f00841368fe6 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:51.755287 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7fb40-6f70-463a-b9cd-f00841368fe6 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:51.780877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:51.810365 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55522848-18a1-42b1-9d0c-99db043a040a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:51.811548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55522848-18a1-42b1-9d0c-99db043a040a admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:51.811863 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55522848-18a1-42b1-9d0c-99db043a040a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:51.812143 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55522848-18a1-42b1-9d0c-99db043a040a admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:51.812750 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55522848-18a1-42b1-9d0c-99db043a040a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:51.814638 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55522848-18a1-42b1-9d0c-99db043a040a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:51.835177 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1242/2505] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:42:51 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:42:51.839144 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca0daa-62a9-41ab-9ba8-2df7c8c09a2f admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:51.849466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca0daa-62a9-41ab-9ba8-2df7c8c09a2f admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:51.854013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac8c8c-fb69-4dab-b7e7-4fd7673f6bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:51.854599 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac8c8c-fb69-4dab-b7e7-4fd7673f6bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:51.854907 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac8c8c-fb69-4dab-b7e7-4fd7673f6bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:51.855181 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac8c8c-fb69-4dab-b7e7-4fd7673f6bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:51.855809 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac8c8c-fb69-4dab-b7e7-4fd7673f6bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:51.857373 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac8c8c-fb69-4dab-b7e7-4fd7673f6bcc admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:51.867762 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1264/2506] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:42:51.871928 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55522848-18a1-42b1-9d0c-99db043a040a admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:51.882688 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55522848-18a1-42b1-9d0c-99db043a040a admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:51.887354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79e370-a2d8-41f2-bb1f-ff6d950ee404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:51.888002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79e370-a2d8-41f2-bb1f-ff6d950ee404 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:51.888283 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79e370-a2d8-41f2-bb1f-ff6d950ee404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:51.888565 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79e370-a2d8-41f2-bb1f-ff6d950ee404 admin admin] PATH_INFO: `/v3/projects/3a261865b9ca43d4bbb32c1f95d1e536/users/c47b30a1234a4b0ba71bffd37fa7f456/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:51.903768 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79e370-a2d8-41f2-bb1f-ff6d950ee404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a261865b9ca43d4bbb32c1f95d1e536, user_id=c47b30a1234a4b0ba71bffd37fa7f456, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:51.906410 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79e370-a2d8-41f2-bb1f-ff6d950ee404 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:51.918770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1243/2507] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:42:51 2022] PUT /identity/v3/projects/3a261865b9ca43d4bbb32c1f95d1e536/users/c47b30a1234a4b0ba71bffd37fa7f456/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:51.922614 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac8c8c-fb69-4dab-b7e7-4fd7673f6bcc admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:51.932463 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac8c8c-fb69-4dab-b7e7-4fd7673f6bcc admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:51.988183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243aadce-32fe-4204-b392-786d98f8d2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:51.988782 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aadce-32fe-4204-b392-786d98f8d2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:51.989062 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aadce-32fe-4204-b392-786d98f8d2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:51.989337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aadce-32fe-4204-b392-786d98f8d2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:51.989998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243aadce-32fe-4204-b392-786d98f8d2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:51.991657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243aadce-32fe-4204-b392-786d98f8d2e4 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:52.001186 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1265/2508] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:42:52.005282 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79e370-a2d8-41f2-bb1f-ff6d950ee404 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:52.016066 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79e370-a2d8-41f2-bb1f-ff6d950ee404 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:52.020584 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3781b09-3c6e-41c3-948f-eabe5a20336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:52.021221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3781b09-3c6e-41c3-948f-eabe5a20336e admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:52.021498 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3781b09-3c6e-41c3-948f-eabe5a20336e admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:52.021768 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3781b09-3c6e-41c3-948f-eabe5a20336e admin admin] PATH_INFO: `/v3/projects/3a261865b9ca43d4bbb32c1f95d1e536/users/c47b30a1234a4b0ba71bffd37fa7f456/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:52.023676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3781b09-3c6e-41c3-948f-eabe5a20336e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a261865b9ca43d4bbb32c1f95d1e536, user_id=c47b30a1234a4b0ba71bffd37fa7f456, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:52.026274 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3781b09-3c6e-41c3-948f-eabe5a20336e admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:52.037363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1244/2509] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:42:52 2022] PUT /identity/v3/projects/3a261865b9ca43d4bbb32c1f95d1e536/users/c47b30a1234a4b0ba71bffd37fa7f456/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:52.047641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55474f63-6420-4abe-9a41-22daf65cc7bd None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:52.048116 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55474f63-6420-4abe-9a41-22daf65cc7bd None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:52.048209 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55474f63-6420-4abe-9a41-22daf65cc7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:52.056193 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:52.076080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-55474f63-6420-4abe-9a41-22daf65cc7bd None None] MFA Rules not processed for user `c47b30a1234a4b0ba71bffd37fa7f456`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:52.078126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-55474f63-6420-4abe-9a41-22daf65cc7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:52.144809 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1266/2510] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:52.156968 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3781b09-3c6e-41c3-948f-eabe5a20336e admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:52.158768 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c3781b09-3c6e-41c3-948f-eabe5a20336e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:52.216845 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3781b09-3c6e-41c3-948f-eabe5a20336e admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:52.221256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf700e-5bdd-43a6-9471-24d4135d06e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:52.221852 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf700e-5bdd-43a6-9471-24d4135d06e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:52.222129 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf700e-5bdd-43a6-9471-24d4135d06e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:52.222401 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf700e-5bdd-43a6-9471-24d4135d06e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:52.231260 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf700e-5bdd-43a6-9471-24d4135d06e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:52.232702 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf700e-5bdd-43a6-9471-24d4135d06e9 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:52.242045 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1245/2511] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:42:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:42:53.573492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55474f63-6420-4abe-9a41-22daf65cc7bd None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:53.635048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55474f63-6420-4abe-9a41-22daf65cc7bd None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:53.639638 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382b8ec-7a86-4f31-8d2a-9cc1930dbfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:53.640234 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382b8ec-7a86-4f31-8d2a-9cc1930dbfba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:53.640513 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382b8ec-7a86-4f31-8d2a-9cc1930dbfba admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:53.640787 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382b8ec-7a86-4f31-8d2a-9cc1930dbfba admin admin] PATH_INFO: `/v3/users/1bb6d69fb12f44118eea8b42e7e4b2c6` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:53.642167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382b8ec-7a86-4f31-8d2a-9cc1930dbfba admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb6d69fb12f44118eea8b42e7e4b2c6)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:53.644097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382b8ec-7a86-4f31-8d2a-9cc1930dbfba admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:53.690970 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c382b8ec-7a86-4f31-8d2a-9cc1930dbfba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb6d69fb12f44118eea8b42e7e4b2c6'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:53.691609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c382b8ec-7a86-4f31-8d2a-9cc1930dbfba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb6d69fb12f44118eea8b42e7e4b2c6'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:53.692236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c382b8ec-7a86-4f31-8d2a-9cc1930dbfba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb6d69fb12f44118eea8b42e7e4b2c6'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:53.704828 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c382b8ec-7a86-4f31-8d2a-9cc1930dbfba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb6d69fb12f44118eea8b42e7e4b2c6'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:53.711676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c382b8ec-7a86-4f31-8d2a-9cc1930dbfba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb6d69fb12f44118eea8b42e7e4b2c6'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:53.724019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1267/2512] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:42:53 2022] DELETE /identity/v3/users/1bb6d69fb12f44118eea8b42e7e4b2c6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:53.728609 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e2197-104c-4751-b5a0-380be3525ad5 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:53.729086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e2197-104c-4751-b5a0-380be3525ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:53.729181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e2197-104c-4751-b5a0-380be3525ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:53.747995 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-b63e2197-104c-4751-b5a0-380be3525ad5 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:53.749965 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b63e2197-104c-4751-b5a0-380be3525ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:53.806332 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1246/2513] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:53.817004 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382b8ec-7a86-4f31-8d2a-9cc1930dbfba admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:53.818505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c382b8ec-7a86-4f31-8d2a-9cc1930dbfba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:53.830073 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:53.879048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382b8ec-7a86-4f31-8d2a-9cc1930dbfba admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:53.882632 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4733f-f67d-46b6-b74c-a0b4acc1d817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:53.883262 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4733f-f67d-46b6-b74c-a0b4acc1d817 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:53.883539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4733f-f67d-46b6-b74c-a0b4acc1d817 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:53.883813 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4733f-f67d-46b6-b74c-a0b4acc1d817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:53.892632 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4733f-f67d-46b6-b74c-a0b4acc1d817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:53.894080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4733f-f67d-46b6-b74c-a0b4acc1d817 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:53.903424 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1268/2514] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:42:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:42:54.166416 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e2197-104c-4751-b5a0-380be3525ad5 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:54.167991 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b63e2197-104c-4751-b5a0-380be3525ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:54.183020 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e2197-104c-4751-b5a0-380be3525ad5 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:54.187815 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63882ce-d41c-4d4c-9232-972ca703cd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:54.188449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63882ce-d41c-4d4c-9232-972ca703cd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:54.188760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63882ce-d41c-4d4c-9232-972ca703cd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:54.189035 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63882ce-d41c-4d4c-9232-972ca703cd02 admin admin] PATH_INFO: `/v3/projects/3221e59c83914066aa1dfd205a89f554` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:54.190663 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63882ce-d41c-4d4c-9232-972ca703cd02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3221e59c83914066aa1dfd205a89f554)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:54.192828 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63882ce-d41c-4d4c-9232-972ca703cd02 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:54.218277 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:54.242780 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d63882ce-d41c-4d4c-9232-972ca703cd02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3221e59c83914066aa1dfd205a89f554', 'request_id': 'req-d63882ce-d41c-4d4c-9232-972ca703cd02'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:54.248185 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d63882ce-d41c-4d4c-9232-972ca703cd02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3221e59c83914066aa1dfd205a89f554', 'request_id': 'req-d63882ce-d41c-4d4c-9232-972ca703cd02'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:54.254268 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d63882ce-d41c-4d4c-9232-972ca703cd02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3221e59c83914066aa1dfd205a89f554', 'request_id': 'req-d63882ce-d41c-4d4c-9232-972ca703cd02'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:54.266592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d63882ce-d41c-4d4c-9232-972ca703cd02 admin admin] The token cache is being invalidate because project 3221e59c83914066aa1dfd205a89f554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:42:54.266938 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d63882ce-d41c-4d4c-9232-972ca703cd02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:54.267553 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d63882ce-d41c-4d4c-9232-972ca703cd02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:54.269012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1247/2515] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:42:54 2022] DELETE /identity/v3/projects/3221e59c83914066aa1dfd205a89f554 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:54.272974 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4733f-f67d-46b6-b74c-a0b4acc1d817 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:54.283044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4733f-f67d-46b6-b74c-a0b4acc1d817 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:54.339691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7a2e8-abdc-4b26-9683-c086891b7408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:54.340558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7a2e8-abdc-4b26-9683-c086891b7408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:54.340998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7a2e8-abdc-4b26-9683-c086891b7408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:54.341279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7a2e8-abdc-4b26-9683-c086891b7408 admin admin] PATH_INFO: `/v3/users/c47b30a1234a4b0ba71bffd37fa7f456` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:54.343094 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7a2e8-abdc-4b26-9683-c086891b7408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47b30a1234a4b0ba71bffd37fa7f456)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:54.344987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7a2e8-abdc-4b26-9683-c086891b7408 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:54.391758 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-dee7a2e8-abdc-4b26-9683-c086891b7408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47b30a1234a4b0ba71bffd37fa7f456'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:54.392415 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-dee7a2e8-abdc-4b26-9683-c086891b7408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47b30a1234a4b0ba71bffd37fa7f456'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:54.393025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-dee7a2e8-abdc-4b26-9683-c086891b7408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47b30a1234a4b0ba71bffd37fa7f456'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:54.406318 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-dee7a2e8-abdc-4b26-9683-c086891b7408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47b30a1234a4b0ba71bffd37fa7f456'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:54.413444 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-dee7a2e8-abdc-4b26-9683-c086891b7408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47b30a1234a4b0ba71bffd37fa7f456'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:54.425640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1269/2516] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:42:54 2022] DELETE /identity/v3/users/c47b30a1234a4b0ba71bffd37fa7f456 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:54.699731 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63882ce-d41c-4d4c-9232-972ca703cd02 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:54.701434 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d63882ce-d41c-4d4c-9232-972ca703cd02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:54.717444 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63882ce-d41c-4d4c-9232-972ca703cd02 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:54.775006 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5afeb-fa6e-4b16-b291-336a6a1cde6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:54.775638 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5afeb-fa6e-4b16-b291-336a6a1cde6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:54.775943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5afeb-fa6e-4b16-b291-336a6a1cde6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:54.776220 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5afeb-fa6e-4b16-b291-336a6a1cde6a admin admin] PATH_INFO: `/v3/projects/3a261865b9ca43d4bbb32c1f95d1e536` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:54.777332 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5afeb-fa6e-4b16-b291-336a6a1cde6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a261865b9ca43d4bbb32c1f95d1e536)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:54.779292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5afeb-fa6e-4b16-b291-336a6a1cde6a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:54.825118 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9ed5afeb-fa6e-4b16-b291-336a6a1cde6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a261865b9ca43d4bbb32c1f95d1e536', 'request_id': 'req-9ed5afeb-fa6e-4b16-b291-336a6a1cde6a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:54.831577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9ed5afeb-fa6e-4b16-b291-336a6a1cde6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a261865b9ca43d4bbb32c1f95d1e536', 'request_id': 'req-9ed5afeb-fa6e-4b16-b291-336a6a1cde6a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:54.837542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9ed5afeb-fa6e-4b16-b291-336a6a1cde6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a261865b9ca43d4bbb32c1f95d1e536', 'request_id': 'req-9ed5afeb-fa6e-4b16-b291-336a6a1cde6a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:54.850356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9ed5afeb-fa6e-4b16-b291-336a6a1cde6a admin admin] The token cache is being invalidate because project 3a261865b9ca43d4bbb32c1f95d1e536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:42:54.850801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9ed5afeb-fa6e-4b16-b291-336a6a1cde6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:54.851473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-9ed5afeb-fa6e-4b16-b291-336a6a1cde6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:42:54.853018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1248/2517] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:42:54 2022] DELETE /identity/v3/projects/3a261865b9ca43d4bbb32c1f95d1e536 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:54.858018 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d58575-aa5d-42e7-8c04-d6ea5025f2d0 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:54.858480 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d58575-aa5d-42e7-8c04-d6ea5025f2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:54.858576 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d58575-aa5d-42e7-8c04-d6ea5025f2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:54.878912 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-35d58575-aa5d-42e7-8c04-d6ea5025f2d0 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:54.880083 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-35d58575-aa5d-42e7-8c04-d6ea5025f2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:54.906031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:54.941128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1270/2518] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:54.948998 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eda90-4f1a-4b9d-958b-324d2147413b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:54.949278 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eda90-4f1a-4b9d-958b-324d2147413b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:54.949551 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eda90-4f1a-4b9d-958b-324d2147413b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:54.970171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-680eda90-4f1a-4b9d-958b-324d2147413b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:54.971431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-680eda90-4f1a-4b9d-958b-324d2147413b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:54.979275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1249/2519] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:54.984853 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d58575-aa5d-42e7-8c04-d6ea5025f2d0 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:54.994602 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d58575-aa5d-42e7-8c04-d6ea5025f2d0 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:54.999834 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b55e1-aa1c-46d0-86d1-15110e4f9862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:55.000447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b55e1-aa1c-46d0-86d1-15110e4f9862 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:55.000726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b55e1-aa1c-46d0-86d1-15110e4f9862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:55.000996 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b55e1-aa1c-46d0-86d1-15110e4f9862 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:55.001654 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b55e1-aa1c-46d0-86d1-15110e4f9862 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:42:55.001957 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b55e1-aa1c-46d0-86d1-15110e4f9862 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:55.003574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b55e1-aa1c-46d0-86d1-15110e4f9862 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:55.014875 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1271/2520] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:42:55.019002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680eda90-4f1a-4b9d-958b-324d2147413b None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:55.028161 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680eda90-4f1a-4b9d-958b-324d2147413b None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:55.033092 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7f4f9-6530-4e3a-8e9d-afa795055c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:55.033685 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7f4f9-6530-4e3a-8e9d-afa795055c9a admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:55.033990 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7f4f9-6530-4e3a-8e9d-afa795055c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:55.034260 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7f4f9-6530-4e3a-8e9d-afa795055c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:55.034922 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7f4f9-6530-4e3a-8e9d-afa795055c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:55.036798 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7f4f9-6530-4e3a-8e9d-afa795055c9a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:55.064769 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1250/2521] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:42:55 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:42:55.068893 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b55e1-aa1c-46d0-86d1-15110e4f9862 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:55.079361 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b55e1-aa1c-46d0-86d1-15110e4f9862 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:55.135775 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d03e8-4f79-4994-a185-6974c1f1d962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:55.136293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d03e8-4f79-4994-a185-6974c1f1d962 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:55.136576 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d03e8-4f79-4994-a185-6974c1f1d962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:55.136852 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d03e8-4f79-4994-a185-6974c1f1d962 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:55.137488 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d03e8-4f79-4994-a185-6974c1f1d962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:55.139792 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d03e8-4f79-4994-a185-6974c1f1d962 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:55.160653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1272/2522] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:42:55 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:42:55.164764 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7f4f9-6530-4e3a-8e9d-afa795055c9a admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:55.175510 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7f4f9-6530-4e3a-8e9d-afa795055c9a admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:55.180244 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4e904-46cd-420c-b79e-6e1a14974a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:55.180837 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e904-46cd-420c-b79e-6e1a14974a4c admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:55.181117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e904-46cd-420c-b79e-6e1a14974a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:55.181393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e904-46cd-420c-b79e-6e1a14974a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:55.182028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4e904-46cd-420c-b79e-6e1a14974a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:55.183686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4e904-46cd-420c-b79e-6e1a14974a4c admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:55.185700 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:55.195619 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1251/2523] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:42:55.199585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d03e8-4f79-4994-a185-6974c1f1d962 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:55.209972 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d03e8-4f79-4994-a185-6974c1f1d962 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:55.214645 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b978920-beb6-4c5f-b8a3-4aeb67883d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:55.215270 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b978920-beb6-4c5f-b8a3-4aeb67883d84 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:55.215550 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b978920-beb6-4c5f-b8a3-4aeb67883d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:55.215825 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b978920-beb6-4c5f-b8a3-4aeb67883d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:55.216464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b978920-beb6-4c5f-b8a3-4aeb67883d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:55.218039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b978920-beb6-4c5f-b8a3-4aeb67883d84 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:55.228437 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1273/2524] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:42:55.232417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4e904-46cd-420c-b79e-6e1a14974a4c admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:55.242736 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4e904-46cd-420c-b79e-6e1a14974a4c admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:55.247665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b603dca-a6f7-49f1-8149-e22ced20ddd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:55.248312 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b603dca-a6f7-49f1-8149-e22ced20ddd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:55.248847 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b603dca-a6f7-49f1-8149-e22ced20ddd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:55.249356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b603dca-a6f7-49f1-8149-e22ced20ddd0 admin admin] PATH_INFO: `/v3/projects/0223c54f6a2c481e9c5fa8d3e8d56dee/users/89efa22526e04a31863a26b594f384ed/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:55.268677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b603dca-a6f7-49f1-8149-e22ced20ddd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0223c54f6a2c481e9c5fa8d3e8d56dee, user_id=89efa22526e04a31863a26b594f384ed, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:55.271383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b603dca-a6f7-49f1-8149-e22ced20ddd0 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:55.285121 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1252/2525] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:42:55 2022] PUT /identity/v3/projects/0223c54f6a2c481e9c5fa8d3e8d56dee/users/89efa22526e04a31863a26b594f384ed/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:55.295314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725ca07-a624-4317-8921-47ae5baf5882 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:55.295895 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725ca07-a624-4317-8921-47ae5baf5882 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:55.296175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725ca07-a624-4317-8921-47ae5baf5882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:55.323473 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-1725ca07-a624-4317-8921-47ae5baf5882 None None] MFA Rules not processed for user `89efa22526e04a31863a26b594f384ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:55.324674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-1725ca07-a624-4317-8921-47ae5baf5882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:55.388778 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1274/2526] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:55 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:55.393826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b603dca-a6f7-49f1-8149-e22ced20ddd0 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:55.456611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b603dca-a6f7-49f1-8149-e22ced20ddd0 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:55.461319 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4a087-8e1e-4ee6-8930-b18639cd1223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:55.461923 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4a087-8e1e-4ee6-8930-b18639cd1223 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:55.462204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4a087-8e1e-4ee6-8930-b18639cd1223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:55.462481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4a087-8e1e-4ee6-8930-b18639cd1223 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:55.463129 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4a087-8e1e-4ee6-8930-b18639cd1223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:55.465030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4a087-8e1e-4ee6-8930-b18639cd1223 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:55.490992 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1253/2527] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:42:55 2022] POST /identity/v3/projects => generated 399 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:42:55.494981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725ca07-a624-4317-8921-47ae5baf5882 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:55.506079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725ca07-a624-4317-8921-47ae5baf5882 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:55.530134 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:55.562022 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ebe32-258e-43de-8526-509f4a70f287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:55.562621 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ebe32-258e-43de-8526-509f4a70f287 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:55.562933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ebe32-258e-43de-8526-509f4a70f287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:55.563205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ebe32-258e-43de-8526-509f4a70f287 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:55.563832 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ebe32-258e-43de-8526-509f4a70f287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:55.565730 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ebe32-258e-43de-8526-509f4a70f287 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:55.588290 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1275/2528] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:42:55 2022] POST /identity/v3/users => generated 306 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:42:55.592380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4a087-8e1e-4ee6-8930-b18639cd1223 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:55.603028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4a087-8e1e-4ee6-8930-b18639cd1223 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:55.607616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f245a-6bf1-47b0-9089-45589e596077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:55.608790 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f245a-6bf1-47b0-9089-45589e596077 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:55.609078 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f245a-6bf1-47b0-9089-45589e596077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:55.609453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f245a-6bf1-47b0-9089-45589e596077 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:55.610101 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f245a-6bf1-47b0-9089-45589e596077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:55.611727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f245a-6bf1-47b0-9089-45589e596077 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:55.622148 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1254/2529] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:42:55.626785 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ebe32-258e-43de-8526-509f4a70f287 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:55.636726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ebe32-258e-43de-8526-509f4a70f287 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:55.642098 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f243c-e780-491d-8507-b144b311c070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:55.642675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f243c-e780-491d-8507-b144b311c070 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:55.642983 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f243c-e780-491d-8507-b144b311c070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:55.643258 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f243c-e780-491d-8507-b144b311c070 admin admin] PATH_INFO: `/v3/projects/8a4bc5b2543946d99a85db647d30f10e/users/751788ad0bad4e64918bb513d64f6ae6/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:55.657954 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f243c-e780-491d-8507-b144b311c070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4bc5b2543946d99a85db647d30f10e, user_id=751788ad0bad4e64918bb513d64f6ae6, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:55.660610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f243c-e780-491d-8507-b144b311c070 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:55.673370 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1276/2530] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:42:55 2022] PUT /identity/v3/projects/8a4bc5b2543946d99a85db647d30f10e/users/751788ad0bad4e64918bb513d64f6ae6/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:55.677365 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f245a-6bf1-47b0-9089-45589e596077 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:55.688168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f245a-6bf1-47b0-9089-45589e596077 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:55.743595 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e000fe-6868-4bb1-a86e-863e2f57ab1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:55.744187 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e000fe-6868-4bb1-a86e-863e2f57ab1b admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:55.744464 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e000fe-6868-4bb1-a86e-863e2f57ab1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:55.744737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e000fe-6868-4bb1-a86e-863e2f57ab1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:55.745361 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e000fe-6868-4bb1-a86e-863e2f57ab1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:55.746979 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e000fe-6868-4bb1-a86e-863e2f57ab1b admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:55.757214 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1255/2531] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:42:55.761494 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f243c-e780-491d-8507-b144b311c070 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:55.772069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f243c-e780-491d-8507-b144b311c070 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:55.776720 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26110255-12cd-4ec4-842e-64a0fafa0750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:55.777387 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26110255-12cd-4ec4-842e-64a0fafa0750 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:55.777669 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26110255-12cd-4ec4-842e-64a0fafa0750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:55.777945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26110255-12cd-4ec4-842e-64a0fafa0750 admin admin] PATH_INFO: `/v3/projects/8a4bc5b2543946d99a85db647d30f10e/users/751788ad0bad4e64918bb513d64f6ae6/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:55.780002 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26110255-12cd-4ec4-842e-64a0fafa0750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4bc5b2543946d99a85db647d30f10e, user_id=751788ad0bad4e64918bb513d64f6ae6, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:55.782616 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26110255-12cd-4ec4-842e-64a0fafa0750 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:55.792670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1277/2532] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:42:55 2022] PUT /identity/v3/projects/8a4bc5b2543946d99a85db647d30f10e/users/751788ad0bad4e64918bb513d64f6ae6/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:42:55.804034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3994ba0-f6ce-4a8c-986a-9762c2083fcf None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:55.804557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3994ba0-f6ce-4a8c-986a-9762c2083fcf None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:55.804557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3994ba0-f6ce-4a8c-986a-9762c2083fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:55.833191 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-d3994ba0-f6ce-4a8c-986a-9762c2083fcf None None] MFA Rules not processed for user `751788ad0bad4e64918bb513d64f6ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:42:55.834408 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d3994ba0-f6ce-4a8c-986a-9762c2083fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:55.866233 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:55.902536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1256/2533] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:42:55 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:42:55.913146 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26110255-12cd-4ec4-842e-64a0fafa0750 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:55.914888 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-26110255-12cd-4ec4-842e-64a0fafa0750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:42:55.973059 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26110255-12cd-4ec4-842e-64a0fafa0750 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:55.976714 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebf340-6477-4017-a91e-aa13befb6057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:55.977301 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebf340-6477-4017-a91e-aa13befb6057 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:55.977574 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebf340-6477-4017-a91e-aa13befb6057 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:55.977842 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebf340-6477-4017-a91e-aa13befb6057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:55.987148 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebf340-6477-4017-a91e-aa13befb6057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:55.988547 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebf340-6477-4017-a91e-aa13befb6057 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:55.997680 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1278/2534] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:42:55 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:42:56.074625 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3994ba0-f6ce-4a8c-986a-9762c2083fcf None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:42:56.084445 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3994ba0-f6ce-4a8c-986a-9762c2083fcf None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:42:56.088084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293d447-3c18-4310-bbf3-0d92e5b3320a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:42:56.088676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293d447-3c18-4310-bbf3-0d92e5b3320a service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:42:56.088952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293d447-3c18-4310-bbf3-0d92e5b3320a service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:42:56.089224 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293d447-3c18-4310-bbf3-0d92e5b3320a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:42:56.145369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293d447-3c18-4310-bbf3-0d92e5b3320a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:42:56.146778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293d447-3c18-4310-bbf3-0d92e5b3320a service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:42:56.156045 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1257/2535] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:42:56 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:43:00.208433 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebf340-6477-4017-a91e-aa13befb6057 service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:00.269949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebf340-6477-4017-a91e-aa13befb6057 service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:00.274487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad30d3-3bd3-43bf-8a13-0c1f15772c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:00.275128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad30d3-3bd3-43bf-8a13-0c1f15772c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:00.275409 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad30d3-3bd3-43bf-8a13-0c1f15772c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:00.275681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad30d3-3bd3-43bf-8a13-0c1f15772c09 admin admin] PATH_INFO: `/v3/users/89efa22526e04a31863a26b594f384ed` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:00.276787 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad30d3-3bd3-43bf-8a13-0c1f15772c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89efa22526e04a31863a26b594f384ed)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:00.278693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad30d3-3bd3-43bf-8a13-0c1f15772c09 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:00.302465 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:00.328511 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-35ad30d3-3bd3-43bf-8a13-0c1f15772c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89efa22526e04a31863a26b594f384ed'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:00.329070 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-35ad30d3-3bd3-43bf-8a13-0c1f15772c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89efa22526e04a31863a26b594f384ed'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:00.329668 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-35ad30d3-3bd3-43bf-8a13-0c1f15772c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89efa22526e04a31863a26b594f384ed'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:00.341308 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-35ad30d3-3bd3-43bf-8a13-0c1f15772c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89efa22526e04a31863a26b594f384ed'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:00.348733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-35ad30d3-3bd3-43bf-8a13-0c1f15772c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89efa22526e04a31863a26b594f384ed'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:00.360856 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1279/2536] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:43:00 2022] DELETE /identity/v3/users/89efa22526e04a31863a26b594f384ed => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:00.365267 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6095b20-d32a-4b14-95f7-ef90c1db21ae None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:00.365728 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6095b20-d32a-4b14-95f7-ef90c1db21ae None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:00.365824 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6095b20-d32a-4b14-95f7-ef90c1db21ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:00.385746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-e6095b20-d32a-4b14-95f7-ef90c1db21ae None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:43:00.387613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e6095b20-d32a-4b14-95f7-ef90c1db21ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:00.446608 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1258/2537] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:43:00.457078 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad30d3-3bd3-43bf-8a13-0c1f15772c09 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:00.458456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-35ad30d3-3bd3-43bf-8a13-0c1f15772c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:00.635827 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad30d3-3bd3-43bf-8a13-0c1f15772c09 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:00.639903 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114dccc-718e-408f-9b28-cc069597490f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:00.640594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114dccc-718e-408f-9b28-cc069597490f service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:00.640875 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114dccc-718e-408f-9b28-cc069597490f service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:00.641148 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114dccc-718e-408f-9b28-cc069597490f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:00.650106 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114dccc-718e-408f-9b28-cc069597490f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:00.651541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114dccc-718e-408f-9b28-cc069597490f service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:00.660973 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1280/2538] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:43:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:43:00.918638 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6095b20-d32a-4b14-95f7-ef90c1db21ae None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:00.920097 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e6095b20-d32a-4b14-95f7-ef90c1db21ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:00.933868 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6095b20-d32a-4b14-95f7-ef90c1db21ae None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:00.938781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02e119-67ca-4bf5-bf0e-c037ae245caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:00.939658 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02e119-67ca-4bf5-bf0e-c037ae245caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:00.939959 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02e119-67ca-4bf5-bf0e-c037ae245caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:00.940262 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02e119-67ca-4bf5-bf0e-c037ae245caf admin admin] PATH_INFO: `/v3/projects/0223c54f6a2c481e9c5fa8d3e8d56dee` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:00.941390 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02e119-67ca-4bf5-bf0e-c037ae245caf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0223c54f6a2c481e9c5fa8d3e8d56dee)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:00.943515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02e119-67ca-4bf5-bf0e-c037ae245caf admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:00.989872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-2a02e119-67ca-4bf5-bf0e-c037ae245caf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0223c54f6a2c481e9c5fa8d3e8d56dee', 'request_id': 'req-2a02e119-67ca-4bf5-bf0e-c037ae245caf'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:00.995240 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-2a02e119-67ca-4bf5-bf0e-c037ae245caf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0223c54f6a2c481e9c5fa8d3e8d56dee', 'request_id': 'req-2a02e119-67ca-4bf5-bf0e-c037ae245caf'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:01.001219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-2a02e119-67ca-4bf5-bf0e-c037ae245caf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0223c54f6a2c481e9c5fa8d3e8d56dee', 'request_id': 'req-2a02e119-67ca-4bf5-bf0e-c037ae245caf'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:01.002820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:01.014752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-2a02e119-67ca-4bf5-bf0e-c037ae245caf admin admin] The token cache is being invalidate because project 0223c54f6a2c481e9c5fa8d3e8d56dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:43:01.015104 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-2a02e119-67ca-4bf5-bf0e-c037ae245caf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:01.015733 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-2a02e119-67ca-4bf5-bf0e-c037ae245caf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:01.017200 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1259/2539] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:43:00 2022] DELETE /identity/v3/projects/0223c54f6a2c481e9c5fa8d3e8d56dee => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:01.021173 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114dccc-718e-408f-9b28-cc069597490f service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:01.031129 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114dccc-718e-408f-9b28-cc069597490f service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:01.084385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7c0e4-8828-4137-b548-d5fd78d82aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:01.084994 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7c0e4-8828-4137-b548-d5fd78d82aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:01.085270 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7c0e4-8828-4137-b548-d5fd78d82aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:01.085541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7c0e4-8828-4137-b548-d5fd78d82aaa admin admin] PATH_INFO: `/v3/users/751788ad0bad4e64918bb513d64f6ae6` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:01.086649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7c0e4-8828-4137-b548-d5fd78d82aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=751788ad0bad4e64918bb513d64f6ae6)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:01.088558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7c0e4-8828-4137-b548-d5fd78d82aaa admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:01.131717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:01.133175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c7f7c0e4-8828-4137-b548-d5fd78d82aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '751788ad0bad4e64918bb513d64f6ae6'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:01.133973 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c7f7c0e4-8828-4137-b548-d5fd78d82aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '751788ad0bad4e64918bb513d64f6ae6'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:01.135101 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c7f7c0e4-8828-4137-b548-d5fd78d82aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '751788ad0bad4e64918bb513d64f6ae6'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:01.148499 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c7f7c0e4-8828-4137-b548-d5fd78d82aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '751788ad0bad4e64918bb513d64f6ae6'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:01.156031 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c7f7c0e4-8828-4137-b548-d5fd78d82aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '751788ad0bad4e64918bb513d64f6ae6'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:01.168380 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1281/2540] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:43:01 2022] DELETE /identity/v3/users/751788ad0bad4e64918bb513d64f6ae6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:01.435123 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02e119-67ca-4bf5-bf0e-c037ae245caf admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:01.437147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2a02e119-67ca-4bf5-bf0e-c037ae245caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:01.453259 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02e119-67ca-4bf5-bf0e-c037ae245caf admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:01.509193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22266a9f-6b46-4c72-856c-dac405c3916f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:01.509822 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22266a9f-6b46-4c72-856c-dac405c3916f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:01.510102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22266a9f-6b46-4c72-856c-dac405c3916f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:01.510375 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22266a9f-6b46-4c72-856c-dac405c3916f admin admin] PATH_INFO: `/v3/projects/8a4bc5b2543946d99a85db647d30f10e` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:01.511499 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22266a9f-6b46-4c72-856c-dac405c3916f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4bc5b2543946d99a85db647d30f10e)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:01.513396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22266a9f-6b46-4c72-856c-dac405c3916f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:01.559537 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-22266a9f-6b46-4c72-856c-dac405c3916f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4bc5b2543946d99a85db647d30f10e', 'request_id': 'req-22266a9f-6b46-4c72-856c-dac405c3916f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:01.565974 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-22266a9f-6b46-4c72-856c-dac405c3916f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4bc5b2543946d99a85db647d30f10e', 'request_id': 'req-22266a9f-6b46-4c72-856c-dac405c3916f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:01.572084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-22266a9f-6b46-4c72-856c-dac405c3916f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4bc5b2543946d99a85db647d30f10e', 'request_id': 'req-22266a9f-6b46-4c72-856c-dac405c3916f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:01.584629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-22266a9f-6b46-4c72-856c-dac405c3916f admin admin] The token cache is being invalidate because project 8a4bc5b2543946d99a85db647d30f10e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:43:01.584912 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-22266a9f-6b46-4c72-856c-dac405c3916f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:01.585525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-22266a9f-6b46-4c72-856c-dac405c3916f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:01.587010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1260/2541] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:43:01 2022] DELETE /identity/v3/projects/8a4bc5b2543946d99a85db647d30f10e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:01.591776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3de6d-0c1b-4bba-b63d-4dc9a9b3dd2f None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:01.592252 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3de6d-0c1b-4bba-b63d-4dc9a9b3dd2f None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:01.592368 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3de6d-0c1b-4bba-b63d-4dc9a9b3dd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:01.611312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-8aa3de6d-0c1b-4bba-b63d-4dc9a9b3dd2f None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:43:01.612498 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-8aa3de6d-0c1b-4bba-b63d-4dc9a9b3dd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:01.669585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1282/2542] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:43:01.677294 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebdd52-ca19-4f54-b3b4-0706f1101ec1 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:01.677579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebdd52-ca19-4f54-b3b4-0706f1101ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:01.677853 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebdd52-ca19-4f54-b3b4-0706f1101ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:01.698066 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-caebdd52-ca19-4f54-b3b4-0706f1101ec1 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:43:01.699242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-caebdd52-ca19-4f54-b3b4-0706f1101ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:01.707915 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1261/2543] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:43:01.711978 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3de6d-0c1b-4bba-b63d-4dc9a9b3dd2f None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:01.721460 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3de6d-0c1b-4bba-b63d-4dc9a9b3dd2f None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:01.725958 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1e6c9-7f40-462c-969c-77a6fe8f13ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:01.726538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1e6c9-7f40-462c-969c-77a6fe8f13ed admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:01.726814 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1e6c9-7f40-462c-969c-77a6fe8f13ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:01.727117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1e6c9-7f40-462c-969c-77a6fe8f13ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:01.727743 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1e6c9-7f40-462c-969c-77a6fe8f13ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:43:01.728069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1e6c9-7f40-462c-969c-77a6fe8f13ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:01.729610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1e6c9-7f40-462c-969c-77a6fe8f13ed admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:01.741350 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1283/2544] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:43:01.745509 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebdd52-ca19-4f54-b3b4-0706f1101ec1 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:01.755339 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebdd52-ca19-4f54-b3b4-0706f1101ec1 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:01.759978 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa91c4d-b414-45e3-a3c8-ace18dc913a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:01.760563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa91c4d-b414-45e3-a3c8-ace18dc913a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:01.760841 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa91c4d-b414-45e3-a3c8-ace18dc913a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:01.761111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa91c4d-b414-45e3-a3c8-ace18dc913a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:01.761732 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa91c4d-b414-45e3-a3c8-ace18dc913a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:01.763679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa91c4d-b414-45e3-a3c8-ace18dc913a9 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:01.790893 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1262/2545] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:43:01 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:43:01.794870 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1e6c9-7f40-462c-969c-77a6fe8f13ed admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:01.805211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1e6c9-7f40-462c-969c-77a6fe8f13ed admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:01.861149 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d4c3e-ad9f-4da2-af6f-817db140f79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:01.861745 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d4c3e-ad9f-4da2-af6f-817db140f79f admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:01.862054 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d4c3e-ad9f-4da2-af6f-817db140f79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:01.862331 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d4c3e-ad9f-4da2-af6f-817db140f79f admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:01.863030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d4c3e-ad9f-4da2-af6f-817db140f79f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:01.864982 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d4c3e-ad9f-4da2-af6f-817db140f79f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:01.885869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1284/2546] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:43:01 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:43:01.890453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa91c4d-b414-45e3-a3c8-ace18dc913a9 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:01.900942 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa91c4d-b414-45e3-a3c8-ace18dc913a9 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:01.905955 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a77f2-b0ab-46f1-bbb4-fa41c3798414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:01.906546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a77f2-b0ab-46f1-bbb4-fa41c3798414 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:01.906849 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a77f2-b0ab-46f1-bbb4-fa41c3798414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:01.907131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a77f2-b0ab-46f1-bbb4-fa41c3798414 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:01.907767 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a77f2-b0ab-46f1-bbb4-fa41c3798414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:01.909341 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a77f2-b0ab-46f1-bbb4-fa41c3798414 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:01.919448 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1263/2547] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:43:01.923797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d4c3e-ad9f-4da2-af6f-817db140f79f admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:01.933625 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d4c3e-ad9f-4da2-af6f-817db140f79f admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:01.938449 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ea33e-570e-40d0-a49a-2626fa2ea44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:01.939071 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ea33e-570e-40d0-a49a-2626fa2ea44b admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:01.939353 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ea33e-570e-40d0-a49a-2626fa2ea44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:01.939629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ea33e-570e-40d0-a49a-2626fa2ea44b admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:01.940264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ea33e-570e-40d0-a49a-2626fa2ea44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:01.941816 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ea33e-570e-40d0-a49a-2626fa2ea44b admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:01.952651 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1285/2548] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:43:01.956687 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a77f2-b0ab-46f1-bbb4-fa41c3798414 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:01.966406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a77f2-b0ab-46f1-bbb4-fa41c3798414 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:01.971844 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c86a4-7020-414f-ba7d-d2315115d0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:01.972483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c86a4-7020-414f-ba7d-d2315115d0a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:01.972762 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c86a4-7020-414f-ba7d-d2315115d0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:01.973035 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c86a4-7020-414f-ba7d-d2315115d0a5 admin admin] PATH_INFO: `/v3/projects/5dcb460f88b24905bc2f2d1519e3c572/users/9227792fff0147019ed63245fefec09f/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:01.987599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c86a4-7020-414f-ba7d-d2315115d0a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dcb460f88b24905bc2f2d1519e3c572, user_id=9227792fff0147019ed63245fefec09f, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:01.990285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c86a4-7020-414f-ba7d-d2315115d0a5 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:02.003249 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1264/2549] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:43:01 2022] PUT /identity/v3/projects/5dcb460f88b24905bc2f2d1519e3c572/users/9227792fff0147019ed63245fefec09f/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:02.013445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527e084-e3d9-40cf-a8b5-d529086cc30d None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:02.013736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527e084-e3d9-40cf-a8b5-d529086cc30d None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:02.014535 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527e084-e3d9-40cf-a8b5-d529086cc30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:02.042608 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-1527e084-e3d9-40cf-a8b5-d529086cc30d None None] MFA Rules not processed for user `9227792fff0147019ed63245fefec09f`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:43:02.043831 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-1527e084-e3d9-40cf-a8b5-d529086cc30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:02.059881 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:02.108252 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1286/2550] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:43:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:43:02.112721 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c86a4-7020-414f-ba7d-d2315115d0a5 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:02.132209 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:02.175980 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c86a4-7020-414f-ba7d-d2315115d0a5 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:02.180537 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18e05c-cfd8-492e-852f-02cdcc50e6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:02.181128 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18e05c-cfd8-492e-852f-02cdcc50e6ab admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:02.181402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18e05c-cfd8-492e-852f-02cdcc50e6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:02.181669 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18e05c-cfd8-492e-852f-02cdcc50e6ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:02.182285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18e05c-cfd8-492e-852f-02cdcc50e6ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:02.184187 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18e05c-cfd8-492e-852f-02cdcc50e6ab admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:02.211425 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1265/2551] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:43:02 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:43:02.215459 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527e084-e3d9-40cf-a8b5-d529086cc30d None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:02.226276 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527e084-e3d9-40cf-a8b5-d529086cc30d None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:02.280438 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401696e-ca5a-4974-892d-8ead006f3274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:02.281038 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401696e-ca5a-4974-892d-8ead006f3274 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:02.281302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401696e-ca5a-4974-892d-8ead006f3274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:02.281569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401696e-ca5a-4974-892d-8ead006f3274 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:02.282178 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401696e-ca5a-4974-892d-8ead006f3274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:02.284092 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401696e-ca5a-4974-892d-8ead006f3274 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:02.304552 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1287/2552] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:43:02 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:43:02.308634 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18e05c-cfd8-492e-852f-02cdcc50e6ab admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:02.319344 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18e05c-cfd8-492e-852f-02cdcc50e6ab admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:02.323930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac148c-790c-42a2-982d-386b3be57760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:02.324521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac148c-790c-42a2-982d-386b3be57760 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:02.324802 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac148c-790c-42a2-982d-386b3be57760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:02.325081 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac148c-790c-42a2-982d-386b3be57760 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:02.325717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac148c-790c-42a2-982d-386b3be57760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:02.328195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac148c-790c-42a2-982d-386b3be57760 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:02.338521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1266/2553] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:43:02.343085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401696e-ca5a-4974-892d-8ead006f3274 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:02.353085 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401696e-ca5a-4974-892d-8ead006f3274 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:02.357635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11895785-64af-4fee-a3a5-026534de4961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:02.358423 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11895785-64af-4fee-a3a5-026534de4961 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:02.358694 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11895785-64af-4fee-a3a5-026534de4961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:02.359002 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11895785-64af-4fee-a3a5-026534de4961 admin admin] PATH_INFO: `/v3/projects/12938aa5de024e5eaa7e469a510a8579/users/7f521f54f3ae4adeba6bd9736ba41233/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:02.374327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11895785-64af-4fee-a3a5-026534de4961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12938aa5de024e5eaa7e469a510a8579, user_id=7f521f54f3ae4adeba6bd9736ba41233, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:02.376985 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11895785-64af-4fee-a3a5-026534de4961 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:02.390573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1288/2554] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:43:02 2022] PUT /identity/v3/projects/12938aa5de024e5eaa7e469a510a8579/users/7f521f54f3ae4adeba6bd9736ba41233/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:02.394805 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac148c-790c-42a2-982d-386b3be57760 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:02.406245 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac148c-790c-42a2-982d-386b3be57760 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:02.465279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4292267-2494-4b74-b9d6-1cacdf44f176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:02.465913 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4292267-2494-4b74-b9d6-1cacdf44f176 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:02.466158 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4292267-2494-4b74-b9d6-1cacdf44f176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:02.466435 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4292267-2494-4b74-b9d6-1cacdf44f176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:02.467248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4292267-2494-4b74-b9d6-1cacdf44f176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:02.468776 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4292267-2494-4b74-b9d6-1cacdf44f176 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:02.478199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1267/2555] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:43:02.482587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11895785-64af-4fee-a3a5-026534de4961 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:02.493280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11895785-64af-4fee-a3a5-026534de4961 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:02.497866 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae7dec-b8e5-4f01-843a-e29bb84750c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:02.499155 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae7dec-b8e5-4f01-843a-e29bb84750c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:02.499489 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae7dec-b8e5-4f01-843a-e29bb84750c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:02.499788 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae7dec-b8e5-4f01-843a-e29bb84750c0 admin admin] PATH_INFO: `/v3/projects/12938aa5de024e5eaa7e469a510a8579/users/7f521f54f3ae4adeba6bd9736ba41233/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:02.501676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae7dec-b8e5-4f01-843a-e29bb84750c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12938aa5de024e5eaa7e469a510a8579, user_id=7f521f54f3ae4adeba6bd9736ba41233, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:02.504341 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae7dec-b8e5-4f01-843a-e29bb84750c0 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:02.515121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1289/2556] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:43:02 2022] PUT /identity/v3/projects/12938aa5de024e5eaa7e469a510a8579/users/7f521f54f3ae4adeba6bd9736ba41233/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:02.580576 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98be02-954c-4992-96fd-580c78b8bb9e None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:02.580865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98be02-954c-4992-96fd-580c78b8bb9e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:02.581145 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98be02-954c-4992-96fd-580c78b8bb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:02.610142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-7d98be02-954c-4992-96fd-580c78b8bb9e None None] MFA Rules not processed for user `7f521f54f3ae4adeba6bd9736ba41233`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:43:02.611421 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7d98be02-954c-4992-96fd-580c78b8bb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:02.680758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1268/2557] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:43:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:43:02.692447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae7dec-b8e5-4f01-843a-e29bb84750c0 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:02.694220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-86ae7dec-b8e5-4f01-843a-e29bb84750c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:02.751704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae7dec-b8e5-4f01-843a-e29bb84750c0 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:02.755424 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3345d4d-4429-4b49-8caf-a96981cc2fce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:02.755888 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3345d4d-4429-4b49-8caf-a96981cc2fce service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:02.756166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3345d4d-4429-4b49-8caf-a96981cc2fce service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:02.756434 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3345d4d-4429-4b49-8caf-a96981cc2fce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:02.780212 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:02.813084 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3345d4d-4429-4b49-8caf-a96981cc2fce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:02.814489 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3345d4d-4429-4b49-8caf-a96981cc2fce service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:02.823045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1290/2558] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:43:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:43:07.024713 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98be02-954c-4992-96fd-580c78b8bb9e None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:07.026093 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7d98be02-954c-4992-96fd-580c78b8bb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:07.037767 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98be02-954c-4992-96fd-580c78b8bb9e None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:07.041265 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e66ab-4623-4378-aa88-b12148e4a754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:07.041849 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e66ab-4623-4378-aa88-b12148e4a754 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:07.042123 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e66ab-4623-4378-aa88-b12148e4a754 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:07.042389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e66ab-4623-4378-aa88-b12148e4a754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:07.051205 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e66ab-4623-4378-aa88-b12148e4a754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:07.052596 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e66ab-4623-4378-aa88-b12148e4a754 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:07.057352 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:07.063757 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1269/2559] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:43:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:43:11.944582 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3345d4d-4429-4b49-8caf-a96981cc2fce service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:12.008704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3345d4d-4429-4b49-8caf-a96981cc2fce service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:12.013141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214530c-04a8-44c4-8df5-729e64f270b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:12.013757 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214530c-04a8-44c4-8df5-729e64f270b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:12.014035 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214530c-04a8-44c4-8df5-729e64f270b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:12.014307 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214530c-04a8-44c4-8df5-729e64f270b1 admin admin] PATH_INFO: `/v3/users/9227792fff0147019ed63245fefec09f` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:12.015416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214530c-04a8-44c4-8df5-729e64f270b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9227792fff0147019ed63245fefec09f)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:12.017495 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214530c-04a8-44c4-8df5-729e64f270b1 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:12.063379 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f214530c-04a8-44c4-8df5-729e64f270b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9227792fff0147019ed63245fefec09f'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:12.064020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f214530c-04a8-44c4-8df5-729e64f270b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9227792fff0147019ed63245fefec09f'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:12.064617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f214530c-04a8-44c4-8df5-729e64f270b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9227792fff0147019ed63245fefec09f'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:12.076287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f214530c-04a8-44c4-8df5-729e64f270b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9227792fff0147019ed63245fefec09f'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:12.083268 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f214530c-04a8-44c4-8df5-729e64f270b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9227792fff0147019ed63245fefec09f'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:12.095453 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1291/2560] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:43:11 2022] DELETE /identity/v3/users/9227792fff0147019ed63245fefec09f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:12.099878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e786cf-66f2-4062-ac01-ad60a0ae3bc4 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:12.100385 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e786cf-66f2-4062-ac01-ad60a0ae3bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:12.100487 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e786cf-66f2-4062-ac01-ad60a0ae3bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:12.119674 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-c8e786cf-66f2-4062-ac01-ad60a0ae3bc4 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:43:12.120851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c8e786cf-66f2-4062-ac01-ad60a0ae3bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:12.177751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1270/2561] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:43:12.187844 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214530c-04a8-44c4-8df5-729e64f270b1 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:12.189230 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f214530c-04a8-44c4-8df5-729e64f270b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:12.241006 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:12.253167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214530c-04a8-44c4-8df5-729e64f270b1 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:12.256820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253efcc8-304b-45e8-a351-3ae11addb883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:12.257417 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253efcc8-304b-45e8-a351-3ae11addb883 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:12.257698 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253efcc8-304b-45e8-a351-3ae11addb883 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:12.257973 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253efcc8-304b-45e8-a351-3ae11addb883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:12.266941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253efcc8-304b-45e8-a351-3ae11addb883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:12.268352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253efcc8-304b-45e8-a351-3ae11addb883 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:12.277674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1292/2562] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:43:12.550745 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e786cf-66f2-4062-ac01-ad60a0ae3bc4 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:12.552339 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c8e786cf-66f2-4062-ac01-ad60a0ae3bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:12.567175 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e786cf-66f2-4062-ac01-ad60a0ae3bc4 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:12.571796 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11550f43-5648-4284-bad4-c91a732365ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:12.572537 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11550f43-5648-4284-bad4-c91a732365ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:12.572878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11550f43-5648-4284-bad4-c91a732365ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:12.573287 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11550f43-5648-4284-bad4-c91a732365ec admin admin] PATH_INFO: `/v3/projects/5dcb460f88b24905bc2f2d1519e3c572` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:12.574650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11550f43-5648-4284-bad4-c91a732365ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dcb460f88b24905bc2f2d1519e3c572)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:12.576756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11550f43-5648-4284-bad4-c91a732365ec admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:12.626469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-11550f43-5648-4284-bad4-c91a732365ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dcb460f88b24905bc2f2d1519e3c572', 'request_id': 'req-11550f43-5648-4284-bad4-c91a732365ec'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:12.631951 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-11550f43-5648-4284-bad4-c91a732365ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dcb460f88b24905bc2f2d1519e3c572', 'request_id': 'req-11550f43-5648-4284-bad4-c91a732365ec'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:12.638241 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-11550f43-5648-4284-bad4-c91a732365ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dcb460f88b24905bc2f2d1519e3c572', 'request_id': 'req-11550f43-5648-4284-bad4-c91a732365ec'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:12.651360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-11550f43-5648-4284-bad4-c91a732365ec admin admin] The token cache is being invalidate because project 5dcb460f88b24905bc2f2d1519e3c572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:43:12.651645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-11550f43-5648-4284-bad4-c91a732365ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:12.652257 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-11550f43-5648-4284-bad4-c91a732365ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:12.653723 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1271/2563] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:43:12 2022] DELETE /identity/v3/projects/5dcb460f88b24905bc2f2d1519e3c572 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:12.658458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253efcc8-304b-45e8-a351-3ae11addb883 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:12.667935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253efcc8-304b-45e8-a351-3ae11addb883 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:12.722586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9256461-1b98-40d1-bdee-bbf8d39c83da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:12.723238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9256461-1b98-40d1-bdee-bbf8d39c83da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:12.723512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9256461-1b98-40d1-bdee-bbf8d39c83da admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:12.723787 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9256461-1b98-40d1-bdee-bbf8d39c83da admin admin] PATH_INFO: `/v3/users/7f521f54f3ae4adeba6bd9736ba41233` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:12.724888 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9256461-1b98-40d1-bdee-bbf8d39c83da admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f521f54f3ae4adeba6bd9736ba41233)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:12.726801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9256461-1b98-40d1-bdee-bbf8d39c83da admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:12.770711 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c9256461-1b98-40d1-bdee-bbf8d39c83da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f521f54f3ae4adeba6bd9736ba41233'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:12.771397 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c9256461-1b98-40d1-bdee-bbf8d39c83da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f521f54f3ae4adeba6bd9736ba41233'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:12.771998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c9256461-1b98-40d1-bdee-bbf8d39c83da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f521f54f3ae4adeba6bd9736ba41233'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:12.784476 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c9256461-1b98-40d1-bdee-bbf8d39c83da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f521f54f3ae4adeba6bd9736ba41233'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:12.791232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c9256461-1b98-40d1-bdee-bbf8d39c83da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f521f54f3ae4adeba6bd9736ba41233'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:12.803836 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1293/2564] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:43:12 2022] DELETE /identity/v3/users/7f521f54f3ae4adeba6bd9736ba41233 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:13.082393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11550f43-5648-4284-bad4-c91a732365ec admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:13.083936 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-11550f43-5648-4284-bad4-c91a732365ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:13.097936 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11550f43-5648-4284-bad4-c91a732365ec admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:13.154225 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da609ad0-5354-4014-af31-b5f21c85af5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:13.154939 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da609ad0-5354-4014-af31-b5f21c85af5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:13.155142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da609ad0-5354-4014-af31-b5f21c85af5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:13.155412 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da609ad0-5354-4014-af31-b5f21c85af5f admin admin] PATH_INFO: `/v3/projects/12938aa5de024e5eaa7e469a510a8579` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:13.157009 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da609ad0-5354-4014-af31-b5f21c85af5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=12938aa5de024e5eaa7e469a510a8579)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:13.158900 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da609ad0-5354-4014-af31-b5f21c85af5f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:13.191059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:13.208880 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-da609ad0-5354-4014-af31-b5f21c85af5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12938aa5de024e5eaa7e469a510a8579', 'request_id': 'req-da609ad0-5354-4014-af31-b5f21c85af5f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:13.214226 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-da609ad0-5354-4014-af31-b5f21c85af5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12938aa5de024e5eaa7e469a510a8579', 'request_id': 'req-da609ad0-5354-4014-af31-b5f21c85af5f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:13.220899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-da609ad0-5354-4014-af31-b5f21c85af5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12938aa5de024e5eaa7e469a510a8579', 'request_id': 'req-da609ad0-5354-4014-af31-b5f21c85af5f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:13.232663 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-da609ad0-5354-4014-af31-b5f21c85af5f admin admin] The token cache is being invalidate because project 12938aa5de024e5eaa7e469a510a8579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:43:13.232878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-da609ad0-5354-4014-af31-b5f21c85af5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:13.233481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-da609ad0-5354-4014-af31-b5f21c85af5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:13.235566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1272/2565] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:43:13 2022] DELETE /identity/v3/projects/12938aa5de024e5eaa7e469a510a8579 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:13.241529 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe1494-a722-41ae-9579-a3e951b00496 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:13.241995 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe1494-a722-41ae-9579-a3e951b00496 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:13.242124 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe1494-a722-41ae-9579-a3e951b00496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:13.261998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-1fbe1494-a722-41ae-9579-a3e951b00496 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:43:13.263355 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-1fbe1494-a722-41ae-9579-a3e951b00496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:13.322564 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1294/2566] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:43:13.331417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7663a92-fa7b-4254-941f-9258755bf6ce None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:13.331707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7663a92-fa7b-4254-941f-9258755bf6ce None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:13.331986 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7663a92-fa7b-4254-941f-9258755bf6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:13.352300 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-d7663a92-fa7b-4254-941f-9258755bf6ce None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:43:13.353506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d7663a92-fa7b-4254-941f-9258755bf6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:13.361488 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1273/2567] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:43:13.365704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe1494-a722-41ae-9579-a3e951b00496 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:13.375424 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe1494-a722-41ae-9579-a3e951b00496 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:13.379989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b7c86-25d2-40b6-8d82-ce5ba7c929ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:13.380575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b7c86-25d2-40b6-8d82-ce5ba7c929ac admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:13.380854 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b7c86-25d2-40b6-8d82-ce5ba7c929ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:13.381127 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b7c86-25d2-40b6-8d82-ce5ba7c929ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:13.381768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b7c86-25d2-40b6-8d82-ce5ba7c929ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:43:13.382065 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b7c86-25d2-40b6-8d82-ce5ba7c929ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:13.383666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b7c86-25d2-40b6-8d82-ce5ba7c929ac admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:13.385126 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:13.401468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1295/2568] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:43:13.402649 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7663a92-fa7b-4254-941f-9258755bf6ce None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:13.412692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7663a92-fa7b-4254-941f-9258755bf6ce None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:13.417428 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddb49c-b76d-4c3d-ad2a-bd7d1b9e92cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:13.418022 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddb49c-b76d-4c3d-ad2a-bd7d1b9e92cd admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:13.418303 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddb49c-b76d-4c3d-ad2a-bd7d1b9e92cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:13.418573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddb49c-b76d-4c3d-ad2a-bd7d1b9e92cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:13.419263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddb49c-b76d-4c3d-ad2a-bd7d1b9e92cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:13.421158 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddb49c-b76d-4c3d-ad2a-bd7d1b9e92cd admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:13.448187 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1274/2569] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:43:13 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:43:13.452331 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b7c86-25d2-40b6-8d82-ce5ba7c929ac admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:13.462957 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b7c86-25d2-40b6-8d82-ce5ba7c929ac admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:13.518130 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c0bbe-6dbd-4742-a274-ef18cc9ffbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:13.518504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c0bbe-6dbd-4742-a274-ef18cc9ffbae admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:13.518693 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c0bbe-6dbd-4742-a274-ef18cc9ffbae admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:13.518996 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c0bbe-6dbd-4742-a274-ef18cc9ffbae admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:13.519641 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c0bbe-6dbd-4742-a274-ef18cc9ffbae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:13.521507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c0bbe-6dbd-4742-a274-ef18cc9ffbae admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:13.542032 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1296/2570] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:43:13 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:43:13.546112 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddb49c-b76d-4c3d-ad2a-bd7d1b9e92cd admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:13.557243 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddb49c-b76d-4c3d-ad2a-bd7d1b9e92cd admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:13.561847 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e99291-01c6-404c-8251-c48a2fff83c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:13.562559 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e99291-01c6-404c-8251-c48a2fff83c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:13.562897 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e99291-01c6-404c-8251-c48a2fff83c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:13.563174 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e99291-01c6-404c-8251-c48a2fff83c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:13.563809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e99291-01c6-404c-8251-c48a2fff83c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:13.565434 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e99291-01c6-404c-8251-c48a2fff83c9 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:13.575160 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1275/2571] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:43:13.579831 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c0bbe-6dbd-4742-a274-ef18cc9ffbae admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:13.589791 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c0bbe-6dbd-4742-a274-ef18cc9ffbae admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:13.594970 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5313a0-d4d9-4995-bb0e-b27ffb4c984d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:13.595579 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5313a0-d4d9-4995-bb0e-b27ffb4c984d admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:13.595855 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5313a0-d4d9-4995-bb0e-b27ffb4c984d admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:13.596125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5313a0-d4d9-4995-bb0e-b27ffb4c984d admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:13.596755 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5313a0-d4d9-4995-bb0e-b27ffb4c984d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:13.598338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5313a0-d4d9-4995-bb0e-b27ffb4c984d admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:13.608670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1297/2572] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:43:13.612743 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e99291-01c6-404c-8251-c48a2fff83c9 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:13.622519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e99291-01c6-404c-8251-c48a2fff83c9 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:13.627168 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587c18d-c18e-4b3f-9e45-66784d3f71bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:13.627798 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587c18d-c18e-4b3f-9e45-66784d3f71bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:13.628076 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587c18d-c18e-4b3f-9e45-66784d3f71bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:13.628350 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587c18d-c18e-4b3f-9e45-66784d3f71bc admin admin] PATH_INFO: `/v3/projects/d2bd20e2b9b141728b7866106a461bac/users/036a62305a5741cfbfb2fd2428e6c682/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:13.643745 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587c18d-c18e-4b3f-9e45-66784d3f71bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2bd20e2b9b141728b7866106a461bac, user_id=036a62305a5741cfbfb2fd2428e6c682, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:13.646385 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587c18d-c18e-4b3f-9e45-66784d3f71bc admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:13.659391 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1276/2573] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:43:13 2022] PUT /identity/v3/projects/d2bd20e2b9b141728b7866106a461bac/users/036a62305a5741cfbfb2fd2428e6c682/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:13.671860 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d515f7-0b8a-47a3-8312-6220aaeae25e None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:13.672155 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d515f7-0b8a-47a3-8312-6220aaeae25e None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:13.672435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d515f7-0b8a-47a3-8312-6220aaeae25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:13.700701 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-84d515f7-0b8a-47a3-8312-6220aaeae25e None None] MFA Rules not processed for user `036a62305a5741cfbfb2fd2428e6c682`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:43:13.701906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-84d515f7-0b8a-47a3-8312-6220aaeae25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:13.766125 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1298/2574] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:43:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:43:13.770916 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587c18d-c18e-4b3f-9e45-66784d3f71bc admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:13.832113 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587c18d-c18e-4b3f-9e45-66784d3f71bc admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:13.836799 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cbe1c-7628-4e69-9314-58a6b35261e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:13.837401 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cbe1c-7628-4e69-9314-58a6b35261e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:13.837679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cbe1c-7628-4e69-9314-58a6b35261e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:13.837949 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cbe1c-7628-4e69-9314-58a6b35261e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:13.838631 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cbe1c-7628-4e69-9314-58a6b35261e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:13.840540 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cbe1c-7628-4e69-9314-58a6b35261e4 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:13.867025 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1277/2575] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:43:13 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:43:13.871143 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d515f7-0b8a-47a3-8312-6220aaeae25e None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:13.882271 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d515f7-0b8a-47a3-8312-6220aaeae25e None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:13.936877 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e24722-d76b-45c6-9337-03bbd64436a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:13.938092 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e24722-d76b-45c6-9337-03bbd64436a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:13.938364 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e24722-d76b-45c6-9337-03bbd64436a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:13.938634 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e24722-d76b-45c6-9337-03bbd64436a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:13.939284 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e24722-d76b-45c6-9337-03bbd64436a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:13.941162 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e24722-d76b-45c6-9337-03bbd64436a1 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:13.949823 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:13.962369 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1299/2576] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:43:13 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:43:13.966356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cbe1c-7628-4e69-9314-58a6b35261e4 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:13.977098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cbe1c-7628-4e69-9314-58a6b35261e4 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:13.981730 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d31093-20e3-49fd-a660-761dca3cdf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:13.982320 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d31093-20e3-49fd-a660-761dca3cdf67 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:13.982600 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d31093-20e3-49fd-a660-761dca3cdf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:13.982903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d31093-20e3-49fd-a660-761dca3cdf67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:13.983534 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d31093-20e3-49fd-a660-761dca3cdf67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:13.985424 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d31093-20e3-49fd-a660-761dca3cdf67 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:13.995677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1278/2577] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:43:14.000054 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e24722-d76b-45c6-9337-03bbd64436a1 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:14.009797 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e24722-d76b-45c6-9337-03bbd64436a1 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:14.014353 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edb14b-ca5a-4054-8f79-15547e79ff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:14.014959 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edb14b-ca5a-4054-8f79-15547e79ff49 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:14.015277 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edb14b-ca5a-4054-8f79-15547e79ff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:14.015548 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edb14b-ca5a-4054-8f79-15547e79ff49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:14.016389 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edb14b-ca5a-4054-8f79-15547e79ff49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:14.017869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edb14b-ca5a-4054-8f79-15547e79ff49 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:14.027796 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1300/2578] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:43:14.032361 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d31093-20e3-49fd-a660-761dca3cdf67 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:14.042133 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d31093-20e3-49fd-a660-761dca3cdf67 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:14.047259 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8148451-0d03-4d97-b062-f61665114028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:14.047880 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8148451-0d03-4d97-b062-f61665114028 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:14.048153 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8148451-0d03-4d97-b062-f61665114028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:14.048420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8148451-0d03-4d97-b062-f61665114028 admin admin] PATH_INFO: `/v3/projects/7c582272cb1a4cd5ace9b752a6341cef/users/7277605c6c5d4d3090e91fef66636c0e/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:14.062621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8148451-0d03-4d97-b062-f61665114028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c582272cb1a4cd5ace9b752a6341cef, user_id=7277605c6c5d4d3090e91fef66636c0e, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:14.065263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8148451-0d03-4d97-b062-f61665114028 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:14.074136 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:14.080349 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1279/2579] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:43:14 2022] PUT /identity/v3/projects/7c582272cb1a4cd5ace9b752a6341cef/users/7277605c6c5d4d3090e91fef66636c0e/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:43:14.090980 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaded5-a9d7-4bfc-8529-dc5216b1781d None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:14.091270 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaded5-a9d7-4bfc-8529-dc5216b1781d None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:14.091551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaded5-a9d7-4bfc-8529-dc5216b1781d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:14.120018 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-93aaded5-a9d7-4bfc-8529-dc5216b1781d None None] MFA Rules not processed for user `7277605c6c5d4d3090e91fef66636c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:43:14.121225 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-93aaded5-a9d7-4bfc-8529-dc5216b1781d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:14.185025 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1301/2580] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:43:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:43:14.190009 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8148451-0d03-4d97-b062-f61665114028 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:14.253751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8148451-0d03-4d97-b062-f61665114028 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:14.258453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88ea36-c2a2-4151-94d7-00ae0cf4bf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:14.259075 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88ea36-c2a2-4151-94d7-00ae0cf4bf7a admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:14.259358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88ea36-c2a2-4151-94d7-00ae0cf4bf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:14.259630 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88ea36-c2a2-4151-94d7-00ae0cf4bf7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:14.260256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88ea36-c2a2-4151-94d7-00ae0cf4bf7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:14.262135 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88ea36-c2a2-4151-94d7-00ae0cf4bf7a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:14.289246 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1280/2581] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:43:14 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:43:14.293261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aaded5-a9d7-4bfc-8529-dc5216b1781d None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:14.303929 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aaded5-a9d7-4bfc-8529-dc5216b1781d None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:14.361392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230effa3-cb28-46f7-a873-fb130109c53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:14.361992 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230effa3-cb28-46f7-a873-fb130109c53a admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:14.362293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230effa3-cb28-46f7-a873-fb130109c53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:14.362571 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230effa3-cb28-46f7-a873-fb130109c53a admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:14.363240 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230effa3-cb28-46f7-a873-fb130109c53a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:14.365146 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230effa3-cb28-46f7-a873-fb130109c53a admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:14.386291 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1302/2582] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:43:14 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:43:14.391086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88ea36-c2a2-4151-94d7-00ae0cf4bf7a admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:14.401302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88ea36-c2a2-4151-94d7-00ae0cf4bf7a admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:14.406497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04c6fa-422c-424b-a50f-8a1b59f01116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:14.407131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04c6fa-422c-424b-a50f-8a1b59f01116 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:14.407407 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04c6fa-422c-424b-a50f-8a1b59f01116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:14.407677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04c6fa-422c-424b-a50f-8a1b59f01116 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:14.408310 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04c6fa-422c-424b-a50f-8a1b59f01116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:14.409881 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04c6fa-422c-424b-a50f-8a1b59f01116 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:14.420685 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1281/2583] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:43:14.425407 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230effa3-cb28-46f7-a873-fb130109c53a admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:14.435372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230effa3-cb28-46f7-a873-fb130109c53a admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:14.440464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b45e9e-e445-4a73-b4db-d23f5a1f9c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:14.441101 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b45e9e-e445-4a73-b4db-d23f5a1f9c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:14.441394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b45e9e-e445-4a73-b4db-d23f5a1f9c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:14.441655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b45e9e-e445-4a73-b4db-d23f5a1f9c87 admin admin] PATH_INFO: `/v3/projects/7fe4d84bff774508879ef576994557c0/users/c337f3cf0da64ff1b272f6f848a7f53d/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:14.457032 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b45e9e-e445-4a73-b4db-d23f5a1f9c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe4d84bff774508879ef576994557c0, user_id=c337f3cf0da64ff1b272f6f848a7f53d, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:14.459682 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b45e9e-e445-4a73-b4db-d23f5a1f9c87 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:14.472997 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1303/2584] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:43:14 2022] PUT /identity/v3/projects/7fe4d84bff774508879ef576994557c0/users/c337f3cf0da64ff1b272f6f848a7f53d/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:14.477125 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04c6fa-422c-424b-a50f-8a1b59f01116 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:14.487153 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04c6fa-422c-424b-a50f-8a1b59f01116 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:14.544626 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb4035-58a3-413c-ac14-942068007bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:14.545152 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb4035-58a3-413c-ac14-942068007bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:14.545433 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb4035-58a3-413c-ac14-942068007bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:14.545708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb4035-58a3-413c-ac14-942068007bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:14.546370 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb4035-58a3-413c-ac14-942068007bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:14.548304 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb4035-58a3-413c-ac14-942068007bb5 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:14.557730 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1282/2585] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:43:14.561802 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b45e9e-e445-4a73-b4db-d23f5a1f9c87 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:14.572695 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b45e9e-e445-4a73-b4db-d23f5a1f9c87 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:14.577289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da43b59-d6bf-40e2-b8c6-badd017447cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:14.578974 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da43b59-d6bf-40e2-b8c6-badd017447cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:14.579253 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da43b59-d6bf-40e2-b8c6-badd017447cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:14.579622 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da43b59-d6bf-40e2-b8c6-badd017447cc admin admin] PATH_INFO: `/v3/projects/7fe4d84bff774508879ef576994557c0/users/c337f3cf0da64ff1b272f6f848a7f53d/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:14.581577 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da43b59-d6bf-40e2-b8c6-badd017447cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe4d84bff774508879ef576994557c0, user_id=c337f3cf0da64ff1b272f6f848a7f53d, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:14.584198 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da43b59-d6bf-40e2-b8c6-badd017447cc admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:14.594283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1304/2586] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:43:14 2022] PUT /identity/v3/projects/7fe4d84bff774508879ef576994557c0/users/c337f3cf0da64ff1b272f6f848a7f53d/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:14.604173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b45aa4-d547-4ed2-a560-45ad9d5505d2 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:14.604457 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b45aa4-d547-4ed2-a560-45ad9d5505d2 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:14.604749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b45aa4-d547-4ed2-a560-45ad9d5505d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:14.633222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-a9b45aa4-d547-4ed2-a560-45ad9d5505d2 None None] MFA Rules not processed for user `c337f3cf0da64ff1b272f6f848a7f53d`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:43:14.634424 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a9b45aa4-d547-4ed2-a560-45ad9d5505d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:14.692445 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:14.702153 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1283/2587] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:43:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:43:14.714730 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da43b59-d6bf-40e2-b8c6-badd017447cc admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:14.716492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0da43b59-d6bf-40e2-b8c6-badd017447cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:14.742746 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:14.775380 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da43b59-d6bf-40e2-b8c6-badd017447cc admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:14.779012 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb62212-5dfa-454c-8e56-e31cd74ca277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:14.779601 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb62212-5dfa-454c-8e56-e31cd74ca277 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:14.779875 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb62212-5dfa-454c-8e56-e31cd74ca277 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:14.780143 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb62212-5dfa-454c-8e56-e31cd74ca277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:14.835816 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb62212-5dfa-454c-8e56-e31cd74ca277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:14.837168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb62212-5dfa-454c-8e56-e31cd74ca277 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:14.845860 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1305/2588] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:43:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:43:16.351909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b45aa4-d547-4ed2-a560-45ad9d5505d2 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:16.353317 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a9b45aa4-d547-4ed2-a560-45ad9d5505d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:16.365888 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b45aa4-d547-4ed2-a560-45ad9d5505d2 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:16.369547 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e116c-714a-4e33-8160-f77d82906147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:16.370141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e116c-714a-4e33-8160-f77d82906147 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:16.370421 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e116c-714a-4e33-8160-f77d82906147 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:16.370695 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e116c-714a-4e33-8160-f77d82906147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:16.428905 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e116c-714a-4e33-8160-f77d82906147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:16.430340 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e116c-714a-4e33-8160-f77d82906147 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:16.440095 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1284/2589] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:43:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:43:16.958800 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb62212-5dfa-454c-8e56-e31cd74ca277 service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:16.967288 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb62212-5dfa-454c-8e56-e31cd74ca277 service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:16.970895 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f3fdd-f6ff-4223-946d-537ab2094520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:16.971483 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f3fdd-f6ff-4223-946d-537ab2094520 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:16.971761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f3fdd-f6ff-4223-946d-537ab2094520 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:16.972034 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f3fdd-f6ff-4223-946d-537ab2094520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:16.980743 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f3fdd-f6ff-4223-946d-537ab2094520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:16.982129 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f3fdd-f6ff-4223-946d-537ab2094520 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:16.991343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1306/2590] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:43:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:43:20.857987 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e116c-714a-4e33-8160-f77d82906147 service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:20.933080 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e116c-714a-4e33-8160-f77d82906147 service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:20.937962 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbef52-1056-465c-a7a0-60e113929e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:20.938591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbef52-1056-465c-a7a0-60e113929e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:20.938898 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbef52-1056-465c-a7a0-60e113929e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:20.939169 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbef52-1056-465c-a7a0-60e113929e20 admin admin] PATH_INFO: `/v3/users/036a62305a5741cfbfb2fd2428e6c682` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:20.940290 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbef52-1056-465c-a7a0-60e113929e20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=036a62305a5741cfbfb2fd2428e6c682)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:20.942316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbef52-1056-465c-a7a0-60e113929e20 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:20.997967 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c5fbef52-1056-465c-a7a0-60e113929e20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036a62305a5741cfbfb2fd2428e6c682'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:20.998645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c5fbef52-1056-465c-a7a0-60e113929e20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036a62305a5741cfbfb2fd2428e6c682'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:20.999311 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c5fbef52-1056-465c-a7a0-60e113929e20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036a62305a5741cfbfb2fd2428e6c682'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:21.013385 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c5fbef52-1056-465c-a7a0-60e113929e20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036a62305a5741cfbfb2fd2428e6c682'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:21.022679 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c5fbef52-1056-465c-a7a0-60e113929e20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036a62305a5741cfbfb2fd2428e6c682'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:21.036836 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1285/2591] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:43:20 2022] DELETE /identity/v3/users/036a62305a5741cfbfb2fd2428e6c682 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:21.041508 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a98e7-97fa-4705-aa95-121846a69243 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:21.042000 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a98e7-97fa-4705-aa95-121846a69243 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:21.042107 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a98e7-97fa-4705-aa95-121846a69243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:21.061522 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-556a98e7-97fa-4705-aa95-121846a69243 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:43:21.062923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-556a98e7-97fa-4705-aa95-121846a69243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:21.124028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1307/2592] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:43:21.135170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbef52-1056-465c-a7a0-60e113929e20 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:21.136630 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c5fbef52-1056-465c-a7a0-60e113929e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:21.152567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:21.208154 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbef52-1056-465c-a7a0-60e113929e20 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:21.211870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4b039-ff99-44e1-aebd-f12c89bc41ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:21.212473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4b039-ff99-44e1-aebd-f12c89bc41ff service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:21.212752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4b039-ff99-44e1-aebd-f12c89bc41ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:21.213022 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4b039-ff99-44e1-aebd-f12c89bc41ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:21.224208 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4b039-ff99-44e1-aebd-f12c89bc41ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:21.225641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4b039-ff99-44e1-aebd-f12c89bc41ff service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:21.235681 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1286/2593] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:43:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:43:21.535552 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a98e7-97fa-4705-aa95-121846a69243 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:21.537094 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-556a98e7-97fa-4705-aa95-121846a69243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:21.552837 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a98e7-97fa-4705-aa95-121846a69243 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:21.558838 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601768c3-66c3-480b-82fd-4319d0089124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:21.559483 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601768c3-66c3-480b-82fd-4319d0089124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:21.559763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601768c3-66c3-480b-82fd-4319d0089124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:21.560049 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601768c3-66c3-480b-82fd-4319d0089124 admin admin] PATH_INFO: `/v3/projects/d2bd20e2b9b141728b7866106a461bac` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:21.561192 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601768c3-66c3-480b-82fd-4319d0089124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2bd20e2b9b141728b7866106a461bac)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:21.565484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601768c3-66c3-480b-82fd-4319d0089124 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:21.615357 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-601768c3-66c3-480b-82fd-4319d0089124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2bd20e2b9b141728b7866106a461bac', 'request_id': 'req-601768c3-66c3-480b-82fd-4319d0089124'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:21.621511 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-601768c3-66c3-480b-82fd-4319d0089124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2bd20e2b9b141728b7866106a461bac', 'request_id': 'req-601768c3-66c3-480b-82fd-4319d0089124'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:21.626155 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:21.628802 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-601768c3-66c3-480b-82fd-4319d0089124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2bd20e2b9b141728b7866106a461bac', 'request_id': 'req-601768c3-66c3-480b-82fd-4319d0089124'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:21.641758 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-601768c3-66c3-480b-82fd-4319d0089124 admin admin] The token cache is being invalidate because project d2bd20e2b9b141728b7866106a461bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:43:21.642044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-601768c3-66c3-480b-82fd-4319d0089124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:21.642663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-601768c3-66c3-480b-82fd-4319d0089124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:21.644147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1308/2594] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:43:21 2022] DELETE /identity/v3/projects/d2bd20e2b9b141728b7866106a461bac => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:21.648099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4b039-ff99-44e1-aebd-f12c89bc41ff service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:21.657736 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4b039-ff99-44e1-aebd-f12c89bc41ff service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:21.714214 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9292f28-b7da-4c75-b8d8-9c4053b65b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:21.714866 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9292f28-b7da-4c75-b8d8-9c4053b65b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:21.715149 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9292f28-b7da-4c75-b8d8-9c4053b65b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:21.715422 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9292f28-b7da-4c75-b8d8-9c4053b65b97 admin admin] PATH_INFO: `/v3/users/7277605c6c5d4d3090e91fef66636c0e` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:21.716536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9292f28-b7da-4c75-b8d8-9c4053b65b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7277605c6c5d4d3090e91fef66636c0e)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:21.718541 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9292f28-b7da-4c75-b8d8-9c4053b65b97 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:21.763604 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f9292f28-b7da-4c75-b8d8-9c4053b65b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7277605c6c5d4d3090e91fef66636c0e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:21.764240 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f9292f28-b7da-4c75-b8d8-9c4053b65b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7277605c6c5d4d3090e91fef66636c0e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:21.764829 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f9292f28-b7da-4c75-b8d8-9c4053b65b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7277605c6c5d4d3090e91fef66636c0e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:21.776612 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f9292f28-b7da-4c75-b8d8-9c4053b65b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7277605c6c5d4d3090e91fef66636c0e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:21.784035 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f9292f28-b7da-4c75-b8d8-9c4053b65b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7277605c6c5d4d3090e91fef66636c0e'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:21.797271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1287/2595] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:43:21 2022] DELETE /identity/v3/users/7277605c6c5d4d3090e91fef66636c0e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:22.067665 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601768c3-66c3-480b-82fd-4319d0089124 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:22.069158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-601768c3-66c3-480b-82fd-4319d0089124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:22.082530 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601768c3-66c3-480b-82fd-4319d0089124 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:22.141362 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490a3cc-e0f2-42ee-99fe-f3b31b18d8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:22.142016 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490a3cc-e0f2-42ee-99fe-f3b31b18d8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:22.142295 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490a3cc-e0f2-42ee-99fe-f3b31b18d8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:22.142565 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490a3cc-e0f2-42ee-99fe-f3b31b18d8cf admin admin] PATH_INFO: `/v3/projects/7c582272cb1a4cd5ace9b752a6341cef` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:22.143710 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490a3cc-e0f2-42ee-99fe-f3b31b18d8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c582272cb1a4cd5ace9b752a6341cef)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:22.145584 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490a3cc-e0f2-42ee-99fe-f3b31b18d8cf admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:22.193900 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4490a3cc-e0f2-42ee-99fe-f3b31b18d8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c582272cb1a4cd5ace9b752a6341cef', 'request_id': 'req-4490a3cc-e0f2-42ee-99fe-f3b31b18d8cf'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:22.200930 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4490a3cc-e0f2-42ee-99fe-f3b31b18d8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c582272cb1a4cd5ace9b752a6341cef', 'request_id': 'req-4490a3cc-e0f2-42ee-99fe-f3b31b18d8cf'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:22.206915 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4490a3cc-e0f2-42ee-99fe-f3b31b18d8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c582272cb1a4cd5ace9b752a6341cef', 'request_id': 'req-4490a3cc-e0f2-42ee-99fe-f3b31b18d8cf'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:22.220248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4490a3cc-e0f2-42ee-99fe-f3b31b18d8cf admin admin] The token cache is being invalidate because project 7c582272cb1a4cd5ace9b752a6341cef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:43:22.220532 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4490a3cc-e0f2-42ee-99fe-f3b31b18d8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:22.221150 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-4490a3cc-e0f2-42ee-99fe-f3b31b18d8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:22.222592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1309/2596] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:43:22 2022] DELETE /identity/v3/projects/7c582272cb1a4cd5ace9b752a6341cef => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:22.226489 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9292f28-b7da-4c75-b8d8-9c4053b65b97 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:22.227958 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f9292f28-b7da-4c75-b8d8-9c4053b65b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:22.241796 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9292f28-b7da-4c75-b8d8-9c4053b65b97 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:22.274669 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:22.303095 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f6e1d-0bf2-4997-827c-ff9cc4c42fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:22.303756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f6e1d-0bf2-4997-827c-ff9cc4c42fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:22.304035 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f6e1d-0bf2-4997-827c-ff9cc4c42fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:22.304306 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f6e1d-0bf2-4997-827c-ff9cc4c42fa9 admin admin] PATH_INFO: `/v3/users/c337f3cf0da64ff1b272f6f848a7f53d` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:22.305411 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f6e1d-0bf2-4997-827c-ff9cc4c42fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c337f3cf0da64ff1b272f6f848a7f53d)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:22.307371 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f6e1d-0bf2-4997-827c-ff9cc4c42fa9 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:22.354125 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-305f6e1d-0bf2-4997-827c-ff9cc4c42fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c337f3cf0da64ff1b272f6f848a7f53d'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:22.354789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-305f6e1d-0bf2-4997-827c-ff9cc4c42fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c337f3cf0da64ff1b272f6f848a7f53d'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:22.355418 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-305f6e1d-0bf2-4997-827c-ff9cc4c42fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c337f3cf0da64ff1b272f6f848a7f53d'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:22.367368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-305f6e1d-0bf2-4997-827c-ff9cc4c42fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c337f3cf0da64ff1b272f6f848a7f53d'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:22.374121 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-305f6e1d-0bf2-4997-827c-ff9cc4c42fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c337f3cf0da64ff1b272f6f848a7f53d'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:22.386750 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1288/2597] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:43:22 2022] DELETE /identity/v3/users/c337f3cf0da64ff1b272f6f848a7f53d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:22.664720 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490a3cc-e0f2-42ee-99fe-f3b31b18d8cf admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:22.666215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4490a3cc-e0f2-42ee-99fe-f3b31b18d8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:22.679784 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490a3cc-e0f2-42ee-99fe-f3b31b18d8cf admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:22.743911 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f16aee-d7e6-4288-9223-41a69bc513e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:22.744566 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f16aee-d7e6-4288-9223-41a69bc513e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:22.744844 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f16aee-d7e6-4288-9223-41a69bc513e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:22.745110 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f16aee-d7e6-4288-9223-41a69bc513e8 admin admin] PATH_INFO: `/v3/projects/7fe4d84bff774508879ef576994557c0` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:22.746235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f16aee-d7e6-4288-9223-41a69bc513e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fe4d84bff774508879ef576994557c0)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:22.748197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f16aee-d7e6-4288-9223-41a69bc513e8 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:22.769981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:22.795450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-46f16aee-d7e6-4288-9223-41a69bc513e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fe4d84bff774508879ef576994557c0', 'request_id': 'req-46f16aee-d7e6-4288-9223-41a69bc513e8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:22.801457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-46f16aee-d7e6-4288-9223-41a69bc513e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fe4d84bff774508879ef576994557c0', 'request_id': 'req-46f16aee-d7e6-4288-9223-41a69bc513e8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:22.806874 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-46f16aee-d7e6-4288-9223-41a69bc513e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fe4d84bff774508879ef576994557c0', 'request_id': 'req-46f16aee-d7e6-4288-9223-41a69bc513e8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:22.820835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-46f16aee-d7e6-4288-9223-41a69bc513e8 admin admin] The token cache is being invalidate because project 7fe4d84bff774508879ef576994557c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:43:22.821147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-46f16aee-d7e6-4288-9223-41a69bc513e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:22.821764 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-46f16aee-d7e6-4288-9223-41a69bc513e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:22.823289 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1310/2598] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:43:22 2022] DELETE /identity/v3/projects/7fe4d84bff774508879ef576994557c0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:22.828766 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb5936-c0ed-4a93-9b76-af0a4ab55641 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:22.829072 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb5936-c0ed-4a93-9b76-af0a4ab55641 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:22.829334 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb5936-c0ed-4a93-9b76-af0a4ab55641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:22.849380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-f4eb5936-c0ed-4a93-9b76-af0a4ab55641 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:43:22.850593 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f4eb5936-c0ed-4a93-9b76-af0a4ab55641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:22.908622 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1289/2599] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:43:22.917941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b040913-cca6-41e2-afd1-30c7df9696d6 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:22.918223 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b040913-cca6-41e2-afd1-30c7df9696d6 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:22.918496 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b040913-cca6-41e2-afd1-30c7df9696d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:22.938610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-5b040913-cca6-41e2-afd1-30c7df9696d6 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:43:22.939838 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-5b040913-cca6-41e2-afd1-30c7df9696d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:22.947593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1311/2600] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:43:22.951783 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb5936-c0ed-4a93-9b76-af0a4ab55641 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:22.962142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb5936-c0ed-4a93-9b76-af0a4ab55641 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:22.966853 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7e41f-6084-4026-9ba7-885633c74e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:22.967452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7e41f-6084-4026-9ba7-885633c74e18 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:22.967732 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7e41f-6084-4026-9ba7-885633c74e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:22.968004 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7e41f-6084-4026-9ba7-885633c74e18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:22.969227 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7e41f-6084-4026-9ba7-885633c74e18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:43:22.969526 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7e41f-6084-4026-9ba7-885633c74e18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:22.971122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7e41f-6084-4026-9ba7-885633c74e18 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:22.982456 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1290/2601] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:43:22.987507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b040913-cca6-41e2-afd1-30c7df9696d6 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:22.996558 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b040913-cca6-41e2-afd1-30c7df9696d6 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:23.001351 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5eff5-f38f-40ab-b278-dc502610c2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:23.001927 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5eff5-f38f-40ab-b278-dc502610c2bf admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:23.002206 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5eff5-f38f-40ab-b278-dc502610c2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:23.002477 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5eff5-f38f-40ab-b278-dc502610c2bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:23.003138 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5eff5-f38f-40ab-b278-dc502610c2bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:23.005003 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5eff5-f38f-40ab-b278-dc502610c2bf admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:23.031807 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1312/2602] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:43:22 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:43:23.035993 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7e41f-6084-4026-9ba7-885633c74e18 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:23.045853 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7e41f-6084-4026-9ba7-885633c74e18 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:23.085977 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:23.103405 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1d478-e34c-4857-af35-61cd79422d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:23.104000 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1d478-e34c-4857-af35-61cd79422d60 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:23.104279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1d478-e34c-4857-af35-61cd79422d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:23.104575 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1d478-e34c-4857-af35-61cd79422d60 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:23.105204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1d478-e34c-4857-af35-61cd79422d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:23.107176 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1d478-e34c-4857-af35-61cd79422d60 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:23.132728 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1291/2603] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:43:23 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:43:23.136840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5eff5-f38f-40ab-b278-dc502610c2bf admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:23.146987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5eff5-f38f-40ab-b278-dc502610c2bf admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:23.152154 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86628a1-0640-4bb8-8436-e98e3022ff5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:23.152739 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86628a1-0640-4bb8-8436-e98e3022ff5e admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:23.153020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86628a1-0640-4bb8-8436-e98e3022ff5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:23.153294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86628a1-0640-4bb8-8436-e98e3022ff5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:23.153923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86628a1-0640-4bb8-8436-e98e3022ff5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:23.155517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86628a1-0640-4bb8-8436-e98e3022ff5e admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:23.165244 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1313/2604] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:43:23.168966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1d478-e34c-4857-af35-61cd79422d60 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:23.179432 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1d478-e34c-4857-af35-61cd79422d60 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:23.184182 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70967f-9967-44af-b1bf-e1abfbc4c050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:23.184767 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70967f-9967-44af-b1bf-e1abfbc4c050 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:23.185043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70967f-9967-44af-b1bf-e1abfbc4c050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:23.185310 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70967f-9967-44af-b1bf-e1abfbc4c050 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:23.185934 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70967f-9967-44af-b1bf-e1abfbc4c050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:23.188222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70967f-9967-44af-b1bf-e1abfbc4c050 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:23.198798 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1292/2605] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:43:23.203095 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86628a1-0640-4bb8-8436-e98e3022ff5e admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:23.213175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86628a1-0640-4bb8-8436-e98e3022ff5e admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:23.217829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034f40a-bd82-4586-b735-0974a5ba6568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:23.218581 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034f40a-bd82-4586-b735-0974a5ba6568 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:23.218894 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034f40a-bd82-4586-b735-0974a5ba6568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:23.219177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034f40a-bd82-4586-b735-0974a5ba6568 admin admin] PATH_INFO: `/v3/projects/ca0f7971ecbf40bc8ded6c942ed4c5b1/users/932b9e7b7ca24381a5ddfb3b04011a16/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:23.233486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034f40a-bd82-4586-b735-0974a5ba6568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0f7971ecbf40bc8ded6c942ed4c5b1, user_id=932b9e7b7ca24381a5ddfb3b04011a16, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:23.236631 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034f40a-bd82-4586-b735-0974a5ba6568 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:23.248755 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1314/2606] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:43:23 2022] PUT /identity/v3/projects/ca0f7971ecbf40bc8ded6c942ed4c5b1/users/932b9e7b7ca24381a5ddfb3b04011a16/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:23.259492 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21464071-1f98-45b2-af45-ee8834daa489 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:23.259993 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21464071-1f98-45b2-af45-ee8834daa489 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:23.260090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21464071-1f98-45b2-af45-ee8834daa489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:23.286750 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-21464071-1f98-45b2-af45-ee8834daa489 None None] MFA Rules not processed for user `932b9e7b7ca24381a5ddfb3b04011a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:43:23.287987 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-21464071-1f98-45b2-af45-ee8834daa489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:23.353001 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1293/2607] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:43:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:43:23.366059 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034f40a-bd82-4586-b735-0974a5ba6568 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:23.367783 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4034f40a-bd82-4586-b735-0974a5ba6568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:23.424207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034f40a-bd82-4586-b735-0974a5ba6568 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:23.427768 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e316e8-a28d-44b7-9e25-735a119f36bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15538b95acef435798ff7651fc1710cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:23.428357 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e316e8-a28d-44b7-9e25-735a119f36bc service glance] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:23.428634 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e316e8-a28d-44b7-9e25-735a119f36bc service glance] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:23.428904 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e316e8-a28d-44b7-9e25-735a119f36bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:23.437617 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e316e8-a28d-44b7-9e25-735a119f36bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:23.439052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e316e8-a28d-44b7-9e25-735a119f36bc service glance] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:23.447652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1315/2608] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:43:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:43:32.359103 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21464071-1f98-45b2-af45-ee8834daa489 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:32.360854 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-21464071-1f98-45b2-af45-ee8834daa489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:32.424830 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21464071-1f98-45b2-af45-ee8834daa489 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:32.428594 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1fd52-4755-44bd-a05f-57dccc7f4ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:32.429327 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1fd52-4755-44bd-a05f-57dccc7f4ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:32.429735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1fd52-4755-44bd-a05f-57dccc7f4ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:32.429971 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1fd52-4755-44bd-a05f-57dccc7f4ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:32.431960 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-85a1fd52-4755-44bd-a05f-57dccc7f4ba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:32.495506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1fd52-4755-44bd-a05f-57dccc7f4ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:32.496955 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1fd52-4755-44bd-a05f-57dccc7f4ba6 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:32.506628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1294/2609] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:43:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:43:33.443745 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:37.571238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e316e8-a28d-44b7-9e25-735a119f36bc service glance] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:37.580639 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e316e8-a28d-44b7-9e25-735a119f36bc service glance] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:37.584363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03575f7c-b2fc-4c85-aac4-a7d11302c313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:37.585224 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03575f7c-b2fc-4c85-aac4-a7d11302c313 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:37.585224 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03575f7c-b2fc-4c85-aac4-a7d11302c313 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:37.585451 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03575f7c-b2fc-4c85-aac4-a7d11302c313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:37.587154 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-03575f7c-b2fc-4c85-aac4-a7d11302c313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:37.650802 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03575f7c-b2fc-4c85-aac4-a7d11302c313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:37.652273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03575f7c-b2fc-4c85-aac4-a7d11302c313 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:37.663300 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1316/2610] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:43:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:43:40.463937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1fd52-4755-44bd-a05f-57dccc7f4ba6 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:40.465396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-85a1fd52-4755-44bd-a05f-57dccc7f4ba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:40.472221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:40.565522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1fd52-4755-44bd-a05f-57dccc7f4ba6 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:40.569713 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4421645-4211-44e5-876a-044b50989fd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7a1b839a6f4bdb9870217fa4d2527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:40.570457 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4421645-4211-44e5-876a-044b50989fd6 service placement] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:40.570887 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4421645-4211-44e5-876a-044b50989fd6 service placement] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:40.571259 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4421645-4211-44e5-876a-044b50989fd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:40.573790 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e4421645-4211-44e5-876a-044b50989fd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:40.586534 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4421645-4211-44e5-876a-044b50989fd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:40.588173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4421645-4211-44e5-876a-044b50989fd6 service placement] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:40.598467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1295/2611] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:43:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:43:43.677425 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03575f7c-b2fc-4c85-aac4-a7d11302c313 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:43.679947 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-03575f7c-b2fc-4c85-aac4-a7d11302c313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:43.693332 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03575f7c-b2fc-4c85-aac4-a7d11302c313 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:43.697936 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce69c66-6906-4b0f-a1ee-6080713ac0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:43.698549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce69c66-6906-4b0f-a1ee-6080713ac0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:43.698840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce69c66-6906-4b0f-a1ee-6080713ac0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:43.699148 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce69c66-6906-4b0f-a1ee-6080713ac0ec admin admin] PATH_INFO: `/v3/users/bfafb0b4dd5c43e0add92a9eae7677b8` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:43.700257 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce69c66-6906-4b0f-a1ee-6080713ac0ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfafb0b4dd5c43e0add92a9eae7677b8)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:43.702138 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce69c66-6906-4b0f-a1ee-6080713ac0ec admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:43.748554 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6ce69c66-6906-4b0f-a1ee-6080713ac0ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfafb0b4dd5c43e0add92a9eae7677b8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:43.749200 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6ce69c66-6906-4b0f-a1ee-6080713ac0ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfafb0b4dd5c43e0add92a9eae7677b8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:43.749809 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6ce69c66-6906-4b0f-a1ee-6080713ac0ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfafb0b4dd5c43e0add92a9eae7677b8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:43.761664 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6ce69c66-6906-4b0f-a1ee-6080713ac0ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfafb0b4dd5c43e0add92a9eae7677b8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:43.768671 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6ce69c66-6906-4b0f-a1ee-6080713ac0ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfafb0b4dd5c43e0add92a9eae7677b8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:43.781323 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1317/2612] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:43:43 2022] DELETE /identity/v3/users/bfafb0b4dd5c43e0add92a9eae7677b8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:43.956367 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4421645-4211-44e5-876a-044b50989fd6 service placement] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:43.967787 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4421645-4211-44e5-876a-044b50989fd6 service placement] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:44.024386 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbf7a1-f0bc-4a9b-a2a8-2f5b5f1e6555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:44.024932 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbf7a1-f0bc-4a9b-a2a8-2f5b5f1e6555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:44.025209 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbf7a1-f0bc-4a9b-a2a8-2f5b5f1e6555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:44.025481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbf7a1-f0bc-4a9b-a2a8-2f5b5f1e6555 admin admin] PATH_INFO: `/v3/projects/c3d973be917e4fd1bcadf1873766e466` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:44.026853 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbf7a1-f0bc-4a9b-a2a8-2f5b5f1e6555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d973be917e4fd1bcadf1873766e466)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:44.028746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbf7a1-f0bc-4a9b-a2a8-2f5b5f1e6555 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:44.073778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8ecbf7a1-f0bc-4a9b-a2a8-2f5b5f1e6555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d973be917e4fd1bcadf1873766e466', 'request_id': 'req-8ecbf7a1-f0bc-4a9b-a2a8-2f5b5f1e6555'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:44.079672 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8ecbf7a1-f0bc-4a9b-a2a8-2f5b5f1e6555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d973be917e4fd1bcadf1873766e466', 'request_id': 'req-8ecbf7a1-f0bc-4a9b-a2a8-2f5b5f1e6555'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:44.085897 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8ecbf7a1-f0bc-4a9b-a2a8-2f5b5f1e6555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d973be917e4fd1bcadf1873766e466', 'request_id': 'req-8ecbf7a1-f0bc-4a9b-a2a8-2f5b5f1e6555'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:44.097925 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8ecbf7a1-f0bc-4a9b-a2a8-2f5b5f1e6555 admin admin] The token cache is being invalidate because project c3d973be917e4fd1bcadf1873766e466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:43:44.098216 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8ecbf7a1-f0bc-4a9b-a2a8-2f5b5f1e6555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:44.098878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-8ecbf7a1-f0bc-4a9b-a2a8-2f5b5f1e6555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:44.100337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1296/2613] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:43:43 2022] DELETE /identity/v3/projects/c3d973be917e4fd1bcadf1873766e466 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:44.104471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce69c66-6906-4b0f-a1ee-6080713ac0ec admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:44.105921 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6ce69c66-6906-4b0f-a1ee-6080713ac0ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:44.121260 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce69c66-6906-4b0f-a1ee-6080713ac0ec admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:44.180055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0386ce9-e65a-4d2e-bd5a-a20f939e814a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:44.180672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0386ce9-e65a-4d2e-bd5a-a20f939e814a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:44.180949 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0386ce9-e65a-4d2e-bd5a-a20f939e814a admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:44.181225 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0386ce9-e65a-4d2e-bd5a-a20f939e814a admin admin] PATH_INFO: `/v3/users/de9e1efe97584046a0f92369d6a5ee00` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:44.182335 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0386ce9-e65a-4d2e-bd5a-a20f939e814a admin admin] RBAC: Authorizing `identity:delete_user(user_id=de9e1efe97584046a0f92369d6a5ee00)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:44.184260 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0386ce9-e65a-4d2e-bd5a-a20f939e814a admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:44.190145 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:44.231563 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f0386ce9-e65a-4d2e-bd5a-a20f939e814a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de9e1efe97584046a0f92369d6a5ee00'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:44.232203 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f0386ce9-e65a-4d2e-bd5a-a20f939e814a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de9e1efe97584046a0f92369d6a5ee00'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:44.232796 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f0386ce9-e65a-4d2e-bd5a-a20f939e814a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de9e1efe97584046a0f92369d6a5ee00'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:44.244883 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f0386ce9-e65a-4d2e-bd5a-a20f939e814a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de9e1efe97584046a0f92369d6a5ee00'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:44.252204 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-f0386ce9-e65a-4d2e-bd5a-a20f939e814a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de9e1efe97584046a0f92369d6a5ee00'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:44.265258 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1318/2614] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:43:44 2022] DELETE /identity/v3/users/de9e1efe97584046a0f92369d6a5ee00 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:44.450765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbf7a1-f0bc-4a9b-a2a8-2f5b5f1e6555 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:44.452587 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8ecbf7a1-f0bc-4a9b-a2a8-2f5b5f1e6555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:44.469818 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbf7a1-f0bc-4a9b-a2a8-2f5b5f1e6555 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:44.493283 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:44.537665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8b0af-6471-4d8e-88d4-0f8d824106d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:44.539359 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8b0af-6471-4d8e-88d4-0f8d824106d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:44.539636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8b0af-6471-4d8e-88d4-0f8d824106d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:44.539910 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8b0af-6471-4d8e-88d4-0f8d824106d4 admin admin] PATH_INFO: `/v3/projects/a5faf6bb04874abf99154ce87c40e780` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:44.541036 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8b0af-6471-4d8e-88d4-0f8d824106d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5faf6bb04874abf99154ce87c40e780)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:44.543083 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8b0af-6471-4d8e-88d4-0f8d824106d4 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:44.599985 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-88c8b0af-6471-4d8e-88d4-0f8d824106d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5faf6bb04874abf99154ce87c40e780', 'request_id': 'req-88c8b0af-6471-4d8e-88d4-0f8d824106d4'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:44.609146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-88c8b0af-6471-4d8e-88d4-0f8d824106d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5faf6bb04874abf99154ce87c40e780', 'request_id': 'req-88c8b0af-6471-4d8e-88d4-0f8d824106d4'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:44.616691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-88c8b0af-6471-4d8e-88d4-0f8d824106d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5faf6bb04874abf99154ce87c40e780', 'request_id': 'req-88c8b0af-6471-4d8e-88d4-0f8d824106d4'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:44.630571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-88c8b0af-6471-4d8e-88d4-0f8d824106d4 admin admin] The token cache is being invalidate because project a5faf6bb04874abf99154ce87c40e780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:43:44.631031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-88c8b0af-6471-4d8e-88d4-0f8d824106d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:44.631765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-88c8b0af-6471-4d8e-88d4-0f8d824106d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:44.633762 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1297/2615] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:43:44 2022] DELETE /identity/v3/projects/a5faf6bb04874abf99154ce87c40e780 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:51.664047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0386ce9-e65a-4d2e-bd5a-a20f939e814a admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:51.665402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f0386ce9-e65a-4d2e-bd5a-a20f939e814a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:51.678612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0386ce9-e65a-4d2e-bd5a-a20f939e814a admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:51.735812 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62df5b-6103-4015-ade5-735987e606c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:51.736435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62df5b-6103-4015-ade5-735987e606c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:51.736720 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62df5b-6103-4015-ade5-735987e606c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:51.736998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62df5b-6103-4015-ade5-735987e606c4 admin admin] PATH_INFO: `/v3/users/932b9e7b7ca24381a5ddfb3b04011a16` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:51.738123 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62df5b-6103-4015-ade5-735987e606c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=932b9e7b7ca24381a5ddfb3b04011a16)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:51.740061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62df5b-6103-4015-ade5-735987e606c4 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:51.785305 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9d62df5b-6103-4015-ade5-735987e606c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932b9e7b7ca24381a5ddfb3b04011a16'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:51.785942 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9d62df5b-6103-4015-ade5-735987e606c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932b9e7b7ca24381a5ddfb3b04011a16'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:51.786543 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9d62df5b-6103-4015-ade5-735987e606c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932b9e7b7ca24381a5ddfb3b04011a16'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:51.798998 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9d62df5b-6103-4015-ade5-735987e606c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932b9e7b7ca24381a5ddfb3b04011a16'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:51.805654 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9d62df5b-6103-4015-ade5-735987e606c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932b9e7b7ca24381a5ddfb3b04011a16'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:51.818695 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1319/2616] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:43:51 2022] DELETE /identity/v3/users/932b9e7b7ca24381a5ddfb3b04011a16 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:43:51.823233 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041e7b-abbf-408f-8c61-c7a689a00698 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:51.823707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041e7b-abbf-408f-8c61-c7a689a00698 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:51.823819 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041e7b-abbf-408f-8c61-c7a689a00698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:51.842654 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2d041e7b-abbf-408f-8c61-c7a689a00698 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:43:51.843870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2d041e7b-abbf-408f-8c61-c7a689a00698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:51.902273 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1298/2617] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:43:51.912183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62df5b-6103-4015-ade5-735987e606c4 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:51.913600 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-9d62df5b-6103-4015-ade5-735987e606c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:51.920184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:51.974682 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62df5b-6103-4015-ade5-735987e606c4 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:51.978332 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c6ce9-6e73-4f6e-88f1-3e25a73f6a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:51.978962 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c6ce9-6e73-4f6e-88f1-3e25a73f6a69 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:51.979245 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c6ce9-6e73-4f6e-88f1-3e25a73f6a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:51.979520 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c6ce9-6e73-4f6e-88f1-3e25a73f6a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:51.989014 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c6ce9-6e73-4f6e-88f1-3e25a73f6a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:51.990412 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c6ce9-6e73-4f6e-88f1-3e25a73f6a69 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:51.999727 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1320/2618] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:43:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:43:52.258757 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d041e7b-abbf-408f-8c61-c7a689a00698 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:43:52.260419 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2d041e7b-abbf-408f-8c61-c7a689a00698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:43:52.272583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d041e7b-abbf-408f-8c61-c7a689a00698 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:43:52.277352 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c79f4-1a0e-4b8d-afa3-1731075e305f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:43:52.277982 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c79f4-1a0e-4b8d-afa3-1731075e305f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:43:52.278263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c79f4-1a0e-4b8d-afa3-1731075e305f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:43:52.278540 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c79f4-1a0e-4b8d-afa3-1731075e305f admin admin] PATH_INFO: `/v3/projects/ca0f7971ecbf40bc8ded6c942ed4c5b1` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:43:52.279735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c79f4-1a0e-4b8d-afa3-1731075e305f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0f7971ecbf40bc8ded6c942ed4c5b1)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:43:52.282331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c79f4-1a0e-4b8d-afa3-1731075e305f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:43:52.329886 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-341c79f4-1a0e-4b8d-afa3-1731075e305f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0f7971ecbf40bc8ded6c942ed4c5b1', 'request_id': 'req-341c79f4-1a0e-4b8d-afa3-1731075e305f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:52.331082 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:52.336467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-341c79f4-1a0e-4b8d-afa3-1731075e305f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0f7971ecbf40bc8ded6c942ed4c5b1', 'request_id': 'req-341c79f4-1a0e-4b8d-afa3-1731075e305f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:52.343841 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-341c79f4-1a0e-4b8d-afa3-1731075e305f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0f7971ecbf40bc8ded6c942ed4c5b1', 'request_id': 'req-341c79f4-1a0e-4b8d-afa3-1731075e305f'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:52.357719 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-341c79f4-1a0e-4b8d-afa3-1731075e305f admin admin] The token cache is being invalidate because project ca0f7971ecbf40bc8ded6c942ed4c5b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:43:52.358006 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-341c79f4-1a0e-4b8d-afa3-1731075e305f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:52.358631 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-341c79f4-1a0e-4b8d-afa3-1731075e305f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:43:52.360199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1299/2619] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:43:52 2022] DELETE /identity/v3/projects/ca0f7971ecbf40bc8ded6c942ed4c5b1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:44:01.248184 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c6ce9-6e73-4f6e-88f1-3e25a73f6a69 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:44:01.250112 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-299c6ce9-6e73-4f6e-88f1-3e25a73f6a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:44:01.323602 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c6ce9-6e73-4f6e-88f1-3e25a73f6a69 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:44:01.385672 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377972af-1af6-40fa-afb5-f2df41fb991b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:44:01.386265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377972af-1af6-40fa-afb5-f2df41fb991b service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:01.386548 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377972af-1af6-40fa-afb5-f2df41fb991b service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:01.386837 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377972af-1af6-40fa-afb5-f2df41fb991b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:01.388608 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-377972af-1af6-40fa-afb5-f2df41fb991b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:44:01.430549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:01.447925 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377972af-1af6-40fa-afb5-f2df41fb991b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:44:01.449506 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377972af-1af6-40fa-afb5-f2df41fb991b service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:44:01.458951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1321/2620] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:44:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:44:02.354302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:DELETE=3,keystone:SELECT=6,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:11.454615 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=8 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:18.283978 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c79f4-1a0e-4b8d-afa3-1731075e305f admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:44:18.286415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-341c79f4-1a0e-4b8d-afa3-1731075e305f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:44:18.457718 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c79f4-1a0e-4b8d-afa3-1731075e305f admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:44:18.462890 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a626a2-7f0e-42af-b276-c50d6d905021 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7a1b839a6f4bdb9870217fa4d2527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:44:18.463493 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a626a2-7f0e-42af-b276-c50d6d905021 service placement] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:18.463766 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a626a2-7f0e-42af-b276-c50d6d905021 service placement] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:18.464034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a626a2-7f0e-42af-b276-c50d6d905021 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:18.465749 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-33a626a2-7f0e-42af-b276-c50d6d905021 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:44:18.478310 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a626a2-7f0e-42af-b276-c50d6d905021 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:44:18.480108 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a626a2-7f0e-42af-b276-c50d6d905021 service placement] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:44:18.491434 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1300/2621] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:44:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:44:22.474592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9ec64-755a-4b91-9e19-07c6ededafa1 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:22.475134 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9ec64-755a-4b91-9e19-07c6ededafa1 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:22.475243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9ec64-755a-4b91-9e19-07c6ededafa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:22.510883 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-dac9ec64-755a-4b91-9e19-07c6ededafa1 None None] MFA Rules not processed for user `6f4696c410f343709be200dee463bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:44:22.512103 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-dac9ec64-755a-4b91-9e19-07c6ededafa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:44:22.583808 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1322/2622] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 26 01:44:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:44:22.629516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a626a2-7f0e-42af-b276-c50d6d905021 service placement] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:44:22.630954 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-33a626a2-7f0e-42af-b276-c50d6d905021 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:44:22.703887 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a626a2-7f0e-42af-b276-c50d6d905021 service placement] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:44:22.709752 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfac15a-91c4-40b9-b859-3719f4069a72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c924da83d1a94c49814d2e7b5969c8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:44:22.710354 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfac15a-91c4-40b9-b859-3719f4069a72 service swift] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:22.710635 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfac15a-91c4-40b9-b859-3719f4069a72 service swift] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:22.710939 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfac15a-91c4-40b9-b859-3719f4069a72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:22.719563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfac15a-91c4-40b9-b859-3719f4069a72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:44:22.721139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfac15a-91c4-40b9-b859-3719f4069a72 service swift] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:44:22.729491 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1301/2623] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 26 01:44:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 01:44:24.181057 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9ec64-755a-4b91-9e19-07c6ededafa1 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:44:24.183345 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-dac9ec64-755a-4b91-9e19-07c6ededafa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:44:24.258426 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9ec64-755a-4b91-9e19-07c6ededafa1 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:44:24.263484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1c952-2947-4d13-9c22-b431064c9d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:44:24.264161 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1c952-2947-4d13-9c22-b431064c9d33 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:24.264505 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1c952-2947-4d13-9c22-b431064c9d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:24.264865 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1c952-2947-4d13-9c22-b431064c9d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:24.267176 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-41f1c952-2947-4d13-9c22-b431064c9d33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:44:24.368217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1c952-2947-4d13-9c22-b431064c9d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:44:24.369652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1c952-2947-4d13-9c22-b431064c9d33 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:44:24.390146 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1323/2624] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:44:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:44:28.281165 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfac15a-91c4-40b9-b859-3719f4069a72 service swift] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:44:28.283349 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4bfac15a-91c4-40b9-b859-3719f4069a72 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:44:28.306808 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfac15a-91c4-40b9-b859-3719f4069a72 service swift] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:44:28.314936 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adff9d-4be2-450f-b089-fd9a1cc43738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:44:28.315785 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adff9d-4be2-450f-b089-fd9a1cc43738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:28.316628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adff9d-4be2-450f-b089-fd9a1cc43738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:28.317119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adff9d-4be2-450f-b089-fd9a1cc43738 admin admin] PATH_INFO: `/v3/users/5b5c8f664d1c4b4599c1d459782e02d3` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:28.318460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adff9d-4be2-450f-b089-fd9a1cc43738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b5c8f664d1c4b4599c1d459782e02d3)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:44:28.320984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adff9d-4be2-450f-b089-fd9a1cc43738 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:44:28.327781 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:28.378439 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-80adff9d-4be2-450f-b089-fd9a1cc43738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b5c8f664d1c4b4599c1d459782e02d3'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:44:28.379184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-80adff9d-4be2-450f-b089-fd9a1cc43738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b5c8f664d1c4b4599c1d459782e02d3'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:44:28.380013 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-80adff9d-4be2-450f-b089-fd9a1cc43738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b5c8f664d1c4b4599c1d459782e02d3'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:44:28.409972 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-80adff9d-4be2-450f-b089-fd9a1cc43738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b5c8f664d1c4b4599c1d459782e02d3'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:44:28.421569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-80adff9d-4be2-450f-b089-fd9a1cc43738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b5c8f664d1c4b4599c1d459782e02d3'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:44:28.442430 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1302/2625] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:44:28 2022] DELETE /identity/v3/users/5b5c8f664d1c4b4599c1d459782e02d3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:44:28.650215 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1c952-2947-4d13-9c22-b431064c9d33 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:44:28.662714 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1c952-2947-4d13-9c22-b431064c9d33 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:44:28.683045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:28.748205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24a5e1-8525-4590-9116-c36461b8bb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:44:28.748801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24a5e1-8525-4590-9116-c36461b8bb22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:28.749087 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24a5e1-8525-4590-9116-c36461b8bb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:28.749363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24a5e1-8525-4590-9116-c36461b8bb22 admin admin] PATH_INFO: `/v3/projects/0134e2ffc3f245699629579eee860242` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:28.750522 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24a5e1-8525-4590-9116-c36461b8bb22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0134e2ffc3f245699629579eee860242)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:44:28.752545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24a5e1-8525-4590-9116-c36461b8bb22 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:44:28.806279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8d24a5e1-8525-4590-9116-c36461b8bb22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0134e2ffc3f245699629579eee860242', 'request_id': 'req-8d24a5e1-8525-4590-9116-c36461b8bb22'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:44:28.815096 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8d24a5e1-8525-4590-9116-c36461b8bb22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0134e2ffc3f245699629579eee860242', 'request_id': 'req-8d24a5e1-8525-4590-9116-c36461b8bb22'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:44:28.822068 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8d24a5e1-8525-4590-9116-c36461b8bb22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0134e2ffc3f245699629579eee860242', 'request_id': 'req-8d24a5e1-8525-4590-9116-c36461b8bb22'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:44:28.843422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8d24a5e1-8525-4590-9116-c36461b8bb22 admin admin] The token cache is being invalidate because project 0134e2ffc3f245699629579eee860242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:44:28.843707 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8d24a5e1-8525-4590-9116-c36461b8bb22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:44:28.844428 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-8d24a5e1-8525-4590-9116-c36461b8bb22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:44:28.849532 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1324/2626] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:44:28 2022] DELETE /identity/v3/projects/0134e2ffc3f245699629579eee860242 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:44:28.851759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa684d-ea2f-4b28-a5a3-aaba77459813 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:28.852139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa684d-ea2f-4b28-a5a3-aaba77459813 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:28.852481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa684d-ea2f-4b28-a5a3-aaba77459813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:28.933740 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-97aa684d-ea2f-4b28-a5a3-aaba77459813 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:44:28.935122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-97aa684d-ea2f-4b28-a5a3-aaba77459813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:44:29.037887 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1303/2627] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:44:29.046856 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309207f9-25b3-43af-89db-83ca1483bc69 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:29.046856 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309207f9-25b3-43af-89db-83ca1483bc69 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:29.046856 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309207f9-25b3-43af-89db-83ca1483bc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:29.072452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-309207f9-25b3-43af-89db-83ca1483bc69 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:44:29.072452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-309207f9-25b3-43af-89db-83ca1483bc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:44:29.084292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1325/2628] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:44:29.088808 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa684d-ea2f-4b28-a5a3-aaba77459813 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:44:29.101091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa684d-ea2f-4b28-a5a3-aaba77459813 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:44:29.106134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306f5eb-070d-4b44-be6d-bd692eb4ff75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:44:29.106745 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306f5eb-070d-4b44-be6d-bd692eb4ff75 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:29.107061 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306f5eb-070d-4b44-be6d-bd692eb4ff75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:29.107332 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306f5eb-070d-4b44-be6d-bd692eb4ff75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:29.108021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306f5eb-070d-4b44-be6d-bd692eb4ff75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:44:29.108446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306f5eb-070d-4b44-be6d-bd692eb4ff75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:44:29.110484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306f5eb-070d-4b44-be6d-bd692eb4ff75 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:44:29.127312 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1304/2629] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:44:29.132115 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309207f9-25b3-43af-89db-83ca1483bc69 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:44:29.141263 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309207f9-25b3-43af-89db-83ca1483bc69 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:44:29.145859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930d8a6-1a16-4ad1-bdfb-001212e23706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:44:29.146447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930d8a6-1a16-4ad1-bdfb-001212e23706 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:29.146721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930d8a6-1a16-4ad1-bdfb-001212e23706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:29.147023 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930d8a6-1a16-4ad1-bdfb-001212e23706 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:29.147661 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930d8a6-1a16-4ad1-bdfb-001212e23706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:44:29.149530 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930d8a6-1a16-4ad1-bdfb-001212e23706 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:44:29.202284 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1326/2630] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:44:29 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:44:29.204254 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306f5eb-070d-4b44-be6d-bd692eb4ff75 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:44:29.250185 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306f5eb-070d-4b44-be6d-bd692eb4ff75 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:44:29.308725 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:29.339483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f215e-8945-4ba1-b310-daa81a685670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:44:29.340847 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f215e-8945-4ba1-b310-daa81a685670 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:29.341337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f215e-8945-4ba1-b310-daa81a685670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:29.341816 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f215e-8945-4ba1-b310-daa81a685670 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:29.342850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f215e-8945-4ba1-b310-daa81a685670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:44:29.348340 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f215e-8945-4ba1-b310-daa81a685670 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:44:29.404937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1305/2631] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:44:29 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:44:29.406229 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930d8a6-1a16-4ad1-bdfb-001212e23706 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:44:29.417889 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930d8a6-1a16-4ad1-bdfb-001212e23706 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:44:29.423152 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b4b80-48ca-49da-9cc0-2f41ac3da06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:44:29.423837 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b4b80-48ca-49da-9cc0-2f41ac3da06f admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:29.424185 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b4b80-48ca-49da-9cc0-2f41ac3da06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:29.424524 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b4b80-48ca-49da-9cc0-2f41ac3da06f admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:29.425239 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b4b80-48ca-49da-9cc0-2f41ac3da06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:44:29.426902 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b4b80-48ca-49da-9cc0-2f41ac3da06f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:44:29.451572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1327/2632] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:44:29.456130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f215e-8945-4ba1-b310-daa81a685670 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:44:29.466396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f215e-8945-4ba1-b310-daa81a685670 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:44:29.471839 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fc326-bdeb-4f38-bf94-a5202ac93cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:44:29.472445 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fc326-bdeb-4f38-bf94-a5202ac93cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:29.472722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fc326-bdeb-4f38-bf94-a5202ac93cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:29.472992 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fc326-bdeb-4f38-bf94-a5202ac93cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:29.473628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fc326-bdeb-4f38-bf94-a5202ac93cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:44:29.475253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fc326-bdeb-4f38-bf94-a5202ac93cb4 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:44:29.491818 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b4b80-48ca-49da-9cc0-2f41ac3da06f admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:44:29.492328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1306/2633] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:44:29.503726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b4b80-48ca-49da-9cc0-2f41ac3da06f admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:44:29.510870 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0171a5-05e1-43ce-a052-528b395c3e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:44:29.511689 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0171a5-05e1-43ce-a052-528b395c3e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:29.512026 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0171a5-05e1-43ce-a052-528b395c3e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:29.512359 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0171a5-05e1-43ce-a052-528b395c3e95 admin admin] PATH_INFO: `/v3/projects/f07b274501ce4c02a9ee39f621109822/users/3fdaa4ff741f4417a35931341e70446a/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:29.530849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0171a5-05e1-43ce-a052-528b395c3e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07b274501ce4c02a9ee39f621109822, user_id=3fdaa4ff741f4417a35931341e70446a, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:44:29.537849 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0171a5-05e1-43ce-a052-528b395c3e95 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:44:29.553019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1328/2634] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:44:29 2022] PUT /identity/v3/projects/f07b274501ce4c02a9ee39f621109822/users/3fdaa4ff741f4417a35931341e70446a/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:44:29.557828 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d955eb-02b0-471e-94be-4ab3227fb9bc None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:29.558102 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d955eb-02b0-471e-94be-4ab3227fb9bc None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:29.558375 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d955eb-02b0-471e-94be-4ab3227fb9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:29.579812 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-97d955eb-02b0-471e-94be-4ab3227fb9bc None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:44:29.581059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-97d955eb-02b0-471e-94be-4ab3227fb9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:44:29.655710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1307/2635] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:44:29.665718 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0171a5-05e1-43ce-a052-528b395c3e95 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:44:29.667673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-5d0171a5-05e1-43ce-a052-528b395c3e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:44:29.715684 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:29.770148 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0171a5-05e1-43ce-a052-528b395c3e95 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:44:29.774217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c5704-25c3-48be-b52f-b433e9b0e6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:44:29.774810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c5704-25c3-48be-b52f-b433e9b0e6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:29.775157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c5704-25c3-48be-b52f-b433e9b0e6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:29.775432 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c5704-25c3-48be-b52f-b433e9b0e6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:29.787792 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c5704-25c3-48be-b52f-b433e9b0e6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:44:29.789218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c5704-25c3-48be-b52f-b433e9b0e6e8 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:44:29.800600 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1329/2636] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:44:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:44:34.945361 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba7a91-b301-4109-9d4b-e96c4db88fe4 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:34.945927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba7a91-b301-4109-9d4b-e96c4db88fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:34.945927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba7a91-b301-4109-9d4b-e96c4db88fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:34.981772 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-a6ba7a91-b301-4109-9d4b-e96c4db88fe4 None None] MFA Rules not processed for user `3fdaa4ff741f4417a35931341e70446a`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:44:34.983708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a6ba7a91-b301-4109-9d4b-e96c4db88fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:44:35.075530 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1308/2637] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:44:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:44:35.092180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c5704-25c3-48be-b52f-b433e9b0e6e8 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:44:35.094297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-417c5704-25c3-48be-b52f-b433e9b0e6e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:44:35.223589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c5704-25c3-48be-b52f-b433e9b0e6e8 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:44:35.230127 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144fcc1-2701-433a-99ca-d5f07159ba2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:44:35.231165 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144fcc1-2701-433a-99ca-d5f07159ba2f service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:35.231450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144fcc1-2701-433a-99ca-d5f07159ba2f service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:35.231726 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144fcc1-2701-433a-99ca-d5f07159ba2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:35.242155 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144fcc1-2701-433a-99ca-d5f07159ba2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:44:35.243803 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144fcc1-2701-433a-99ca-d5f07159ba2f service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:44:35.253856 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1330/2638] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:44:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:44:37.640322 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fe602-859c-4914-b9f4-1d16a421ccaa None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:37.641321 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fe602-859c-4914-b9f4-1d16a421ccaa None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:37.641655 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fe602-859c-4914-b9f4-1d16a421ccaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:37.661989 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-374fe602-859c-4914-b9f4-1d16a421ccaa None None] MFA Rules not processed for user `3fdaa4ff741f4417a35931341e70446a`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:44:37.663247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-374fe602-859c-4914-b9f4-1d16a421ccaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:44:37.670555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1309/2639] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:44:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:44:38.178984 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144fcc1-2701-433a-99ca-d5f07159ba2f service nova] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:44:38.189509 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144fcc1-2701-433a-99ca-d5f07159ba2f service nova] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:44:38.193207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05959373-b0ca-442c-9c3a-fad479502f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:44:38.193799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05959373-b0ca-442c-9c3a-fad479502f05 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:38.194545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05959373-b0ca-442c-9c3a-fad479502f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:38.195017 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05959373-b0ca-442c-9c3a-fad479502f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:38.197784 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-05959373-b0ca-442c-9c3a-fad479502f05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:44:38.216257 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05959373-b0ca-442c-9c3a-fad479502f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:44:38.217967 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05959373-b0ca-442c-9c3a-fad479502f05 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:44:38.228353 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1331/2640] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:44:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:44:46.386431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a426d-790c-444c-add3-6a863a4d3bac None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:46.386986 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a426d-790c-444c-add3-6a863a4d3bac None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:46.387300 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a426d-790c-444c-add3-6a863a4d3bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:46.406726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-0b2a426d-790c-444c-add3-6a863a4d3bac None None] MFA Rules not processed for user `6f4696c410f343709be200dee463bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:44:46.408145 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0b2a426d-790c-444c-add3-6a863a4d3bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:44:46.449957 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:46.471348 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1310/2641] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 26 01:44:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:44:46.484049 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05959373-b0ca-442c-9c3a-fad479502f05 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:44:46.486068 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-05959373-b0ca-442c-9c3a-fad479502f05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:44:46.558702 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05959373-b0ca-442c-9c3a-fad479502f05 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:44:46.564588 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bc993-6ee4-4be0-8ee2-62907a3c5cfe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c924da83d1a94c49814d2e7b5969c8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:44:46.565195 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bc993-6ee4-4be0-8ee2-62907a3c5cfe service swift] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:44:46.565476 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bc993-6ee4-4be0-8ee2-62907a3c5cfe service swift] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:44:46.565751 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bc993-6ee4-4be0-8ee2-62907a3c5cfe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:44:46.574273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bc993-6ee4-4be0-8ee2-62907a3c5cfe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:44:46.575892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bc993-6ee4-4be0-8ee2-62907a3c5cfe service swift] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:44:46.585893 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1332/2642] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 26 01:44:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 01:44:56.463505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=6 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:56.582072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=99 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:45:05.792356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da9f95-059b-469c-8328-6be4cb23840a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:45:05.792886 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da9f95-059b-469c-8328-6be4cb23840a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:45:05.792886 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da9f95-059b-469c-8328-6be4cb23840a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:45:05.814778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-a5da9f95-059b-469c-8328-6be4cb23840a None None] MFA Rules not processed for user `6f4696c410f343709be200dee463bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:45:05.816021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a5da9f95-059b-469c-8328-6be4cb23840a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:45:05.823469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1311/2643] 10.222.0.26 () {58 vars in 967 bytes} [Mon Sep 26 01:45:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:45:05.837393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bc993-6ee4-4be0-8ee2-62907a3c5cfe service swift] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:45:05.849919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bc993-6ee4-4be0-8ee2-62907a3c5cfe service swift] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:45:05.855521 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ca8fd-754a-4c8c-a9bc-b339e74e93fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c924da83d1a94c49814d2e7b5969c8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:45:05.856226 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ca8fd-754a-4c8c-a9bc-b339e74e93fe service swift] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:45:05.856607 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ca8fd-754a-4c8c-a9bc-b339e74e93fe service swift] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:45:05.856983 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ca8fd-754a-4c8c-a9bc-b339e74e93fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:45:05.867201 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ca8fd-754a-4c8c-a9bc-b339e74e93fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:45:05.868751 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ca8fd-754a-4c8c-a9bc-b339e74e93fe service swift] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:45:05.880515 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1333/2644] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 26 01:45:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 01:45:15.807740 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:45:15.874097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=6 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:09.437513 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da9f95-059b-469c-8328-6be4cb23840a None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:09.447619 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da9f95-059b-469c-8328-6be4cb23840a None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:09.451157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24064e-d577-42a3-8ea9-03a20a582bf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:09.451758 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24064e-d577-42a3-8ea9-03a20a582bf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:09.452035 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24064e-d577-42a3-8ea9-03a20a582bf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:09.452308 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24064e-d577-42a3-8ea9-03a20a582bf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:09.454002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-9a24064e-d577-42a3-8ea9-03a20a582bf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:09.466565 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24064e-d577-42a3-8ea9-03a20a582bf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:09.468010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24064e-d577-42a3-8ea9-03a20a582bf8 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:09.477617 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1312/2645] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:46:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:46:12.629175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ca8fd-754a-4c8c-a9bc-b339e74e93fe service swift] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:12.630664 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-356ca8fd-754a-4c8c-a9bc-b339e74e93fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:12.644513 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ca8fd-754a-4c8c-a9bc-b339e74e93fe service swift] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:12.649179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845041a9-d31e-41d4-a685-ed9fc5a5478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:12.649809 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845041a9-d31e-41d4-a685-ed9fc5a5478e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:12.650087 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845041a9-d31e-41d4-a685-ed9fc5a5478e admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:12.650361 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845041a9-d31e-41d4-a685-ed9fc5a5478e admin admin] PATH_INFO: `/v3/users/148b0d6aee584ecab139cf93e8d32578` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:12.651462 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845041a9-d31e-41d4-a685-ed9fc5a5478e admin admin] RBAC: Authorizing `identity:delete_user(user_id=148b0d6aee584ecab139cf93e8d32578)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:12.653488 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845041a9-d31e-41d4-a685-ed9fc5a5478e admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:12.702137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-845041a9-d31e-41d4-a685-ed9fc5a5478e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '148b0d6aee584ecab139cf93e8d32578'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:12.702785 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-845041a9-d31e-41d4-a685-ed9fc5a5478e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '148b0d6aee584ecab139cf93e8d32578'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:12.703437 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-845041a9-d31e-41d4-a685-ed9fc5a5478e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '148b0d6aee584ecab139cf93e8d32578'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:12.716217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-845041a9-d31e-41d4-a685-ed9fc5a5478e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '148b0d6aee584ecab139cf93e8d32578'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:12.723260 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-845041a9-d31e-41d4-a685-ed9fc5a5478e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '148b0d6aee584ecab139cf93e8d32578'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:12.736111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1334/2646] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:46:12 2022] DELETE /identity/v3/users/148b0d6aee584ecab139cf93e8d32578 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:12.915114 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24064e-d577-42a3-8ea9-03a20a582bf8 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:12.926887 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24064e-d577-42a3-8ea9-03a20a582bf8 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:12.985209 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adaec9-d1ef-4bda-b6ef-2f91b05c1e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:12.985946 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adaec9-d1ef-4bda-b6ef-2f91b05c1e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:12.986353 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adaec9-d1ef-4bda-b6ef-2f91b05c1e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:12.987404 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adaec9-d1ef-4bda-b6ef-2f91b05c1e09 admin admin] PATH_INFO: `/v3/projects/52832793efa441adb8b69af641a4b127` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:12.988684 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adaec9-d1ef-4bda-b6ef-2f91b05c1e09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52832793efa441adb8b69af641a4b127)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:12.990935 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adaec9-d1ef-4bda-b6ef-2f91b05c1e09 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:13.039994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d2adaec9-d1ef-4bda-b6ef-2f91b05c1e09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52832793efa441adb8b69af641a4b127', 'request_id': 'req-d2adaec9-d1ef-4bda-b6ef-2f91b05c1e09'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:13.045324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d2adaec9-d1ef-4bda-b6ef-2f91b05c1e09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52832793efa441adb8b69af641a4b127', 'request_id': 'req-d2adaec9-d1ef-4bda-b6ef-2f91b05c1e09'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:13.052250 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d2adaec9-d1ef-4bda-b6ef-2f91b05c1e09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52832793efa441adb8b69af641a4b127', 'request_id': 'req-d2adaec9-d1ef-4bda-b6ef-2f91b05c1e09'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:13.064841 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d2adaec9-d1ef-4bda-b6ef-2f91b05c1e09 admin admin] The token cache is being invalidate because project 52832793efa441adb8b69af641a4b127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:46:13.065331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d2adaec9-d1ef-4bda-b6ef-2f91b05c1e09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:13.065970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d2adaec9-d1ef-4bda-b6ef-2f91b05c1e09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:13.067497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1313/2647] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:46:12 2022] DELETE /identity/v3/projects/52832793efa441adb8b69af641a4b127 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:13.072291 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3ca39-ec96-4f41-9929-a0846fb9f1eb None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:13.072582 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3ca39-ec96-4f41-9929-a0846fb9f1eb None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:13.072904 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3ca39-ec96-4f41-9929-a0846fb9f1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:13.092653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-39a3ca39-ec96-4f41-9929-a0846fb9f1eb None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:13.093859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-39a3ca39-ec96-4f41-9929-a0846fb9f1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:13.152620 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1335/2648] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:46:13.161187 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012fb90-4b82-42fd-a241-1109ea0ab16d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:13.161478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012fb90-4b82-42fd-a241-1109ea0ab16d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:13.161757 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012fb90-4b82-42fd-a241-1109ea0ab16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:13.182285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-f012fb90-4b82-42fd-a241-1109ea0ab16d None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:13.183741 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f012fb90-4b82-42fd-a241-1109ea0ab16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:13.192017 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1314/2649] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:46:13.196138 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3ca39-ec96-4f41-9929-a0846fb9f1eb None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:13.206597 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3ca39-ec96-4f41-9929-a0846fb9f1eb None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:13.211252 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70c5d3-0c00-4b87-9e58-e7528576c51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:13.211873 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70c5d3-0c00-4b87-9e58-e7528576c51e admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:13.212205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70c5d3-0c00-4b87-9e58-e7528576c51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:13.212513 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70c5d3-0c00-4b87-9e58-e7528576c51e admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:13.213278 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70c5d3-0c00-4b87-9e58-e7528576c51e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:46:13.213644 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70c5d3-0c00-4b87-9e58-e7528576c51e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:13.215879 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70c5d3-0c00-4b87-9e58-e7528576c51e admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:13.228417 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1336/2650] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:46:13.232613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012fb90-4b82-42fd-a241-1109ea0ab16d None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:13.241745 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012fb90-4b82-42fd-a241-1109ea0ab16d None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:13.246347 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c94875-9a55-497a-b7df-babcb4af318a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:13.246970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c94875-9a55-497a-b7df-babcb4af318a admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:13.247247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c94875-9a55-497a-b7df-babcb4af318a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:13.247517 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c94875-9a55-497a-b7df-babcb4af318a admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:13.248133 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c94875-9a55-497a-b7df-babcb4af318a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:13.249986 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c94875-9a55-497a-b7df-babcb4af318a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:13.286075 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1315/2651] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:46:13 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:46:13.290081 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70c5d3-0c00-4b87-9e58-e7528576c51e admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:13.299800 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70c5d3-0c00-4b87-9e58-e7528576c51e admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:13.355253 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55d04c-b5b9-4a2c-b4e3-bb9ca277329e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:13.355843 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55d04c-b5b9-4a2c-b4e3-bb9ca277329e admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:13.356117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55d04c-b5b9-4a2c-b4e3-bb9ca277329e admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:13.356387 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55d04c-b5b9-4a2c-b4e3-bb9ca277329e admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:13.357006 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55d04c-b5b9-4a2c-b4e3-bb9ca277329e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:13.358904 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55d04c-b5b9-4a2c-b4e3-bb9ca277329e admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:13.366640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:13.380649 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1337/2652] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:46:13 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:46:13.384563 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c94875-9a55-497a-b7df-babcb4af318a admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:13.395401 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c94875-9a55-497a-b7df-babcb4af318a admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:13.400018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917303e-c4ef-40bb-864a-697724630945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:13.400618 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917303e-c4ef-40bb-864a-697724630945 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:13.401039 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917303e-c4ef-40bb-864a-697724630945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:13.401325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917303e-c4ef-40bb-864a-697724630945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:13.401970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917303e-c4ef-40bb-864a-697724630945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:13.403812 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917303e-c4ef-40bb-864a-697724630945 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:13.414754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1316/2653] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:46:13.418871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55d04c-b5b9-4a2c-b4e3-bb9ca277329e admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:13.428810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55d04c-b5b9-4a2c-b4e3-bb9ca277329e admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:13.433663 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143d5cc-9a19-4014-9f2f-f8e2bd8b95a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:13.434252 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143d5cc-9a19-4014-9f2f-f8e2bd8b95a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:13.434525 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143d5cc-9a19-4014-9f2f-f8e2bd8b95a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:13.434792 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143d5cc-9a19-4014-9f2f-f8e2bd8b95a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:13.435455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143d5cc-9a19-4014-9f2f-f8e2bd8b95a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:13.437040 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143d5cc-9a19-4014-9f2f-f8e2bd8b95a9 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:13.447575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1338/2654] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:46:13.451564 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917303e-c4ef-40bb-864a-697724630945 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:13.462218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917303e-c4ef-40bb-864a-697724630945 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:13.466818 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685feca3-8bc4-4831-99aa-c1b73aaf6519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:13.467476 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685feca3-8bc4-4831-99aa-c1b73aaf6519 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:13.467756 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685feca3-8bc4-4831-99aa-c1b73aaf6519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:13.468031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685feca3-8bc4-4831-99aa-c1b73aaf6519 admin admin] PATH_INFO: `/v3/projects/3eee82d6bf904cec94bee9a88b9ced93/users/87c50914b3254c22ba3388154d99586c/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:13.482789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685feca3-8bc4-4831-99aa-c1b73aaf6519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eee82d6bf904cec94bee9a88b9ced93, user_id=87c50914b3254c22ba3388154d99586c, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:13.485431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685feca3-8bc4-4831-99aa-c1b73aaf6519 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:13.498359 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1317/2655] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:46:13 2022] PUT /identity/v3/projects/3eee82d6bf904cec94bee9a88b9ced93/users/87c50914b3254c22ba3388154d99586c/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:13.509389 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927342f3-29c7-4156-9e05-cda16b7904fb None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:13.509673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927342f3-29c7-4156-9e05-cda16b7904fb None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:13.509948 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927342f3-29c7-4156-9e05-cda16b7904fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:13.537244 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-927342f3-29c7-4156-9e05-cda16b7904fb None None] MFA Rules not processed for user `87c50914b3254c22ba3388154d99586c`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:13.538522 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-927342f3-29c7-4156-9e05-cda16b7904fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:13.605534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1339/2656] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:46:13.609948 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685feca3-8bc4-4831-99aa-c1b73aaf6519 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:13.616256 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:13.673107 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685feca3-8bc4-4831-99aa-c1b73aaf6519 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:13.678532 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42e38f-d4a2-4f8f-9e32-8583dd2cbbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:13.679161 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42e38f-d4a2-4f8f-9e32-8583dd2cbbb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:13.679456 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42e38f-d4a2-4f8f-9e32-8583dd2cbbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:13.679734 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42e38f-d4a2-4f8f-9e32-8583dd2cbbb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:13.680379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42e38f-d4a2-4f8f-9e32-8583dd2cbbb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:13.682273 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42e38f-d4a2-4f8f-9e32-8583dd2cbbb6 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:13.708434 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1318/2657] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:46:13 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:46:13.712472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927342f3-29c7-4156-9e05-cda16b7904fb None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:13.723551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927342f3-29c7-4156-9e05-cda16b7904fb None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:13.777692 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075eb0f-7163-4ee2-a3d3-978ee68411fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:13.778279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075eb0f-7163-4ee2-a3d3-978ee68411fc admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:13.778561 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075eb0f-7163-4ee2-a3d3-978ee68411fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:13.778858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075eb0f-7163-4ee2-a3d3-978ee68411fc admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:13.779498 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075eb0f-7163-4ee2-a3d3-978ee68411fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:13.781392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075eb0f-7163-4ee2-a3d3-978ee68411fc admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:13.802989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1340/2658] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:46:13 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:46:13.807060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42e38f-d4a2-4f8f-9e32-8583dd2cbbb6 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:13.817439 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42e38f-d4a2-4f8f-9e32-8583dd2cbbb6 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:13.822060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23439440-a47b-4982-a502-4e535fff8643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:13.822651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23439440-a47b-4982-a502-4e535fff8643 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:13.822966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23439440-a47b-4982-a502-4e535fff8643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:13.823240 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23439440-a47b-4982-a502-4e535fff8643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:13.823872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23439440-a47b-4982-a502-4e535fff8643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:13.825450 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23439440-a47b-4982-a502-4e535fff8643 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:13.836592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1319/2659] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:46:13.840409 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075eb0f-7163-4ee2-a3d3-978ee68411fc admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:13.850730 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075eb0f-7163-4ee2-a3d3-978ee68411fc admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:13.855330 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cf971-4740-467b-b245-17e48103ffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:13.856024 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cf971-4740-467b-b245-17e48103ffa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:13.856243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cf971-4740-467b-b245-17e48103ffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:13.856516 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cf971-4740-467b-b245-17e48103ffa1 admin admin] PATH_INFO: `/v3/projects/03a49aa15805473f9ead72294e8c2d46/users/c3ffb9593b4a4683817e519908e05e20/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:13.871533 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cf971-4740-467b-b245-17e48103ffa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a49aa15805473f9ead72294e8c2d46, user_id=c3ffb9593b4a4683817e519908e05e20, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:13.874206 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cf971-4740-467b-b245-17e48103ffa1 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:13.886778 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1341/2660] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:46:13 2022] PUT /identity/v3/projects/03a49aa15805473f9ead72294e8c2d46/users/c3ffb9593b4a4683817e519908e05e20/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:13.890685 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23439440-a47b-4982-a502-4e535fff8643 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:13.900936 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23439440-a47b-4982-a502-4e535fff8643 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:13.960125 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172c255-86bf-4765-80d5-3086de145b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:13.960861 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172c255-86bf-4765-80d5-3086de145b57 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:13.961000 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172c255-86bf-4765-80d5-3086de145b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:13.961269 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172c255-86bf-4765-80d5-3086de145b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:13.961903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172c255-86bf-4765-80d5-3086de145b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:13.963810 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172c255-86bf-4765-80d5-3086de145b57 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:13.974270 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1320/2661] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:46:13.978396 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cf971-4740-467b-b245-17e48103ffa1 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:13.988884 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cf971-4740-467b-b245-17e48103ffa1 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:13.993634 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf5f1d-1e22-4bd1-83e1-93b29bbf0675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:13.994273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf5f1d-1e22-4bd1-83e1-93b29bbf0675 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:13.994547 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf5f1d-1e22-4bd1-83e1-93b29bbf0675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:13.994822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf5f1d-1e22-4bd1-83e1-93b29bbf0675 admin admin] PATH_INFO: `/v3/projects/03a49aa15805473f9ead72294e8c2d46/users/c3ffb9593b4a4683817e519908e05e20/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:13.996752 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf5f1d-1e22-4bd1-83e1-93b29bbf0675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a49aa15805473f9ead72294e8c2d46, user_id=c3ffb9593b4a4683817e519908e05e20, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:13.999362 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf5f1d-1e22-4bd1-83e1-93b29bbf0675 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:14.009532 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1342/2662] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:46:13 2022] PUT /identity/v3/projects/03a49aa15805473f9ead72294e8c2d46/users/c3ffb9593b4a4683817e519908e05e20/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:14.021443 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e07c-11d4-4bc3-b16e-62637e438758 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:14.021732 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e07c-11d4-4bc3-b16e-62637e438758 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:14.022011 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e07c-11d4-4bc3-b16e-62637e438758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:14.049764 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-f624e07c-11d4-4bc3-b16e-62637e438758 None None] MFA Rules not processed for user `c3ffb9593b4a4683817e519908e05e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:14.051006 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f624e07c-11d4-4bc3-b16e-62637e438758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:14.114249 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:14.118646 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1321/2663] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:46:14.129397 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf5f1d-1e22-4bd1-83e1-93b29bbf0675 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:14.131098 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-dbbf5f1d-1e22-4bd1-83e1-93b29bbf0675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:14.154224 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:14.209182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf5f1d-1e22-4bd1-83e1-93b29bbf0675 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:14.213014 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43641f56-8ba2-45be-8382-964f568c1259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:14.213624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43641f56-8ba2-45be-8382-964f568c1259 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:14.213978 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43641f56-8ba2-45be-8382-964f568c1259 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:14.214298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43641f56-8ba2-45be-8382-964f568c1259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:14.270796 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43641f56-8ba2-45be-8382-964f568c1259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:14.272253 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43641f56-8ba2-45be-8382-964f568c1259 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:14.281100 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1343/2664] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:46:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:46:15.646389 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624e07c-11d4-4bc3-b16e-62637e438758 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:15.648141 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f624e07c-11d4-4bc3-b16e-62637e438758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:15.660964 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624e07c-11d4-4bc3-b16e-62637e438758 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:15.664527 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e06fc-6f36-4069-9417-16a5355e91b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:15.665064 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e06fc-6f36-4069-9417-16a5355e91b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:15.665343 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e06fc-6f36-4069-9417-16a5355e91b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:15.665615 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e06fc-6f36-4069-9417-16a5355e91b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:15.674564 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e06fc-6f36-4069-9417-16a5355e91b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:15.676019 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e06fc-6f36-4069-9417-16a5355e91b3 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:15.685672 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1322/2665] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:46:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:46:19.434681 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43641f56-8ba2-45be-8382-964f568c1259 service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:19.497588 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43641f56-8ba2-45be-8382-964f568c1259 service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:19.502988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd09dc4-fbb4-4815-b6af-964db9a9fc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:19.503640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd09dc4-fbb4-4815-b6af-964db9a9fc9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:19.503924 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd09dc4-fbb4-4815-b6af-964db9a9fc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:19.504203 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd09dc4-fbb4-4815-b6af-964db9a9fc9d admin admin] PATH_INFO: `/v3/users/87c50914b3254c22ba3388154d99586c` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:19.505326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd09dc4-fbb4-4815-b6af-964db9a9fc9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=87c50914b3254c22ba3388154d99586c)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:19.507265 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd09dc4-fbb4-4815-b6af-964db9a9fc9d admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:19.552898 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-cbd09dc4-fbb4-4815-b6af-964db9a9fc9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87c50914b3254c22ba3388154d99586c'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:19.553551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-cbd09dc4-fbb4-4815-b6af-964db9a9fc9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87c50914b3254c22ba3388154d99586c'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:19.554180 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-cbd09dc4-fbb4-4815-b6af-964db9a9fc9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87c50914b3254c22ba3388154d99586c'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:19.566111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:19.572310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-cbd09dc4-fbb4-4815-b6af-964db9a9fc9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87c50914b3254c22ba3388154d99586c'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:19.579413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-cbd09dc4-fbb4-4815-b6af-964db9a9fc9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87c50914b3254c22ba3388154d99586c'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:19.592342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1344/2666] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:46:19 2022] DELETE /identity/v3/users/87c50914b3254c22ba3388154d99586c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:19.597878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32deb801-08f0-4c05-9d1e-5d8be401d1ab None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:19.598358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32deb801-08f0-4c05-9d1e-5d8be401d1ab None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:19.598482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32deb801-08f0-4c05-9d1e-5d8be401d1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:19.619244 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-32deb801-08f0-4c05-9d1e-5d8be401d1ab None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:19.620441 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-32deb801-08f0-4c05-9d1e-5d8be401d1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:19.678280 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1323/2667] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:46:19.687754 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd09dc4-fbb4-4815-b6af-964db9a9fc9d admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:19.689162 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-cbd09dc4-fbb4-4815-b6af-964db9a9fc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:19.745456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd09dc4-fbb4-4815-b6af-964db9a9fc9d admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:19.749079 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc36939-59a0-4819-9a1e-fc6ade341a17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:19.749673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc36939-59a0-4819-9a1e-fc6ade341a17 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:19.749941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc36939-59a0-4819-9a1e-fc6ade341a17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:19.750208 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc36939-59a0-4819-9a1e-fc6ade341a17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:19.759023 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc36939-59a0-4819-9a1e-fc6ade341a17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:19.760416 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc36939-59a0-4819-9a1e-fc6ade341a17 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:19.769699 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1345/2668] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:46:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:46:20.030941 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32deb801-08f0-4c05-9d1e-5d8be401d1ab None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:20.032430 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-32deb801-08f0-4c05-9d1e-5d8be401d1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:20.045428 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32deb801-08f0-4c05-9d1e-5d8be401d1ab None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:20.050724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bac686-8005-49e1-888d-5fccc24f55e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:20.051415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bac686-8005-49e1-888d-5fccc24f55e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:20.051699 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bac686-8005-49e1-888d-5fccc24f55e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:20.051978 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bac686-8005-49e1-888d-5fccc24f55e2 admin admin] PATH_INFO: `/v3/projects/3eee82d6bf904cec94bee9a88b9ced93` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:20.053121 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bac686-8005-49e1-888d-5fccc24f55e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eee82d6bf904cec94bee9a88b9ced93)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:20.055087 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bac686-8005-49e1-888d-5fccc24f55e2 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:20.102056 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c1bac686-8005-49e1-888d-5fccc24f55e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eee82d6bf904cec94bee9a88b9ced93', 'request_id': 'req-c1bac686-8005-49e1-888d-5fccc24f55e2'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:20.107720 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c1bac686-8005-49e1-888d-5fccc24f55e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eee82d6bf904cec94bee9a88b9ced93', 'request_id': 'req-c1bac686-8005-49e1-888d-5fccc24f55e2'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:20.115015 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c1bac686-8005-49e1-888d-5fccc24f55e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eee82d6bf904cec94bee9a88b9ced93', 'request_id': 'req-c1bac686-8005-49e1-888d-5fccc24f55e2'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:20.128435 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c1bac686-8005-49e1-888d-5fccc24f55e2 admin admin] The token cache is being invalidate because project 3eee82d6bf904cec94bee9a88b9ced93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:46:20.128722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c1bac686-8005-49e1-888d-5fccc24f55e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:20.129350 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c1bac686-8005-49e1-888d-5fccc24f55e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:20.130883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1324/2669] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:46:20 2022] DELETE /identity/v3/projects/3eee82d6bf904cec94bee9a88b9ced93 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:20.134864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc36939-59a0-4819-9a1e-fc6ade341a17 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:20.144512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc36939-59a0-4819-9a1e-fc6ade341a17 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:20.199929 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0deddf2-eec3-4d75-8874-91e4d5596fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:20.200465 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0deddf2-eec3-4d75-8874-91e4d5596fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:20.200739 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0deddf2-eec3-4d75-8874-91e4d5596fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:20.201007 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0deddf2-eec3-4d75-8874-91e4d5596fce admin admin] PATH_INFO: `/v3/users/c3ffb9593b4a4683817e519908e05e20` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:20.202100 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0deddf2-eec3-4d75-8874-91e4d5596fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3ffb9593b4a4683817e519908e05e20)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:20.204012 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0deddf2-eec3-4d75-8874-91e4d5596fce admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:20.249703 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-d0deddf2-eec3-4d75-8874-91e4d5596fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3ffb9593b4a4683817e519908e05e20'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:20.250338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-d0deddf2-eec3-4d75-8874-91e4d5596fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3ffb9593b4a4683817e519908e05e20'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:20.250964 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-d0deddf2-eec3-4d75-8874-91e4d5596fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3ffb9593b4a4683817e519908e05e20'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:20.263101 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-d0deddf2-eec3-4d75-8874-91e4d5596fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3ffb9593b4a4683817e519908e05e20'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:20.270019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-d0deddf2-eec3-4d75-8874-91e4d5596fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3ffb9593b4a4683817e519908e05e20'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:20.273639 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:20.283589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1346/2670] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:46:20 2022] DELETE /identity/v3/users/c3ffb9593b4a4683817e519908e05e20 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:20.548328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bac686-8005-49e1-888d-5fccc24f55e2 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:20.550413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c1bac686-8005-49e1-888d-5fccc24f55e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:20.564475 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bac686-8005-49e1-888d-5fccc24f55e2 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:20.621947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5671247-bbf8-4a2a-8839-1e0fbce31c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:20.622594 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5671247-bbf8-4a2a-8839-1e0fbce31c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:20.622855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5671247-bbf8-4a2a-8839-1e0fbce31c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:20.623136 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5671247-bbf8-4a2a-8839-1e0fbce31c1a admin admin] PATH_INFO: `/v3/projects/03a49aa15805473f9ead72294e8c2d46` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:20.624241 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5671247-bbf8-4a2a-8839-1e0fbce31c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a49aa15805473f9ead72294e8c2d46)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:20.626137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5671247-bbf8-4a2a-8839-1e0fbce31c1a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:20.637279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:20.672559 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-a5671247-bbf8-4a2a-8839-1e0fbce31c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a49aa15805473f9ead72294e8c2d46', 'request_id': 'req-a5671247-bbf8-4a2a-8839-1e0fbce31c1a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:20.678510 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-a5671247-bbf8-4a2a-8839-1e0fbce31c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a49aa15805473f9ead72294e8c2d46', 'request_id': 'req-a5671247-bbf8-4a2a-8839-1e0fbce31c1a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:20.684695 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-a5671247-bbf8-4a2a-8839-1e0fbce31c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a49aa15805473f9ead72294e8c2d46', 'request_id': 'req-a5671247-bbf8-4a2a-8839-1e0fbce31c1a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:20.697179 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-a5671247-bbf8-4a2a-8839-1e0fbce31c1a admin admin] The token cache is being invalidate because project 03a49aa15805473f9ead72294e8c2d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:46:20.697467 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-a5671247-bbf8-4a2a-8839-1e0fbce31c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:20.698081 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-a5671247-bbf8-4a2a-8839-1e0fbce31c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:20.699584 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1325/2671] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:46:20 2022] DELETE /identity/v3/projects/03a49aa15805473f9ead72294e8c2d46 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:20.704338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb4935-1503-43cc-aac4-8bc14a0788e8 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:20.705372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb4935-1503-43cc-aac4-8bc14a0788e8 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:20.705478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb4935-1503-43cc-aac4-8bc14a0788e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:20.724923 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-6deb4935-1503-43cc-aac4-8bc14a0788e8 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:20.726172 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6deb4935-1503-43cc-aac4-8bc14a0788e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:20.783609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1347/2672] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:46:20.791494 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7b94a-93ea-4a05-9199-f9981ced1628 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:20.791777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7b94a-93ea-4a05-9199-f9981ced1628 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:20.792048 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7b94a-93ea-4a05-9199-f9981ced1628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:20.812215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-02e7b94a-93ea-4a05-9199-f9981ced1628 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:20.813415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-02e7b94a-93ea-4a05-9199-f9981ced1628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:20.821722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1326/2673] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:46:20.825778 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb4935-1503-43cc-aac4-8bc14a0788e8 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:20.835742 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb4935-1503-43cc-aac4-8bc14a0788e8 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:20.840291 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefc06c-2e41-461d-8128-74c129141682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:20.840878 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefc06c-2e41-461d-8128-74c129141682 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:20.841157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefc06c-2e41-461d-8128-74c129141682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:20.841429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefc06c-2e41-461d-8128-74c129141682 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:20.842087 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefc06c-2e41-461d-8128-74c129141682 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:46:20.842389 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefc06c-2e41-461d-8128-74c129141682 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:20.843987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefc06c-2e41-461d-8128-74c129141682 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:20.855391 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1348/2674] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:46:20.859607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7b94a-93ea-4a05-9199-f9981ced1628 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:20.869197 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7b94a-93ea-4a05-9199-f9981ced1628 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:20.873841 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25a408-8a7c-4fff-865e-7aea74840f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:20.874423 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25a408-8a7c-4fff-865e-7aea74840f02 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:20.874697 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25a408-8a7c-4fff-865e-7aea74840f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:20.874999 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25a408-8a7c-4fff-865e-7aea74840f02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:20.875615 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25a408-8a7c-4fff-865e-7aea74840f02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:20.878088 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25a408-8a7c-4fff-865e-7aea74840f02 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:20.904135 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1327/2675] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:46:20 2022] POST /identity/v3/projects => generated 393 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:46:20.908252 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefc06c-2e41-461d-8128-74c129141682 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:20.918423 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefc06c-2e41-461d-8128-74c129141682 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:20.975130 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32278872-66bc-4cad-8ce3-473ed77c13da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:20.975723 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32278872-66bc-4cad-8ce3-473ed77c13da admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:20.976001 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32278872-66bc-4cad-8ce3-473ed77c13da admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:20.976324 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32278872-66bc-4cad-8ce3-473ed77c13da admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:20.976898 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32278872-66bc-4cad-8ce3-473ed77c13da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:20.978771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32278872-66bc-4cad-8ce3-473ed77c13da admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:21.000569 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1349/2676] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:46:20 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:46:21.005850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25a408-8a7c-4fff-865e-7aea74840f02 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:21.016249 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25a408-8a7c-4fff-865e-7aea74840f02 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:21.020921 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90102a2a-e5f1-4d09-ac22-f96209f92431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:21.021515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90102a2a-e5f1-4d09-ac22-f96209f92431 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:21.021792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90102a2a-e5f1-4d09-ac22-f96209f92431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:21.022098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90102a2a-e5f1-4d09-ac22-f96209f92431 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:21.022729 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90102a2a-e5f1-4d09-ac22-f96209f92431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:21.024558 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90102a2a-e5f1-4d09-ac22-f96209f92431 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:21.034328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1328/2677] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:46:21.038089 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32278872-66bc-4cad-8ce3-473ed77c13da admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:21.047851 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32278872-66bc-4cad-8ce3-473ed77c13da admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:21.053046 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe59bc-347d-4069-bafe-860f93a966a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:21.053656 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe59bc-347d-4069-bafe-860f93a966a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:21.053907 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe59bc-347d-4069-bafe-860f93a966a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:21.054175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe59bc-347d-4069-bafe-860f93a966a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:21.054811 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe59bc-347d-4069-bafe-860f93a966a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:21.056373 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe59bc-347d-4069-bafe-860f93a966a0 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:21.067390 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1350/2678] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:46:21.071265 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90102a2a-e5f1-4d09-ac22-f96209f92431 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:21.081289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90102a2a-e5f1-4d09-ac22-f96209f92431 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:21.086016 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5289ad-7162-423a-a690-da0eaf8e5b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:21.086644 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5289ad-7162-423a-a690-da0eaf8e5b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:21.086963 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5289ad-7162-423a-a690-da0eaf8e5b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:21.087239 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5289ad-7162-423a-a690-da0eaf8e5b3f admin admin] PATH_INFO: `/v3/projects/1a3c0c0870784265884b0d894b8a574c/users/24c14bba160e427592a05b3d881c402d/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:21.102050 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5289ad-7162-423a-a690-da0eaf8e5b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3c0c0870784265884b0d894b8a574c, user_id=24c14bba160e427592a05b3d881c402d, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:21.104705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5289ad-7162-423a-a690-da0eaf8e5b3f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:21.117233 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1329/2679] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:46:21 2022] PUT /identity/v3/projects/1a3c0c0870784265884b0d894b8a574c/users/24c14bba160e427592a05b3d881c402d/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:21.129112 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477f70a-2e75-4847-b50b-d89f7dc64833 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:21.129461 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477f70a-2e75-4847-b50b-d89f7dc64833 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:21.129740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477f70a-2e75-4847-b50b-d89f7dc64833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:21.157826 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-9477f70a-2e75-4847-b50b-d89f7dc64833 None None] MFA Rules not processed for user `24c14bba160e427592a05b3d881c402d`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:21.159363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-9477f70a-2e75-4847-b50b-d89f7dc64833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:21.206731 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:21.225287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1351/2680] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:46:21.229916 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5289ad-7162-423a-a690-da0eaf8e5b3f admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:21.293801 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5289ad-7162-423a-a690-da0eaf8e5b3f admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:21.298411 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5d939-71d1-48e0-b746-48b37e15fd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:21.299134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5d939-71d1-48e0-b746-48b37e15fd0c admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:21.299325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5d939-71d1-48e0-b746-48b37e15fd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:21.299601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5d939-71d1-48e0-b746-48b37e15fd0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:21.300234 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5d939-71d1-48e0-b746-48b37e15fd0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:21.302117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5d939-71d1-48e0-b746-48b37e15fd0c admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:21.328042 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1330/2681] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:46:21 2022] POST /identity/v3/projects => generated 391 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:46:21.332624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477f70a-2e75-4847-b50b-d89f7dc64833 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:21.343152 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477f70a-2e75-4847-b50b-d89f7dc64833 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:21.397938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c318c3d-45e1-4e3f-ac0f-f7fde2e2e367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:21.398544 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c318c3d-45e1-4e3f-ac0f-f7fde2e2e367 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:21.398840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c318c3d-45e1-4e3f-ac0f-f7fde2e2e367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:21.399114 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c318c3d-45e1-4e3f-ac0f-f7fde2e2e367 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:21.399750 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c318c3d-45e1-4e3f-ac0f-f7fde2e2e367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:21.401640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c318c3d-45e1-4e3f-ac0f-f7fde2e2e367 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:21.423096 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1352/2682] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:46:21 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:46:21.427696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5d939-71d1-48e0-b746-48b37e15fd0c admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:21.438147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5d939-71d1-48e0-b746-48b37e15fd0c admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:21.443053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187de45b-aacf-4b81-b00b-82a9627c7cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:21.443649 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187de45b-aacf-4b81-b00b-82a9627c7cbd admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:21.443929 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187de45b-aacf-4b81-b00b-82a9627c7cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:21.444206 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187de45b-aacf-4b81-b00b-82a9627c7cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:21.444875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187de45b-aacf-4b81-b00b-82a9627c7cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:21.446470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187de45b-aacf-4b81-b00b-82a9627c7cbd admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:21.457440 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1331/2683] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:46:21.461500 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c318c3d-45e1-4e3f-ac0f-f7fde2e2e367 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:21.472194 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c318c3d-45e1-4e3f-ac0f-f7fde2e2e367 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:21.476811 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634746d-b4e7-4f32-95c5-a8208bb3520b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:21.477475 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634746d-b4e7-4f32-95c5-a8208bb3520b admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:21.477755 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634746d-b4e7-4f32-95c5-a8208bb3520b admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:21.478028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634746d-b4e7-4f32-95c5-a8208bb3520b admin admin] PATH_INFO: `/v3/projects/75d9556eed054e4ea574ab5a768ef61f/users/3734c5a4aee44d1ba22e9cf57a8b17d8/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:21.492546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634746d-b4e7-4f32-95c5-a8208bb3520b admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d9556eed054e4ea574ab5a768ef61f, user_id=3734c5a4aee44d1ba22e9cf57a8b17d8, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:21.495129 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634746d-b4e7-4f32-95c5-a8208bb3520b admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:21.507695 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1353/2684] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:46:21 2022] PUT /identity/v3/projects/75d9556eed054e4ea574ab5a768ef61f/users/3734c5a4aee44d1ba22e9cf57a8b17d8/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:21.511676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187de45b-aacf-4b81-b00b-82a9627c7cbd admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:21.522218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187de45b-aacf-4b81-b00b-82a9627c7cbd admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:21.529873 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:21.583574 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffbccb-6aa9-4b3f-92a4-17a486014243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:21.584181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffbccb-6aa9-4b3f-92a4-17a486014243 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:21.584461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffbccb-6aa9-4b3f-92a4-17a486014243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:21.584736 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffbccb-6aa9-4b3f-92a4-17a486014243 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:21.585370 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffbccb-6aa9-4b3f-92a4-17a486014243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:21.586989 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffbccb-6aa9-4b3f-92a4-17a486014243 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:21.597350 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1332/2685] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:46:21.601570 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634746d-b4e7-4f32-95c5-a8208bb3520b admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:21.611680 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634746d-b4e7-4f32-95c5-a8208bb3520b admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:21.616244 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a51fc-3577-4788-bfab-990a8fd879b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:21.616880 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a51fc-3577-4788-bfab-990a8fd879b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:21.617159 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a51fc-3577-4788-bfab-990a8fd879b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:21.617433 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a51fc-3577-4788-bfab-990a8fd879b9 admin admin] PATH_INFO: `/v3/projects/75d9556eed054e4ea574ab5a768ef61f/users/3734c5a4aee44d1ba22e9cf57a8b17d8/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:21.619377 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a51fc-3577-4788-bfab-990a8fd879b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d9556eed054e4ea574ab5a768ef61f, user_id=3734c5a4aee44d1ba22e9cf57a8b17d8, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:21.621944 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a51fc-3577-4788-bfab-990a8fd879b9 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:21.632005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1354/2686] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:46:21 2022] PUT /identity/v3/projects/75d9556eed054e4ea574ab5a768ef61f/users/3734c5a4aee44d1ba22e9cf57a8b17d8/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:21.642111 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6a696-33c7-44a0-a234-1310365abca1 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:21.643167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6a696-33c7-44a0-a234-1310365abca1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:21.643350 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6a696-33c7-44a0-a234-1310365abca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:21.671194 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-54d6a696-33c7-44a0-a234-1310365abca1 None None] MFA Rules not processed for user `3734c5a4aee44d1ba22e9cf57a8b17d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:21.672452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-54d6a696-33c7-44a0-a234-1310365abca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:21.739537 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1333/2687] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:21 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:46:21.749963 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a51fc-3577-4788-bfab-990a8fd879b9 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:21.751867 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-8c0a51fc-3577-4788-bfab-990a8fd879b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:21.808299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a51fc-3577-4788-bfab-990a8fd879b9 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:21.811922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6646ddf-df24-442f-ac42-c607fc3f4d35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:21.812509 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6646ddf-df24-442f-ac42-c607fc3f4d35 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:21.812789 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6646ddf-df24-442f-ac42-c607fc3f4d35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:21.813061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6646ddf-df24-442f-ac42-c607fc3f4d35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:21.823000 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6646ddf-df24-442f-ac42-c607fc3f4d35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:21.824394 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6646ddf-df24-442f-ac42-c607fc3f4d35 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:21.834392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1355/2688] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:46:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:46:21.880461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6a696-33c7-44a0-a234-1310365abca1 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:21.881841 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-54d6a696-33c7-44a0-a234-1310365abca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:21.894451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6a696-33c7-44a0-a234-1310365abca1 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:21.898118 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea1ccb-34e3-4e11-91db-e2be438e5e1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:21.898707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea1ccb-34e3-4e11-91db-e2be438e5e1c service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:21.899030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea1ccb-34e3-4e11-91db-e2be438e5e1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:21.899307 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea1ccb-34e3-4e11-91db-e2be438e5e1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:21.956155 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea1ccb-34e3-4e11-91db-e2be438e5e1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:21.957597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea1ccb-34e3-4e11-91db-e2be438e5e1c service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:21.966450 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1334/2689] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:46:21 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:46:25.275170 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6646ddf-df24-442f-ac42-c607fc3f4d35 service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:25.330211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:25.347288 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6646ddf-df24-442f-ac42-c607fc3f4d35 service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:25.351875 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293c087-ca4c-46ca-a864-846da1c0ad67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:25.352497 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293c087-ca4c-46ca-a864-846da1c0ad67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:25.352779 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293c087-ca4c-46ca-a864-846da1c0ad67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:25.353056 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293c087-ca4c-46ca-a864-846da1c0ad67 admin admin] PATH_INFO: `/v3/users/24c14bba160e427592a05b3d881c402d` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:25.354427 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293c087-ca4c-46ca-a864-846da1c0ad67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c14bba160e427592a05b3d881c402d)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:25.356981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293c087-ca4c-46ca-a864-846da1c0ad67 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:25.415020 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6293c087-ca4c-46ca-a864-846da1c0ad67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c14bba160e427592a05b3d881c402d'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:25.415758 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6293c087-ca4c-46ca-a864-846da1c0ad67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c14bba160e427592a05b3d881c402d'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:25.416552 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6293c087-ca4c-46ca-a864-846da1c0ad67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c14bba160e427592a05b3d881c402d'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:25.429536 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6293c087-ca4c-46ca-a864-846da1c0ad67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c14bba160e427592a05b3d881c402d'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:25.437273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6293c087-ca4c-46ca-a864-846da1c0ad67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c14bba160e427592a05b3d881c402d'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:25.451051 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1356/2690] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:46:25 2022] DELETE /identity/v3/users/24c14bba160e427592a05b3d881c402d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:25.456206 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa9c0d-0b69-4be1-8690-6b3931d1c94b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:25.456737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa9c0d-0b69-4be1-8690-6b3931d1c94b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:25.456888 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa9c0d-0b69-4be1-8690-6b3931d1c94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:25.477597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-79fa9c0d-0b69-4be1-8690-6b3931d1c94b None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:25.479360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-79fa9c0d-0b69-4be1-8690-6b3931d1c94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:25.509923 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:25.551331 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1335/2691] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:46:25.563448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293c087-ca4c-46ca-a864-846da1c0ad67 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:25.565655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6293c087-ca4c-46ca-a864-846da1c0ad67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:25.626447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293c087-ca4c-46ca-a864-846da1c0ad67 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:25.630266 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbd333-c3d6-4730-b543-de1014613682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:25.630907 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbd333-c3d6-4730-b543-de1014613682 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:25.631189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbd333-c3d6-4730-b543-de1014613682 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:25.631464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbd333-c3d6-4730-b543-de1014613682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:25.640596 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbd333-c3d6-4730-b543-de1014613682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:25.642028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbd333-c3d6-4730-b543-de1014613682 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:25.651682 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1357/2692] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:46:25.916381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa9c0d-0b69-4be1-8690-6b3931d1c94b None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:25.917931 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-79fa9c0d-0b69-4be1-8690-6b3931d1c94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:25.931718 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa9c0d-0b69-4be1-8690-6b3931d1c94b None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:25.935806 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db53c2-bf12-4389-a192-7b15b54e4485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:25.936512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db53c2-bf12-4389-a192-7b15b54e4485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:25.936874 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db53c2-bf12-4389-a192-7b15b54e4485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:25.937213 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db53c2-bf12-4389-a192-7b15b54e4485 admin admin] PATH_INFO: `/v3/projects/1a3c0c0870784265884b0d894b8a574c` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:25.938337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db53c2-bf12-4389-a192-7b15b54e4485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a3c0c0870784265884b0d894b8a574c)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:25.940715 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db53c2-bf12-4389-a192-7b15b54e4485 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:25.988241 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-82db53c2-bf12-4389-a192-7b15b54e4485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a3c0c0870784265884b0d894b8a574c', 'request_id': 'req-82db53c2-bf12-4389-a192-7b15b54e4485'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:25.993609 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-82db53c2-bf12-4389-a192-7b15b54e4485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a3c0c0870784265884b0d894b8a574c', 'request_id': 'req-82db53c2-bf12-4389-a192-7b15b54e4485'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:25.999596 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-82db53c2-bf12-4389-a192-7b15b54e4485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a3c0c0870784265884b0d894b8a574c', 'request_id': 'req-82db53c2-bf12-4389-a192-7b15b54e4485'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:26.011644 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-82db53c2-bf12-4389-a192-7b15b54e4485 admin admin] The token cache is being invalidate because project 1a3c0c0870784265884b0d894b8a574c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:46:26.011925 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-82db53c2-bf12-4389-a192-7b15b54e4485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:26.012539 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-82db53c2-bf12-4389-a192-7b15b54e4485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:26.013993 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1336/2693] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:46:25 2022] DELETE /identity/v3/projects/1a3c0c0870784265884b0d894b8a574c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:26.018735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbd333-c3d6-4730-b543-de1014613682 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:26.028734 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbd333-c3d6-4730-b543-de1014613682 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:26.084237 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf56ba-0a5e-41cd-b880-35969153d544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:26.084773 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf56ba-0a5e-41cd-b880-35969153d544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:26.085048 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf56ba-0a5e-41cd-b880-35969153d544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:26.085316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf56ba-0a5e-41cd-b880-35969153d544 admin admin] PATH_INFO: `/v3/users/3734c5a4aee44d1ba22e9cf57a8b17d8` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:26.086422 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf56ba-0a5e-41cd-b880-35969153d544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3734c5a4aee44d1ba22e9cf57a8b17d8)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:26.088339 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf56ba-0a5e-41cd-b880-35969153d544 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:26.099049 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:26.138176 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-70bf56ba-0a5e-41cd-b880-35969153d544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3734c5a4aee44d1ba22e9cf57a8b17d8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:26.138893 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-70bf56ba-0a5e-41cd-b880-35969153d544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3734c5a4aee44d1ba22e9cf57a8b17d8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:26.139518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-70bf56ba-0a5e-41cd-b880-35969153d544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3734c5a4aee44d1ba22e9cf57a8b17d8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:26.152241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-70bf56ba-0a5e-41cd-b880-35969153d544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3734c5a4aee44d1ba22e9cf57a8b17d8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:26.160072 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-70bf56ba-0a5e-41cd-b880-35969153d544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3734c5a4aee44d1ba22e9cf57a8b17d8'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:26.174530 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1358/2694] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:46:26 2022] DELETE /identity/v3/users/3734c5a4aee44d1ba22e9cf57a8b17d8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:46:26.473347 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db53c2-bf12-4389-a192-7b15b54e4485 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:26.474897 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-82db53c2-bf12-4389-a192-7b15b54e4485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:26.504363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db53c2-bf12-4389-a192-7b15b54e4485 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:26.564904 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f0383-afc9-4778-924e-c85d140c563a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:26.565535 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f0383-afc9-4778-924e-c85d140c563a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:26.565812 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f0383-afc9-4778-924e-c85d140c563a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:26.566161 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f0383-afc9-4778-924e-c85d140c563a admin admin] PATH_INFO: `/v3/projects/75d9556eed054e4ea574ab5a768ef61f` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:26.567215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f0383-afc9-4778-924e-c85d140c563a admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d9556eed054e4ea574ab5a768ef61f)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:26.569214 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f0383-afc9-4778-924e-c85d140c563a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:26.616263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f10f0383-afc9-4778-924e-c85d140c563a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d9556eed054e4ea574ab5a768ef61f', 'request_id': 'req-f10f0383-afc9-4778-924e-c85d140c563a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:26.621253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:26.622452 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f10f0383-afc9-4778-924e-c85d140c563a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d9556eed054e4ea574ab5a768ef61f', 'request_id': 'req-f10f0383-afc9-4778-924e-c85d140c563a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:26.631905 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f10f0383-afc9-4778-924e-c85d140c563a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d9556eed054e4ea574ab5a768ef61f', 'request_id': 'req-f10f0383-afc9-4778-924e-c85d140c563a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:26.645119 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f10f0383-afc9-4778-924e-c85d140c563a admin admin] The token cache is being invalidate because project 75d9556eed054e4ea574ab5a768ef61f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:46:26.645418 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f10f0383-afc9-4778-924e-c85d140c563a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:26.646106 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f10f0383-afc9-4778-924e-c85d140c563a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:26.647804 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1337/2695] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:46:26 2022] DELETE /identity/v3/projects/75d9556eed054e4ea574ab5a768ef61f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:26.652858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5eec0-bec9-475a-9ffd-136de54f75f2 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:26.653355 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5eec0-bec9-475a-9ffd-136de54f75f2 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:26.653471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5eec0-bec9-475a-9ffd-136de54f75f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:26.673024 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-3be5eec0-bec9-475a-9ffd-136de54f75f2 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:26.674258 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-3be5eec0-bec9-475a-9ffd-136de54f75f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:26.734231 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1359/2696] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:46:26.742894 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e64ff5-e7a5-4153-af83-22d045799c43 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:26.743183 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e64ff5-e7a5-4153-af83-22d045799c43 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:26.743460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e64ff5-e7a5-4153-af83-22d045799c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:26.765057 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-46e64ff5-e7a5-4153-af83-22d045799c43 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:26.766273 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-46e64ff5-e7a5-4153-af83-22d045799c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:26.774393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1338/2697] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:46:26.778667 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5eec0-bec9-475a-9ffd-136de54f75f2 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:26.788367 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5eec0-bec9-475a-9ffd-136de54f75f2 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:26.792892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ad9c3-697c-4bfb-aed4-c457e78aec43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:26.793477 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ad9c3-697c-4bfb-aed4-c457e78aec43 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:26.793756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ad9c3-697c-4bfb-aed4-c457e78aec43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:26.794027 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ad9c3-697c-4bfb-aed4-c457e78aec43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:26.794666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ad9c3-697c-4bfb-aed4-c457e78aec43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:46:26.795007 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ad9c3-697c-4bfb-aed4-c457e78aec43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:26.796598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ad9c3-697c-4bfb-aed4-c457e78aec43 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:26.808666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1360/2698] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:46:26.812843 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e64ff5-e7a5-4153-af83-22d045799c43 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:26.823107 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e64ff5-e7a5-4153-af83-22d045799c43 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:26.827820 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890ddfa-c01a-4767-bf20-7686d06ca799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:26.828435 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890ddfa-c01a-4767-bf20-7686d06ca799 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:26.828696 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890ddfa-c01a-4767-bf20-7686d06ca799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:26.828967 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890ddfa-c01a-4767-bf20-7686d06ca799 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:26.829977 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890ddfa-c01a-4767-bf20-7686d06ca799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:26.831911 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890ddfa-c01a-4767-bf20-7686d06ca799 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:26.860175 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1339/2699] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:46:26 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:46:26.865674 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ad9c3-697c-4bfb-aed4-c457e78aec43 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:26.875703 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ad9c3-697c-4bfb-aed4-c457e78aec43 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:26.931333 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d844e4-7359-4aab-8a0f-6fe7fb8b426e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:26.931935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d844e4-7359-4aab-8a0f-6fe7fb8b426e admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:26.932218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d844e4-7359-4aab-8a0f-6fe7fb8b426e admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:26.932495 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d844e4-7359-4aab-8a0f-6fe7fb8b426e admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:26.933121 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d844e4-7359-4aab-8a0f-6fe7fb8b426e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:26.935039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d844e4-7359-4aab-8a0f-6fe7fb8b426e admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:26.956811 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1361/2700] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:46:26 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:46:26.960985 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890ddfa-c01a-4767-bf20-7686d06ca799 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:26.971841 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890ddfa-c01a-4767-bf20-7686d06ca799 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:26.976475 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e2c91-ef0a-47ae-b507-9b290448751a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:26.977071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e2c91-ef0a-47ae-b507-9b290448751a admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:26.977353 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e2c91-ef0a-47ae-b507-9b290448751a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:26.977632 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e2c91-ef0a-47ae-b507-9b290448751a admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:26.978269 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e2c91-ef0a-47ae-b507-9b290448751a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:26.979887 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e2c91-ef0a-47ae-b507-9b290448751a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:26.989698 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1340/2701] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:46:26.993480 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d844e4-7359-4aab-8a0f-6fe7fb8b426e admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:26.999830 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:27.003729 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d844e4-7359-4aab-8a0f-6fe7fb8b426e admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:27.009718 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea717ed-4c45-4b28-a99b-8cc7957c53e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:27.010470 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea717ed-4c45-4b28-a99b-8cc7957c53e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:27.010989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea717ed-4c45-4b28-a99b-8cc7957c53e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:27.011287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea717ed-4c45-4b28-a99b-8cc7957c53e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:27.012078 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea717ed-4c45-4b28-a99b-8cc7957c53e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:27.013652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea717ed-4c45-4b28-a99b-8cc7957c53e6 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:27.024703 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1362/2702] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:46:27.028804 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e2c91-ef0a-47ae-b507-9b290448751a admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:27.039713 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e2c91-ef0a-47ae-b507-9b290448751a admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:27.044352 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d398d32-3b02-4373-9312-da6e0dd34878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:27.044994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d398d32-3b02-4373-9312-da6e0dd34878 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:27.045274 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d398d32-3b02-4373-9312-da6e0dd34878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:27.045549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d398d32-3b02-4373-9312-da6e0dd34878 admin admin] PATH_INFO: `/v3/projects/a6a2262bbe5b497f8dfa1a11381104b0/users/19859b54e19d43c2a62c6f499950c74a/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:27.059940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d398d32-3b02-4373-9312-da6e0dd34878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a2262bbe5b497f8dfa1a11381104b0, user_id=19859b54e19d43c2a62c6f499950c74a, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:27.062585 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d398d32-3b02-4373-9312-da6e0dd34878 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:27.075470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1341/2703] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:46:27 2022] PUT /identity/v3/projects/a6a2262bbe5b497f8dfa1a11381104b0/users/19859b54e19d43c2a62c6f499950c74a/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:27.087480 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890fb20-7b00-4e34-9702-b3183a20a8f6 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:27.087766 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890fb20-7b00-4e34-9702-b3183a20a8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:27.088058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890fb20-7b00-4e34-9702-b3183a20a8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:27.116706 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-9890fb20-7b00-4e34-9702-b3183a20a8f6 None None] MFA Rules not processed for user `19859b54e19d43c2a62c6f499950c74a`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:27.117835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-9890fb20-7b00-4e34-9702-b3183a20a8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:27.182590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1363/2704] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:46:27.186892 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d398d32-3b02-4373-9312-da6e0dd34878 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:27.248759 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d398d32-3b02-4373-9312-da6e0dd34878 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:27.254043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dca24e-9a43-4558-867b-ca19c63b9a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:27.254637 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dca24e-9a43-4558-867b-ca19c63b9a72 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:27.254944 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dca24e-9a43-4558-867b-ca19c63b9a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:27.255219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dca24e-9a43-4558-867b-ca19c63b9a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:27.255840 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dca24e-9a43-4558-867b-ca19c63b9a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:27.257712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dca24e-9a43-4558-867b-ca19c63b9a72 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:27.284574 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1342/2705] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:46:27 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:46:27.288600 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890fb20-7b00-4e34-9702-b3183a20a8f6 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:27.300439 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890fb20-7b00-4e34-9702-b3183a20a8f6 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:27.358456 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da8cb1-58c2-4234-a38c-461e1f39e1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:27.359097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da8cb1-58c2-4234-a38c-461e1f39e1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:27.359378 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da8cb1-58c2-4234-a38c-461e1f39e1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:27.359682 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da8cb1-58c2-4234-a38c-461e1f39e1b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:27.360317 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da8cb1-58c2-4234-a38c-461e1f39e1b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:27.362957 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da8cb1-58c2-4234-a38c-461e1f39e1b8 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:27.383573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1364/2706] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:46:27 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:46:27.387488 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dca24e-9a43-4558-867b-ca19c63b9a72 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:27.398113 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dca24e-9a43-4558-867b-ca19c63b9a72 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:27.402791 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82437a-75ea-4b2b-8e26-8b98f6e6771d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:27.403454 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82437a-75ea-4b2b-8e26-8b98f6e6771d admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:27.403733 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82437a-75ea-4b2b-8e26-8b98f6e6771d admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:27.404007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82437a-75ea-4b2b-8e26-8b98f6e6771d admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:27.404639 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82437a-75ea-4b2b-8e26-8b98f6e6771d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:27.406225 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82437a-75ea-4b2b-8e26-8b98f6e6771d admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:27.417468 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1343/2707] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:46:27.421597 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da8cb1-58c2-4234-a38c-461e1f39e1b8 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:27.432518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da8cb1-58c2-4234-a38c-461e1f39e1b8 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:27.437143 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796c954-9fec-4a9b-8beb-53da68c0daa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:27.437733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796c954-9fec-4a9b-8beb-53da68c0daa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:27.438014 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796c954-9fec-4a9b-8beb-53da68c0daa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:27.438288 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796c954-9fec-4a9b-8beb-53da68c0daa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:27.438986 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796c954-9fec-4a9b-8beb-53da68c0daa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:27.440556 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796c954-9fec-4a9b-8beb-53da68c0daa8 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:27.450272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1365/2708] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:46:27.455252 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82437a-75ea-4b2b-8e26-8b98f6e6771d admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:27.465039 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82437a-75ea-4b2b-8e26-8b98f6e6771d admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:27.469623 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d2ba4-e43b-4917-bddd-4b552f550bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:27.470939 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d2ba4-e43b-4917-bddd-4b552f550bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:27.471292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d2ba4-e43b-4917-bddd-4b552f550bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:27.471570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d2ba4-e43b-4917-bddd-4b552f550bd3 admin admin] PATH_INFO: `/v3/projects/9a068f5d6f524cadbfc0a81cec28b3d1/users/bb6177eedcfe43b7935e950973131a9b/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:27.486032 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d2ba4-e43b-4917-bddd-4b552f550bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a068f5d6f524cadbfc0a81cec28b3d1, user_id=bb6177eedcfe43b7935e950973131a9b, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:27.488692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d2ba4-e43b-4917-bddd-4b552f550bd3 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:27.501018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1344/2709] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:46:27 2022] PUT /identity/v3/projects/9a068f5d6f524cadbfc0a81cec28b3d1/users/bb6177eedcfe43b7935e950973131a9b/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:27.511247 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd34ae-1140-4d7c-ab60-e57cbdd6cb58 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:27.511538 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd34ae-1140-4d7c-ab60-e57cbdd6cb58 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:27.511818 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd34ae-1140-4d7c-ab60-e57cbdd6cb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:27.544490 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-24bd34ae-1140-4d7c-ab60-e57cbdd6cb58 None None] MFA Rules not processed for user `bb6177eedcfe43b7935e950973131a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:27.545705 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-24bd34ae-1140-4d7c-ab60-e57cbdd6cb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:27.596568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:27.615013 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1366/2710] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:46:27.619710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d2ba4-e43b-4917-bddd-4b552f550bd3 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:27.660744 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:27.694739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d2ba4-e43b-4917-bddd-4b552f550bd3 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:27.699844 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fff4eb-99f5-4400-adee-bf1843245c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:27.700571 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fff4eb-99f5-4400-adee-bf1843245c5f admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:27.700900 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fff4eb-99f5-4400-adee-bf1843245c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:27.701262 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fff4eb-99f5-4400-adee-bf1843245c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:27.701971 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fff4eb-99f5-4400-adee-bf1843245c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:27.703979 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fff4eb-99f5-4400-adee-bf1843245c5f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:27.732999 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1345/2711] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:46:27 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:46:27.737169 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd34ae-1140-4d7c-ab60-e57cbdd6cb58 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:27.749338 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd34ae-1140-4d7c-ab60-e57cbdd6cb58 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:27.818581 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad2702-c63e-4cb2-81ab-56f789831a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:27.819349 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad2702-c63e-4cb2-81ab-56f789831a43 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:27.819629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad2702-c63e-4cb2-81ab-56f789831a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:27.819899 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad2702-c63e-4cb2-81ab-56f789831a43 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:27.820544 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad2702-c63e-4cb2-81ab-56f789831a43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:27.822401 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad2702-c63e-4cb2-81ab-56f789831a43 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:27.842814 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1367/2712] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:46:27 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:46:27.847629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fff4eb-99f5-4400-adee-bf1843245c5f admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:27.857998 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fff4eb-99f5-4400-adee-bf1843245c5f admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:27.863393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cc05d-9a47-479b-99e8-e27c3d229eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:27.863990 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cc05d-9a47-479b-99e8-e27c3d229eaa admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:27.864267 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cc05d-9a47-479b-99e8-e27c3d229eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:27.864536 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cc05d-9a47-479b-99e8-e27c3d229eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:27.865167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5cc05d-9a47-479b-99e8-e27c3d229eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:27.866762 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5cc05d-9a47-479b-99e8-e27c3d229eaa admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:27.877397 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1346/2713] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:46:27.881524 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad2702-c63e-4cb2-81ab-56f789831a43 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:27.892688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad2702-c63e-4cb2-81ab-56f789831a43 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:27.897365 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9bb94-0af9-45e0-8048-c230dc421ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:27.897953 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9bb94-0af9-45e0-8048-c230dc421ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:27.898235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9bb94-0af9-45e0-8048-c230dc421ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:27.898512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9bb94-0af9-45e0-8048-c230dc421ed2 admin admin] PATH_INFO: `/v3/projects/24b9563f59494c269e3a1d976a1cf5bc/users/53e832d23c9f4434a35e41e12aac9dba/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:27.914016 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9bb94-0af9-45e0-8048-c230dc421ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b9563f59494c269e3a1d976a1cf5bc, user_id=53e832d23c9f4434a35e41e12aac9dba, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:27.916670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9bb94-0af9-45e0-8048-c230dc421ed2 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:27.930430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1368/2714] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:46:27 2022] PUT /identity/v3/projects/24b9563f59494c269e3a1d976a1cf5bc/users/53e832d23c9f4434a35e41e12aac9dba/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:27.934279 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cc05d-9a47-479b-99e8-e27c3d229eaa admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:27.945220 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cc05d-9a47-479b-99e8-e27c3d229eaa admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:28.004059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81494d6-1ba3-4f42-99cb-1671130ee177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:28.004665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81494d6-1ba3-4f42-99cb-1671130ee177 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:28.004943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81494d6-1ba3-4f42-99cb-1671130ee177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:28.005215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81494d6-1ba3-4f42-99cb-1671130ee177 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:28.005848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81494d6-1ba3-4f42-99cb-1671130ee177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:28.007477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81494d6-1ba3-4f42-99cb-1671130ee177 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:28.017866 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1347/2715] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:46:28.022107 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9bb94-0af9-45e0-8048-c230dc421ed2 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:28.032463 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9bb94-0af9-45e0-8048-c230dc421ed2 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:28.038596 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc0474-f8df-4e41-9c96-4ea8bb92615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:28.039297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc0474-f8df-4e41-9c96-4ea8bb92615a admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:28.039577 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc0474-f8df-4e41-9c96-4ea8bb92615a admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:28.039852 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc0474-f8df-4e41-9c96-4ea8bb92615a admin admin] PATH_INFO: `/v3/projects/24b9563f59494c269e3a1d976a1cf5bc/users/53e832d23c9f4434a35e41e12aac9dba/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:28.041759 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc0474-f8df-4e41-9c96-4ea8bb92615a admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b9563f59494c269e3a1d976a1cf5bc, user_id=53e832d23c9f4434a35e41e12aac9dba, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:28.044395 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc0474-f8df-4e41-9c96-4ea8bb92615a admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:28.054665 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1369/2716] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:46:28 2022] PUT /identity/v3/projects/24b9563f59494c269e3a1d976a1cf5bc/users/53e832d23c9f4434a35e41e12aac9dba/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:28.065125 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea7873-eb82-405e-8888-b88ecfae2061 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:28.065407 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea7873-eb82-405e-8888-b88ecfae2061 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:28.065684 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea7873-eb82-405e-8888-b88ecfae2061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:28.093562 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2cea7873-eb82-405e-8888-b88ecfae2061 None None] MFA Rules not processed for user `53e832d23c9f4434a35e41e12aac9dba`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:28.094777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2cea7873-eb82-405e-8888-b88ecfae2061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:28.162613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1348/2717] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:46:28.174467 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc0474-f8df-4e41-9c96-4ea8bb92615a admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:28.176207 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e2bc0474-f8df-4e41-9c96-4ea8bb92615a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:28.232724 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc0474-f8df-4e41-9c96-4ea8bb92615a admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:28.236342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5cdc8-7285-4448-b678-8c28ff57d30b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:28.236926 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5cdc8-7285-4448-b678-8c28ff57d30b service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:28.237197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5cdc8-7285-4448-b678-8c28ff57d30b service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:28.237464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5cdc8-7285-4448-b678-8c28ff57d30b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:28.292507 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5cdc8-7285-4448-b678-8c28ff57d30b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:28.293914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5cdc8-7285-4448-b678-8c28ff57d30b service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:28.297339 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:28.304884 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1370/2718] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:46:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:46:29.820447 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea7873-eb82-405e-8888-b88ecfae2061 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:29.822053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2cea7873-eb82-405e-8888-b88ecfae2061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:29.835381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea7873-eb82-405e-8888-b88ecfae2061 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:29.839708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cd96e-c672-41f2-952e-94495a1c07d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:29.840338 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cd96e-c672-41f2-952e-94495a1c07d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:29.840618 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cd96e-c672-41f2-952e-94495a1c07d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:29.840893 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cd96e-c672-41f2-952e-94495a1c07d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:29.867900 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:29.901962 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cd96e-c672-41f2-952e-94495a1c07d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:29.903551 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cd96e-c672-41f2-952e-94495a1c07d4 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:29.913265 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1349/2719] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:46:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:46:29.952835 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aeba7-f439-49a4-bdcd-c9ec65837e3e None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:29.953373 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aeba7-f439-49a4-bdcd-c9ec65837e3e None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:29.953640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aeba7-f439-49a4-bdcd-c9ec65837e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:29.973610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-8a3aeba7-f439-49a4-bdcd-c9ec65837e3e None None] MFA Rules not processed for user `3fdaa4ff741f4417a35931341e70446a`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:29.974940 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-8a3aeba7-f439-49a4-bdcd-c9ec65837e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:30.035454 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1371/2720] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:46:30.450476 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cd96e-c672-41f2-952e-94495a1c07d4 service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:30.459515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cd96e-c672-41f2-952e-94495a1c07d4 service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:30.463128 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc12c63-7bce-4bed-b3da-4e771d746933 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:30.463727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc12c63-7bce-4bed-b3da-4e771d746933 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:30.464006 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc12c63-7bce-4bed-b3da-4e771d746933 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:30.464280 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc12c63-7bce-4bed-b3da-4e771d746933 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:30.473565 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc12c63-7bce-4bed-b3da-4e771d746933 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:30.475019 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc12c63-7bce-4bed-b3da-4e771d746933 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:30.484620 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1350/2721] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:46:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:46:34.171947 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3aeba7-f439-49a4-bdcd-c9ec65837e3e None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:34.174053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-8a3aeba7-f439-49a4-bdcd-c9ec65837e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:34.230493 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3aeba7-f439-49a4-bdcd-c9ec65837e3e None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:34.234124 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a768d-53c7-49eb-962e-63640f15b5e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:34.234733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a768d-53c7-49eb-962e-63640f15b5e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:34.235045 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a768d-53c7-49eb-962e-63640f15b5e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:34.235322 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a768d-53c7-49eb-962e-63640f15b5e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:34.237284 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-ed9a768d-53c7-49eb-962e-63640f15b5e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:34.306164 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a768d-53c7-49eb-962e-63640f15b5e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:34.307600 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a768d-53c7-49eb-962e-63640f15b5e5 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:34.318370 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1372/2722] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:46:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:46:34.449215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc12c63-7bce-4bed-b3da-4e771d746933 service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:34.510557 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc12c63-7bce-4bed-b3da-4e771d746933 service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:34.515117 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b145b38-e2b5-4cf0-8f77-032b37327da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:34.515735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b145b38-e2b5-4cf0-8f77-032b37327da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:34.516012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b145b38-e2b5-4cf0-8f77-032b37327da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:34.516321 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b145b38-e2b5-4cf0-8f77-032b37327da2 admin admin] PATH_INFO: `/v3/users/19859b54e19d43c2a62c6f499950c74a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:34.517826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b145b38-e2b5-4cf0-8f77-032b37327da2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19859b54e19d43c2a62c6f499950c74a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:34.519773 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b145b38-e2b5-4cf0-8f77-032b37327da2 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:34.565737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0b145b38-e2b5-4cf0-8f77-032b37327da2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19859b54e19d43c2a62c6f499950c74a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:34.566383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0b145b38-e2b5-4cf0-8f77-032b37327da2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19859b54e19d43c2a62c6f499950c74a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:34.567048 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0b145b38-e2b5-4cf0-8f77-032b37327da2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19859b54e19d43c2a62c6f499950c74a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:34.578484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0b145b38-e2b5-4cf0-8f77-032b37327da2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19859b54e19d43c2a62c6f499950c74a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:34.585619 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0b145b38-e2b5-4cf0-8f77-032b37327da2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19859b54e19d43c2a62c6f499950c74a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:34.598291 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1351/2723] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:46:34 2022] DELETE /identity/v3/users/19859b54e19d43c2a62c6f499950c74a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:34.602884 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1d7c2-e38b-417c-be21-ef173c0ddcfb None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:34.603292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1d7c2-e38b-417c-be21-ef173c0ddcfb None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:34.603573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1d7c2-e38b-417c-be21-ef173c0ddcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:34.622580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-02a1d7c2-e38b-417c-be21-ef173c0ddcfb None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:34.623829 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-02a1d7c2-e38b-417c-be21-ef173c0ddcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:34.666074 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:34.685362 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1373/2724] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:46:34.695535 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b145b38-e2b5-4cf0-8f77-032b37327da2 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:34.696944 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0b145b38-e2b5-4cf0-8f77-032b37327da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:34.731906 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:34.757180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b145b38-e2b5-4cf0-8f77-032b37327da2 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:34.760815 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445490a-7cde-48a5-bf08-7ffdfd033426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:34.761412 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445490a-7cde-48a5-bf08-7ffdfd033426 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:34.761691 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445490a-7cde-48a5-bf08-7ffdfd033426 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:34.761984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445490a-7cde-48a5-bf08-7ffdfd033426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:34.771302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445490a-7cde-48a5-bf08-7ffdfd033426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:34.772723 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445490a-7cde-48a5-bf08-7ffdfd033426 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:34.782029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1352/2725] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:46:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:46:35.045711 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1d7c2-e38b-417c-be21-ef173c0ddcfb None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:35.047305 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-02a1d7c2-e38b-417c-be21-ef173c0ddcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:35.061281 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1d7c2-e38b-417c-be21-ef173c0ddcfb None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:35.067654 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe8072-f80e-43b5-b46b-8a9ef0def879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:35.068303 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe8072-f80e-43b5-b46b-8a9ef0def879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:35.068585 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe8072-f80e-43b5-b46b-8a9ef0def879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:35.068861 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe8072-f80e-43b5-b46b-8a9ef0def879 admin admin] PATH_INFO: `/v3/projects/a6a2262bbe5b497f8dfa1a11381104b0` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:35.069989 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe8072-f80e-43b5-b46b-8a9ef0def879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6a2262bbe5b497f8dfa1a11381104b0)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:35.071933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe8072-f80e-43b5-b46b-8a9ef0def879 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:35.119284 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-2dfe8072-f80e-43b5-b46b-8a9ef0def879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6a2262bbe5b497f8dfa1a11381104b0', 'request_id': 'req-2dfe8072-f80e-43b5-b46b-8a9ef0def879'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.125437 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-2dfe8072-f80e-43b5-b46b-8a9ef0def879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6a2262bbe5b497f8dfa1a11381104b0', 'request_id': 'req-2dfe8072-f80e-43b5-b46b-8a9ef0def879'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.131588 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-2dfe8072-f80e-43b5-b46b-8a9ef0def879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6a2262bbe5b497f8dfa1a11381104b0', 'request_id': 'req-2dfe8072-f80e-43b5-b46b-8a9ef0def879'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.144097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-2dfe8072-f80e-43b5-b46b-8a9ef0def879 admin admin] The token cache is being invalidate because project a6a2262bbe5b497f8dfa1a11381104b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:46:35.144377 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-2dfe8072-f80e-43b5-b46b-8a9ef0def879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.144980 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-2dfe8072-f80e-43b5-b46b-8a9ef0def879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.146464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1374/2726] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:46:35 2022] DELETE /identity/v3/projects/a6a2262bbe5b497f8dfa1a11381104b0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:35.150447 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445490a-7cde-48a5-bf08-7ffdfd033426 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:35.160643 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445490a-7cde-48a5-bf08-7ffdfd033426 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:35.216218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64750c92-7c03-47ac-b48f-327b18b8719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:35.216844 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64750c92-7c03-47ac-b48f-327b18b8719c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:35.217123 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64750c92-7c03-47ac-b48f-327b18b8719c admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:35.217396 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64750c92-7c03-47ac-b48f-327b18b8719c admin admin] PATH_INFO: `/v3/users/bb6177eedcfe43b7935e950973131a9b` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:35.218506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64750c92-7c03-47ac-b48f-327b18b8719c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb6177eedcfe43b7935e950973131a9b)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:35.221274 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64750c92-7c03-47ac-b48f-327b18b8719c admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:35.265566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-64750c92-7c03-47ac-b48f-327b18b8719c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb6177eedcfe43b7935e950973131a9b'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.266716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-64750c92-7c03-47ac-b48f-327b18b8719c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb6177eedcfe43b7935e950973131a9b'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.267422 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-64750c92-7c03-47ac-b48f-327b18b8719c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb6177eedcfe43b7935e950973131a9b'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.278890 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-64750c92-7c03-47ac-b48f-327b18b8719c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb6177eedcfe43b7935e950973131a9b'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.285652 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-64750c92-7c03-47ac-b48f-327b18b8719c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb6177eedcfe43b7935e950973131a9b'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.298380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1353/2727] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:46:35 2022] DELETE /identity/v3/users/bb6177eedcfe43b7935e950973131a9b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:35.496179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe8072-f80e-43b5-b46b-8a9ef0def879 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:35.497611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-2dfe8072-f80e-43b5-b46b-8a9ef0def879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:35.556976 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe8072-f80e-43b5-b46b-8a9ef0def879 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:35.572473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64750c92-7c03-47ac-b48f-327b18b8719c admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:35.573952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-64750c92-7c03-47ac-b48f-327b18b8719c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:35.621985 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75f1ed-da13-451a-a54c-1380dae4b5cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:35.622736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75f1ed-da13-451a-a54c-1380dae4b5cb service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:35.623118 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75f1ed-da13-451a-a54c-1380dae4b5cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:35.623475 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75f1ed-da13-451a-a54c-1380dae4b5cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:35.625280 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-cb75f1ed-da13-451a-a54c-1380dae4b5cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:35.639777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:35.657393 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64750c92-7c03-47ac-b48f-327b18b8719c admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:35.662659 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f88d1-d4ed-47b7-930a-1bbfcc481389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:35.663325 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f88d1-d4ed-47b7-930a-1bbfcc481389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:35.663610 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f88d1-d4ed-47b7-930a-1bbfcc481389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:35.663883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f88d1-d4ed-47b7-930a-1bbfcc481389 admin admin] PATH_INFO: `/v3/projects/9a068f5d6f524cadbfc0a81cec28b3d1` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:35.665207 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f88d1-d4ed-47b7-930a-1bbfcc481389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a068f5d6f524cadbfc0a81cec28b3d1)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:35.668271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f88d1-d4ed-47b7-930a-1bbfcc481389 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:35.676882 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:35.722653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75f1ed-da13-451a-a54c-1380dae4b5cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:35.724501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75f1ed-da13-451a-a54c-1380dae4b5cb service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:35.725363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-e85f88d1-d4ed-47b7-930a-1bbfcc481389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a068f5d6f524cadbfc0a81cec28b3d1', 'request_id': 'req-e85f88d1-d4ed-47b7-930a-1bbfcc481389'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.733057 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-e85f88d1-d4ed-47b7-930a-1bbfcc481389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a068f5d6f524cadbfc0a81cec28b3d1', 'request_id': 'req-e85f88d1-d4ed-47b7-930a-1bbfcc481389'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.739011 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1375/2728] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:46:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:46:35.740831 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-e85f88d1-d4ed-47b7-930a-1bbfcc481389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a068f5d6f524cadbfc0a81cec28b3d1', 'request_id': 'req-e85f88d1-d4ed-47b7-930a-1bbfcc481389'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.753376 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-e85f88d1-d4ed-47b7-930a-1bbfcc481389 admin admin] The token cache is being invalidate because project 9a068f5d6f524cadbfc0a81cec28b3d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:46:35.753616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-e85f88d1-d4ed-47b7-930a-1bbfcc481389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.754230 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-e85f88d1-d4ed-47b7-930a-1bbfcc481389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.755737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1354/2729] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:46:35 2022] DELETE /identity/v3/projects/9a068f5d6f524cadbfc0a81cec28b3d1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:35.759859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75f1ed-da13-451a-a54c-1380dae4b5cb service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:35.771348 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75f1ed-da13-451a-a54c-1380dae4b5cb service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:35.832305 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf42fc-ab50-49eb-b75f-738883fe1321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:35.832931 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf42fc-ab50-49eb-b75f-738883fe1321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:35.833208 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf42fc-ab50-49eb-b75f-738883fe1321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:35.833477 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf42fc-ab50-49eb-b75f-738883fe1321 admin admin] PATH_INFO: `/v3/users/53e832d23c9f4434a35e41e12aac9dba` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:35.834610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf42fc-ab50-49eb-b75f-738883fe1321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53e832d23c9f4434a35e41e12aac9dba)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:35.836530 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf42fc-ab50-49eb-b75f-738883fe1321 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:35.886235 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-46bf42fc-ab50-49eb-b75f-738883fe1321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53e832d23c9f4434a35e41e12aac9dba'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.886929 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-46bf42fc-ab50-49eb-b75f-738883fe1321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53e832d23c9f4434a35e41e12aac9dba'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.887670 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-46bf42fc-ab50-49eb-b75f-738883fe1321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53e832d23c9f4434a35e41e12aac9dba'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.899464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-46bf42fc-ab50-49eb-b75f-738883fe1321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53e832d23c9f4434a35e41e12aac9dba'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.906208 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-46bf42fc-ab50-49eb-b75f-738883fe1321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53e832d23c9f4434a35e41e12aac9dba'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:35.920707 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1376/2730] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:46:35 2022] DELETE /identity/v3/users/53e832d23c9f4434a35e41e12aac9dba => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:36.409629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f88d1-d4ed-47b7-930a-1bbfcc481389 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:36.411171 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e85f88d1-d4ed-47b7-930a-1bbfcc481389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:36.426044 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f88d1-d4ed-47b7-930a-1bbfcc481389 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:36.483449 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d300d5-f682-413b-ac0b-06195f4df507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:36.484079 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d300d5-f682-413b-ac0b-06195f4df507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:36.484356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d300d5-f682-413b-ac0b-06195f4df507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:36.484629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d300d5-f682-413b-ac0b-06195f4df507 admin admin] PATH_INFO: `/v3/projects/24b9563f59494c269e3a1d976a1cf5bc` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:36.485732 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d300d5-f682-413b-ac0b-06195f4df507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b9563f59494c269e3a1d976a1cf5bc)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:36.487687 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d300d5-f682-413b-ac0b-06195f4df507 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:36.536446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-e5d300d5-f682-413b-ac0b-06195f4df507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b9563f59494c269e3a1d976a1cf5bc', 'request_id': 'req-e5d300d5-f682-413b-ac0b-06195f4df507'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:36.542071 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-e5d300d5-f682-413b-ac0b-06195f4df507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b9563f59494c269e3a1d976a1cf5bc', 'request_id': 'req-e5d300d5-f682-413b-ac0b-06195f4df507'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:36.548146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-e5d300d5-f682-413b-ac0b-06195f4df507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b9563f59494c269e3a1d976a1cf5bc', 'request_id': 'req-e5d300d5-f682-413b-ac0b-06195f4df507'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:36.560150 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-e5d300d5-f682-413b-ac0b-06195f4df507 admin admin] The token cache is being invalidate because project 24b9563f59494c269e3a1d976a1cf5bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:46:36.560431 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-e5d300d5-f682-413b-ac0b-06195f4df507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:36.561054 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-e5d300d5-f682-413b-ac0b-06195f4df507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:46:36.562494 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1355/2731] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:46:36 2022] DELETE /identity/v3/projects/24b9563f59494c269e3a1d976a1cf5bc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:36.567430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a866b-ae07-45dc-be21-d19651834b2c None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:36.567911 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a866b-ae07-45dc-be21-d19651834b2c None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:36.568010 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a866b-ae07-45dc-be21-d19651834b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:36.588166 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-eb1a866b-ae07-45dc-be21-d19651834b2c None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:36.589332 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-eb1a866b-ae07-45dc-be21-d19651834b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:36.628933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:36.650489 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1377/2732] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:46:36.658943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6719a1a-3609-42bf-b9c3-43764427634f None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:36.659401 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6719a1a-3609-42bf-b9c3-43764427634f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:36.659498 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6719a1a-3609-42bf-b9c3-43764427634f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:36.799401 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-b6719a1a-3609-42bf-b9c3-43764427634f None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:36.800611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b6719a1a-3609-42bf-b9c3-43764427634f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:36.808473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1356/2733] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:46:36.812734 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a866b-ae07-45dc-be21-d19651834b2c None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:36.822565 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a866b-ae07-45dc-be21-d19651834b2c None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:36.827187 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c2e43-8bb1-4539-ac37-5a3b9104a04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:36.827775 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c2e43-8bb1-4539-ac37-5a3b9104a04f admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:36.828051 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c2e43-8bb1-4539-ac37-5a3b9104a04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:36.828320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c2e43-8bb1-4539-ac37-5a3b9104a04f admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:36.829010 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c2e43-8bb1-4539-ac37-5a3b9104a04f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:46:36.829579 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c2e43-8bb1-4539-ac37-5a3b9104a04f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:36.831177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c2e43-8bb1-4539-ac37-5a3b9104a04f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:36.842474 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1378/2734] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:46:36.847454 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6719a1a-3609-42bf-b9c3-43764427634f None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:36.856628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6719a1a-3609-42bf-b9c3-43764427634f None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:36.862524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6b4ec-71a6-4473-9b18-77ec15f3a1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:36.863170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6b4ec-71a6-4473-9b18-77ec15f3a1dd admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:36.863451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6b4ec-71a6-4473-9b18-77ec15f3a1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:36.863724 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6b4ec-71a6-4473-9b18-77ec15f3a1dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:36.864372 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6b4ec-71a6-4473-9b18-77ec15f3a1dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:36.866267 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6b4ec-71a6-4473-9b18-77ec15f3a1dd admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:36.871099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:36.895777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1357/2735] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:46:36 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:46:36.899943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c2e43-8bb1-4539-ac37-5a3b9104a04f admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:36.910430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c2e43-8bb1-4539-ac37-5a3b9104a04f admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:36.966814 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07199025-0f41-4440-adb5-9ef2c9b73408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:36.967417 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07199025-0f41-4440-adb5-9ef2c9b73408 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:36.967728 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07199025-0f41-4440-adb5-9ef2c9b73408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:36.968010 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07199025-0f41-4440-adb5-9ef2c9b73408 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:36.968639 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07199025-0f41-4440-adb5-9ef2c9b73408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:36.971091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07199025-0f41-4440-adb5-9ef2c9b73408 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:36.995468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1379/2736] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:46:36 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:46:36.996732 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6b4ec-71a6-4473-9b18-77ec15f3a1dd admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:37.007686 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6b4ec-71a6-4473-9b18-77ec15f3a1dd admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:37.013656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de67860-a32e-41c7-8638-0a121457be82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:37.014268 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de67860-a32e-41c7-8638-0a121457be82 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:37.014573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de67860-a32e-41c7-8638-0a121457be82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:37.014862 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de67860-a32e-41c7-8638-0a121457be82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:37.015534 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de67860-a32e-41c7-8638-0a121457be82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:37.017770 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de67860-a32e-41c7-8638-0a121457be82 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:37.027903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1358/2737] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:46:37.032008 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07199025-0f41-4440-adb5-9ef2c9b73408 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:37.042194 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07199025-0f41-4440-adb5-9ef2c9b73408 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:37.047101 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c51244-f506-4bc5-994b-f5477386b8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:37.047727 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c51244-f506-4bc5-994b-f5477386b8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:37.048012 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c51244-f506-4bc5-994b-f5477386b8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:37.048279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c51244-f506-4bc5-994b-f5477386b8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:37.048945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c51244-f506-4bc5-994b-f5477386b8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:37.050545 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c51244-f506-4bc5-994b-f5477386b8b2 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:37.061588 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1380/2738] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:46:37.066669 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de67860-a32e-41c7-8638-0a121457be82 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:37.076678 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de67860-a32e-41c7-8638-0a121457be82 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:37.081653 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4d98c-40bc-4f46-b71f-aec9cbe91545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:37.082301 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4d98c-40bc-4f46-b71f-aec9cbe91545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:37.082582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4d98c-40bc-4f46-b71f-aec9cbe91545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:37.082884 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4d98c-40bc-4f46-b71f-aec9cbe91545 admin admin] PATH_INFO: `/v3/projects/6a0a42f8dc0f4321b650bfa358908aa6/users/75fb84f08f7e4eb4a2735a5a73d40d8d/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:37.098374 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4d98c-40bc-4f46-b71f-aec9cbe91545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0a42f8dc0f4321b650bfa358908aa6, user_id=75fb84f08f7e4eb4a2735a5a73d40d8d, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:37.100963 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4d98c-40bc-4f46-b71f-aec9cbe91545 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:37.114473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1359/2739] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:46:37 2022] PUT /identity/v3/projects/6a0a42f8dc0f4321b650bfa358908aa6/users/75fb84f08f7e4eb4a2735a5a73d40d8d/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:46:37.119444 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bfb41-4667-4ece-9c88-20cfb82665fe None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:37.119793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bfb41-4667-4ece-9c88-20cfb82665fe None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:37.120097 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bfb41-4667-4ece-9c88-20cfb82665fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:37.142142 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-d84bfb41-4667-4ece-9c88-20cfb82665fe None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:37.143399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d84bfb41-4667-4ece-9c88-20cfb82665fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:37.202427 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1381/2740] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:46:37.213272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4d98c-40bc-4f46-b71f-aec9cbe91545 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:37.215228 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-39b4d98c-40bc-4f46-b71f-aec9cbe91545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:37.272409 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4d98c-40bc-4f46-b71f-aec9cbe91545 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:37.275980 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621196eb-4d21-412e-b5b6-4e417b8fa1d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:37.276569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621196eb-4d21-412e-b5b6-4e417b8fa1d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:37.276841 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621196eb-4d21-412e-b5b6-4e417b8fa1d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:37.277106 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621196eb-4d21-412e-b5b6-4e417b8fa1d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:37.286413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621196eb-4d21-412e-b5b6-4e417b8fa1d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:37.287843 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621196eb-4d21-412e-b5b6-4e417b8fa1d8 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:37.296953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1360/2741] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:46:37.934423 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a213f-59ad-4659-8bf9-44e42c36d638 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:37.934984 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a213f-59ad-4659-8bf9-44e42c36d638 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:37.934984 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a213f-59ad-4659-8bf9-44e42c36d638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:37.964080 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-315a213f-59ad-4659-8bf9-44e42c36d638 None None] MFA Rules not processed for user `75fb84f08f7e4eb4a2735a5a73d40d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:37.965192 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-315a213f-59ad-4659-8bf9-44e42c36d638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:38.007842 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:38.033260 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1382/2742] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:46:38.043763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621196eb-4d21-412e-b5b6-4e417b8fa1d8 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:38.045142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-621196eb-4d21-412e-b5b6-4e417b8fa1d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:38.103217 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621196eb-4d21-412e-b5b6-4e417b8fa1d8 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:38.106726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6842d-6171-4395-b351-cfdb8eac0976 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:38.107351 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6842d-6171-4395-b351-cfdb8eac0976 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:38.107625 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6842d-6171-4395-b351-cfdb8eac0976 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:38.107891 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6842d-6171-4395-b351-cfdb8eac0976 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:38.116957 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6842d-6171-4395-b351-cfdb8eac0976 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:38.118365 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6842d-6171-4395-b351-cfdb8eac0976 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:38.127185 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1361/2743] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:46:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:46:39.590711 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae9745-7c18-4dc6-978d-b6edc01bce5a None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:39.591377 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae9745-7c18-4dc6-978d-b6edc01bce5a None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:39.591377 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae9745-7c18-4dc6-978d-b6edc01bce5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:39.610883 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-d6ae9745-7c18-4dc6-978d-b6edc01bce5a None None] MFA Rules not processed for user `75fb84f08f7e4eb4a2735a5a73d40d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:46:39.612070 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d6ae9745-7c18-4dc6-978d-b6edc01bce5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:39.618817 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1383/2744] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:46:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:46:42.792415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6842d-6171-4395-b351-cfdb8eac0976 service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:46:42.793822 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-01a6842d-6171-4395-b351-cfdb8eac0976 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:42.806197 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6842d-6171-4395-b351-cfdb8eac0976 service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:46:42.809695 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9fb96-3ffa-4b49-9584-87d930a2c687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:46:42.810267 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9fb96-3ffa-4b49-9584-87d930a2c687 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:46:42.810538 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9fb96-3ffa-4b49-9584-87d930a2c687 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:46:42.810806 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9fb96-3ffa-4b49-9584-87d930a2c687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:46:42.813086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-47e9fb96-3ffa-4b49-9584-87d930a2c687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:46:42.822455 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9fb96-3ffa-4b49-9584-87d930a2c687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:46:42.823917 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9fb96-3ffa-4b49-9584-87d930a2c687 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:46:42.832340 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1362/2745] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:46:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:46:49.605383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=12 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:52.828202 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=79,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:47:13.571387 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295925c-d122-4b2f-9920-35ce3600710c None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:47:13.571963 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295925c-d122-4b2f-9920-35ce3600710c None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:47:13.571963 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295925c-d122-4b2f-9920-35ce3600710c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:47:13.591926 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-2295925c-d122-4b2f-9920-35ce3600710c None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:47:13.593116 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-2295925c-d122-4b2f-9920-35ce3600710c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:47:13.601232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1384/2746] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Sep 26 01:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:47:13.616594 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9fb96-3ffa-4b49-9584-87d930a2c687 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:47:13.618200 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-47e9fb96-3ffa-4b49-9584-87d930a2c687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:47:13.691700 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9fb96-3ffa-4b49-9584-87d930a2c687 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:47:13.697137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2101ba-d476-4945-9fd5-4f40d85659f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:47:13.697736 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2101ba-d476-4945-9fd5-4f40d85659f7 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:47:13.698017 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2101ba-d476-4945-9fd5-4f40d85659f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:47:13.698293 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2101ba-d476-4945-9fd5-4f40d85659f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:47:13.707360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2101ba-d476-4945-9fd5-4f40d85659f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:47:13.708915 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2101ba-d476-4945-9fd5-4f40d85659f7 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:47:13.718373 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1363/2747] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:47:16.627623 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c875ce-555e-48c8-b50d-ccbb92b85374 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:47:16.628158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c875ce-555e-48c8-b50d-ccbb92b85374 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:47:16.628158 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c875ce-555e-48c8-b50d-ccbb92b85374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:47:16.647181 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-f1c875ce-555e-48c8-b50d-ccbb92b85374 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:47:16.648380 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f1c875ce-555e-48c8-b50d-ccbb92b85374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:47:16.657127 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1385/2748] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Sep 26 01:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:47:16.670848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2101ba-d476-4945-9fd5-4f40d85659f7 service nova] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:47:16.673106 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2a2101ba-d476-4945-9fd5-4f40d85659f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:47:16.687888 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2101ba-d476-4945-9fd5-4f40d85659f7 service nova] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:47:16.693661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb84dd-97dd-41ba-9225-6fc89618d393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:47:16.694244 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb84dd-97dd-41ba-9225-6fc89618d393 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:47:16.694518 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb84dd-97dd-41ba-9225-6fc89618d393 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:47:16.694786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb84dd-97dd-41ba-9225-6fc89618d393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:47:16.703133 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb84dd-97dd-41ba-9225-6fc89618d393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:47:16.704780 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb84dd-97dd-41ba-9225-6fc89618d393 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:47:16.713921 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1364/2749] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:47:19.874226 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf56fe-2538-46d5-b6c6-b1f1f61d21a1 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:47:19.875123 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf56fe-2538-46d5-b6c6-b1f1f61d21a1 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:47:19.875123 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf56fe-2538-46d5-b6c6-b1f1f61d21a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:47:19.895597 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-5ccf56fe-2538-46d5-b6c6-b1f1f61d21a1 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:47:19.896795 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-5ccf56fe-2538-46d5-b6c6-b1f1f61d21a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:47:19.904631 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1386/2750] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Sep 26 01:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:47:19.918968 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb84dd-97dd-41ba-9225-6fc89618d393 service nova] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:47:19.930575 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb84dd-97dd-41ba-9225-6fc89618d393 service nova] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:47:19.936056 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6dbc7-f120-4ad3-a50e-a3aa77b815e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:47:19.936643 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6dbc7-f120-4ad3-a50e-a3aa77b815e7 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:47:19.936921 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6dbc7-f120-4ad3-a50e-a3aa77b815e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:47:19.937346 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6dbc7-f120-4ad3-a50e-a3aa77b815e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:47:19.945545 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6dbc7-f120-4ad3-a50e-a3aa77b815e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:47:19.947129 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6dbc7-f120-4ad3-a50e-a3aa77b815e7 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:47:19.957328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1365/2751] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:47:22.970392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b766e4-1539-4b34-b863-ea4be3c784c9 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:47:22.970975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b766e4-1539-4b34-b863-ea4be3c784c9 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:47:22.970975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b766e4-1539-4b34-b863-ea4be3c784c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:47:22.990254 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-d3b766e4-1539-4b34-b863-ea4be3c784c9 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:47:22.991476 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d3b766e4-1539-4b34-b863-ea4be3c784c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:47:22.999131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1387/2752] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Sep 26 01:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:47:23.013588 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6dbc7-f120-4ad3-a50e-a3aa77b815e7 service nova] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:47:23.025666 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6dbc7-f120-4ad3-a50e-a3aa77b815e7 service nova] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:47:23.031123 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74d763-d057-4315-a485-0430603216e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:47:23.031703 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74d763-d057-4315-a485-0430603216e1 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:47:23.032531 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74d763-d057-4315-a485-0430603216e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:47:23.032800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74d763-d057-4315-a485-0430603216e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:47:23.040712 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74d763-d057-4315-a485-0430603216e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:47:23.042239 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74d763-d057-4315-a485-0430603216e1 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:47:23.051480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1366/2753] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:47:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:47:27.165937 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2711c30-1a46-4b69-8394-250c3fdded82 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:47:27.166429 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2711c30-1a46-4b69-8394-250c3fdded82 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:47:27.166542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2711c30-1a46-4b69-8394-250c3fdded82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:47:27.186092 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-d2711c30-1a46-4b69-8394-250c3fdded82 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:47:27.187311 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d2711c30-1a46-4b69-8394-250c3fdded82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:47:27.195087 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1388/2754] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Sep 26 01:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:47:27.210922 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74d763-d057-4315-a485-0430603216e1 service nova] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:47:27.222932 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74d763-d057-4315-a485-0430603216e1 service nova] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:47:27.228582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd45d1-6661-4d10-aacd-a1d50d9b2b4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:47:27.229172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd45d1-6661-4d10-aacd-a1d50d9b2b4e service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:47:27.229448 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd45d1-6661-4d10-aacd-a1d50d9b2b4e service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:47:27.229719 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd45d1-6661-4d10-aacd-a1d50d9b2b4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:47:27.238478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd45d1-6661-4d10-aacd-a1d50d9b2b4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:47:27.240052 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd45d1-6661-4d10-aacd-a1d50d9b2b4e service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:47:27.249276 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1367/2755] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:47:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:47:30.331676 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac89f6-c304-45b9-b696-38791bbc4a88 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:47:30.332198 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac89f6-c304-45b9-b696-38791bbc4a88 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:47:30.332311 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac89f6-c304-45b9-b696-38791bbc4a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:47:30.360315 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-fbac89f6-c304-45b9-b696-38791bbc4a88 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:47:30.361531 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-fbac89f6-c304-45b9-b696-38791bbc4a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:47:30.369613 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1389/2756] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Sep 26 01:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:47:30.385809 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd45d1-6661-4d10-aacd-a1d50d9b2b4e service nova] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:47:30.398390 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd45d1-6661-4d10-aacd-a1d50d9b2b4e service nova] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:47:30.403973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c7193-0615-43fb-90fb-1e4ea5552ad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:47:30.404569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c7193-0615-43fb-90fb-1e4ea5552ad8 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:47:30.404850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c7193-0615-43fb-90fb-1e4ea5552ad8 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:47:30.405124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c7193-0615-43fb-90fb-1e4ea5552ad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:47:30.414385 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c7193-0615-43fb-90fb-1e4ea5552ad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:47:30.415974 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c7193-0615-43fb-90fb-1e4ea5552ad8 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:47:30.425289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1368/2757] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:47:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:47:40.235007 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac89f6-c304-45b9-b696-38791bbc4a88 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:47:40.242154 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=19 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:47:40.251898 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac89f6-c304-45b9-b696-38791bbc4a88 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:47:40.258930 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec03d0-b593-4f7a-aa6e-aa275a791741 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:47:40.259578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec03d0-b593-4f7a-aa6e-aa275a791741 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:47:40.259851 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec03d0-b593-4f7a-aa6e-aa275a791741 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:47:40.260141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec03d0-b593-4f7a-aa6e-aa275a791741 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:47:40.262021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-fdec03d0-b593-4f7a-aa6e-aa275a791741 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:47:40.274986 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec03d0-b593-4f7a-aa6e-aa275a791741 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:47:40.276530 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec03d0-b593-4f7a-aa6e-aa275a791741 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:47:40.287908 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1390/2758] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:47:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:47:40.421051 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=64 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:47:45.460248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f55720-ce5e-4933-98e8-1898cb9b26ca None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:47:45.460889 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f55720-ce5e-4933-98e8-1898cb9b26ca None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:47:45.460889 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f55720-ce5e-4933-98e8-1898cb9b26ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:47:45.481027 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-89f55720-ce5e-4933-98e8-1898cb9b26ca None None] MFA Rules not processed for user `75fb84f08f7e4eb4a2735a5a73d40d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:47:45.482229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-89f55720-ce5e-4933-98e8-1898cb9b26ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:47:45.489036 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1369/2759] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:47:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:47:45.717976 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec03d0-b593-4f7a-aa6e-aa275a791741 service nova] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:47:45.727552 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec03d0-b593-4f7a-aa6e-aa275a791741 service nova] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:47:45.731083 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0c6b1-981e-408d-a8db-a3c2d7081feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:47:45.731662 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0c6b1-981e-408d-a8db-a3c2d7081feb service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:47:45.731940 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0c6b1-981e-408d-a8db-a3c2d7081feb service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:47:45.732211 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0c6b1-981e-408d-a8db-a3c2d7081feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:47:45.733892 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-95c0c6b1-981e-408d-a8db-a3c2d7081feb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:47:45.743176 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0c6b1-981e-408d-a8db-a3c2d7081feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:47:45.744561 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0c6b1-981e-408d-a8db-a3c2d7081feb service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:47:45.752942 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1391/2760] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:47:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:47:46.076200 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f55720-ce5e-4933-98e8-1898cb9b26ca None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:47:46.077877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-89f55720-ce5e-4933-98e8-1898cb9b26ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:47:46.149634 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f55720-ce5e-4933-98e8-1898cb9b26ca None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:47:46.154476 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055b8fe-0a1a-4929-a8c3-82a68409ac28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7a1b839a6f4bdb9870217fa4d2527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:47:46.155115 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055b8fe-0a1a-4929-a8c3-82a68409ac28 service placement] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:47:46.155381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055b8fe-0a1a-4929-a8c3-82a68409ac28 service placement] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:47:46.155651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055b8fe-0a1a-4929-a8c3-82a68409ac28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:47:46.157337 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7055b8fe-0a1a-4929-a8c3-82a68409ac28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:47:46.168969 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055b8fe-0a1a-4929-a8c3-82a68409ac28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:47:46.170525 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055b8fe-0a1a-4929-a8c3-82a68409ac28 service placement] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:47:46.180297 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1370/2761] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:47:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:47:54.511152 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0c6b1-981e-408d-a8db-a3c2d7081feb service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:47:54.525733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0c6b1-981e-408d-a8db-a3c2d7081feb service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:47:54.531448 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85e1fd-b11c-47c4-af84-1ce4ec66ffa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:47:54.532028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85e1fd-b11c-47c4-af84-1ce4ec66ffa9 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:47:54.532516 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85e1fd-b11c-47c4-af84-1ce4ec66ffa9 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:47:54.532646 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85e1fd-b11c-47c4-af84-1ce4ec66ffa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:47:54.534419 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0e85e1fd-b11c-47c4-af84-1ce4ec66ffa9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:47:54.546725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85e1fd-b11c-47c4-af84-1ce4ec66ffa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:47:54.549146 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85e1fd-b11c-47c4-af84-1ce4ec66ffa9 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:47:54.559955 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1392/2762] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:47:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:47:56.176193 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=35 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:47:59.395172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7ae95-7453-4e7b-89c1-d346222be635 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:47:59.395848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7ae95-7453-4e7b-89c1-d346222be635 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:47:59.395848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7ae95-7453-4e7b-89c1-d346222be635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:47:59.417033 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-4ad7ae95-7453-4e7b-89c1-d346222be635 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:47:59.418199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4ad7ae95-7453-4e7b-89c1-d346222be635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:47:59.427116 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1371/2763] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Sep 26 01:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:47:59.440673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85e1fd-b11c-47c4-af84-1ce4ec66ffa9 service nova] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:47:59.452156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85e1fd-b11c-47c4-af84-1ce4ec66ffa9 service nova] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:47:59.458426 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff325364-a1d3-44db-a46c-d799433c59b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:47:59.459117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff325364-a1d3-44db-a46c-d799433c59b8 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:47:59.459395 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff325364-a1d3-44db-a46c-d799433c59b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:47:59.459666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff325364-a1d3-44db-a46c-d799433c59b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:47:59.468571 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff325364-a1d3-44db-a46c-d799433c59b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:47:59.470639 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff325364-a1d3-44db-a46c-d799433c59b8 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:47:59.480859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1393/2764] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:47:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:48:02.690923 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccf184-bc52-4011-9f61-a620f20068b9 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:02.691481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccf184-bc52-4011-9f61-a620f20068b9 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:02.691481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccf184-bc52-4011-9f61-a620f20068b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:02.712218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-30ccf184-bc52-4011-9f61-a620f20068b9 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:48:02.713400 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-30ccf184-bc52-4011-9f61-a620f20068b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:02.721032 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1372/2765] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Sep 26 01:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:48:02.734539 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff325364-a1d3-44db-a46c-d799433c59b8 service nova] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:02.746330 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff325364-a1d3-44db-a46c-d799433c59b8 service nova] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:02.751688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c60acc-f813-4539-a752-baf061f982fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:02.752264 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c60acc-f813-4539-a752-baf061f982fa service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:02.752541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c60acc-f813-4539-a752-baf061f982fa service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:02.752810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c60acc-f813-4539-a752-baf061f982fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:02.761406 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c60acc-f813-4539-a752-baf061f982fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:02.762972 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c60acc-f813-4539-a752-baf061f982fa service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:02.772262 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1394/2766] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:48:05.754249 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82402810-96c9-4f44-8e89-898add5ef64c None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:05.754754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82402810-96c9-4f44-8e89-898add5ef64c None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:05.754927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82402810-96c9-4f44-8e89-898add5ef64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:05.774221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-82402810-96c9-4f44-8e89-898add5ef64c None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:48:05.775430 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-82402810-96c9-4f44-8e89-898add5ef64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:05.783090 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1373/2767] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Sep 26 01:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:48:05.797598 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c60acc-f813-4539-a752-baf061f982fa service nova] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:05.808751 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c60acc-f813-4539-a752-baf061f982fa service nova] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:05.814159 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e6f24-4a21-4000-8e65-258de0bbe09f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:05.814767 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e6f24-4a21-4000-8e65-258de0bbe09f service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:05.815078 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e6f24-4a21-4000-8e65-258de0bbe09f service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:05.815358 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e6f24-4a21-4000-8e65-258de0bbe09f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:05.823396 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e6f24-4a21-4000-8e65-258de0bbe09f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:05.824944 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e6f24-4a21-4000-8e65-258de0bbe09f service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:05.835040 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1395/2768] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:48:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:48:08.914358 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8493e3-782c-4a27-80c1-8ca0a20bf43d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:08.914856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8493e3-782c-4a27-80c1-8ca0a20bf43d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:08.914976 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8493e3-782c-4a27-80c1-8ca0a20bf43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:08.934695 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-de8493e3-782c-4a27-80c1-8ca0a20bf43d None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:48:08.935916 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-de8493e3-782c-4a27-80c1-8ca0a20bf43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:08.944341 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1374/2769] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Sep 26 01:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:48:08.959392 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e6f24-4a21-4000-8e65-258de0bbe09f service nova] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:08.970428 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e6f24-4a21-4000-8e65-258de0bbe09f service nova] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:08.975875 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08383da7-b170-433f-980b-2c514dbb8f50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:08.976458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08383da7-b170-433f-980b-2c514dbb8f50 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:08.976741 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08383da7-b170-433f-980b-2c514dbb8f50 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:08.977036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08383da7-b170-433f-980b-2c514dbb8f50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:08.985447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08383da7-b170-433f-980b-2c514dbb8f50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:08.987036 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08383da7-b170-433f-980b-2c514dbb8f50 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:08.997195 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1396/2770] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:48:13.114378 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9c481-f860-4384-9e7e-671441661310 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:13.114950 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9c481-f860-4384-9e7e-671441661310 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:13.115066 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9c481-f860-4384-9e7e-671441661310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:13.135524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-d9e9c481-f860-4384-9e7e-671441661310 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:48:13.136725 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d9e9c481-f860-4384-9e7e-671441661310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:13.144545 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1375/2771] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Sep 26 01:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:48:13.159002 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08383da7-b170-433f-980b-2c514dbb8f50 service nova] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:13.165367 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=42 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:48:13.171823 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08383da7-b170-433f-980b-2c514dbb8f50 service nova] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:13.177883 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791c03c-66d0-44ea-b750-e98950974041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:13.178465 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791c03c-66d0-44ea-b750-e98950974041 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:13.178746 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791c03c-66d0-44ea-b750-e98950974041 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:13.179053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791c03c-66d0-44ea-b750-e98950974041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:13.187055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791c03c-66d0-44ea-b750-e98950974041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:13.188610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791c03c-66d0-44ea-b750-e98950974041 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:13.197988 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1397/2772] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:48:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:48:23.130309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=15 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:48:23.193696 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=5 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:48:28.809937 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c5e57-dd4b-44d9-b8d7-09e2115212cf None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:28.810423 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c5e57-dd4b-44d9-b8d7-09e2115212cf None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:28.810542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c5e57-dd4b-44d9-b8d7-09e2115212cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:28.830312 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-0f9c5e57-dd4b-44d9-b8d7-09e2115212cf None None] MFA Rules not processed for user `3fdaa4ff741f4417a35931341e70446a`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:48:28.831615 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0f9c5e57-dd4b-44d9-b8d7-09e2115212cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:28.887251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1376/2773] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:48:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:48:38.880760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=25 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:48:43.579995 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791c03c-66d0-44ea-b750-e98950974041 service nova] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:43.591886 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791c03c-66d0-44ea-b750-e98950974041 service nova] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:43.597346 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa49e5-8e78-45e7-9fd0-ef691f97c1a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7a1b839a6f4bdb9870217fa4d2527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:43.597978 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa49e5-8e78-45e7-9fd0-ef691f97c1a3 service placement] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:43.598261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa49e5-8e78-45e7-9fd0-ef691f97c1a3 service placement] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:43.598565 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa49e5-8e78-45e7-9fd0-ef691f97c1a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:43.600378 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-abfa49e5-8e78-45e7-9fd0-ef691f97c1a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:43.612635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa49e5-8e78-45e7-9fd0-ef691f97c1a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:43.614305 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa49e5-8e78-45e7-9fd0-ef691f97c1a3 service placement] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:43.629544 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1398/2774] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:48:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:48:43.636050 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c5e57-dd4b-44d9-b8d7-09e2115212cf None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:43.648420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c5e57-dd4b-44d9-b8d7-09e2115212cf None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:43.654628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cf8ff-2425-476d-bd6b-f168cef1fab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:43.655294 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cf8ff-2425-476d-bd6b-f168cef1fab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:43.655569 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cf8ff-2425-476d-bd6b-f168cef1fab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:43.656029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cf8ff-2425-476d-bd6b-f168cef1fab8 admin admin] PATH_INFO: `/v3/users/75fb84f08f7e4eb4a2735a5a73d40d8d` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:43.657161 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471cf8ff-2425-476d-bd6b-f168cef1fab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75fb84f08f7e4eb4a2735a5a73d40d8d)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:43.659109 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471cf8ff-2425-476d-bd6b-f168cef1fab8 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:43.706080 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-471cf8ff-2425-476d-bd6b-f168cef1fab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75fb84f08f7e4eb4a2735a5a73d40d8d'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:43.706787 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-471cf8ff-2425-476d-bd6b-f168cef1fab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75fb84f08f7e4eb4a2735a5a73d40d8d'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:43.707406 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-471cf8ff-2425-476d-bd6b-f168cef1fab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75fb84f08f7e4eb4a2735a5a73d40d8d'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:43.718703 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-471cf8ff-2425-476d-bd6b-f168cef1fab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75fb84f08f7e4eb4a2735a5a73d40d8d'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:43.725899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-471cf8ff-2425-476d-bd6b-f168cef1fab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75fb84f08f7e4eb4a2735a5a73d40d8d'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:43.737899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1377/2775] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:48:43 2022] DELETE /identity/v3/users/75fb84f08f7e4eb4a2735a5a73d40d8d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:48:43.917488 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa49e5-8e78-45e7-9fd0-ef691f97c1a3 service placement] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:43.932447 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa49e5-8e78-45e7-9fd0-ef691f97c1a3 service placement] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:43.989817 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb62891-d020-48ff-b6a7-29009dc6de03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:43.990435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb62891-d020-48ff-b6a7-29009dc6de03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:43.990712 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb62891-d020-48ff-b6a7-29009dc6de03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:43.991014 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb62891-d020-48ff-b6a7-29009dc6de03 admin admin] PATH_INFO: `/v3/projects/6a0a42f8dc0f4321b650bfa358908aa6` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:43.992112 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb62891-d020-48ff-b6a7-29009dc6de03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a0a42f8dc0f4321b650bfa358908aa6)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:43.994030 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb62891-d020-48ff-b6a7-29009dc6de03 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:44.041062 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-eeb62891-d020-48ff-b6a7-29009dc6de03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0a42f8dc0f4321b650bfa358908aa6', 'request_id': 'req-eeb62891-d020-48ff-b6a7-29009dc6de03'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:44.047056 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-eeb62891-d020-48ff-b6a7-29009dc6de03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0a42f8dc0f4321b650bfa358908aa6', 'request_id': 'req-eeb62891-d020-48ff-b6a7-29009dc6de03'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:44.053182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-eeb62891-d020-48ff-b6a7-29009dc6de03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0a42f8dc0f4321b650bfa358908aa6', 'request_id': 'req-eeb62891-d020-48ff-b6a7-29009dc6de03'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:44.065706 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-eeb62891-d020-48ff-b6a7-29009dc6de03 admin admin] The token cache is being invalidate because project 6a0a42f8dc0f4321b650bfa358908aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:48:44.066012 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-eeb62891-d020-48ff-b6a7-29009dc6de03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:44.066635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-eeb62891-d020-48ff-b6a7-29009dc6de03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:44.068137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1399/2776] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:48:43 2022] DELETE /identity/v3/projects/6a0a42f8dc0f4321b650bfa358908aa6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:48:44.073196 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a05f37-fa48-4bd4-9866-7a5578ec49b6 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:44.073644 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a05f37-fa48-4bd4-9866-7a5578ec49b6 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:44.073984 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a05f37-fa48-4bd4-9866-7a5578ec49b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:44.093709 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-d7a05f37-fa48-4bd4-9866-7a5578ec49b6 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:48:44.094956 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d7a05f37-fa48-4bd4-9866-7a5578ec49b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:44.154681 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1378/2777] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:48:44.163155 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59180366-6664-4cd4-9482-f79b69f334e4 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:44.163446 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59180366-6664-4cd4-9482-f79b69f334e4 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:44.163725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59180366-6664-4cd4-9482-f79b69f334e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:44.184205 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-59180366-6664-4cd4-9482-f79b69f334e4 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:48:44.185411 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-59180366-6664-4cd4-9482-f79b69f334e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:44.193526 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1400/2778] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:48:44.197633 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a05f37-fa48-4bd4-9866-7a5578ec49b6 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:44.208030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a05f37-fa48-4bd4-9866-7a5578ec49b6 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:44.212587 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e739e-99d9-4d01-9297-ade807710362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:44.213178 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e739e-99d9-4d01-9297-ade807710362 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:44.213457 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e739e-99d9-4d01-9297-ade807710362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:44.213750 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e739e-99d9-4d01-9297-ade807710362 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:44.214366 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e739e-99d9-4d01-9297-ade807710362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:48:44.214670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e739e-99d9-4d01-9297-ade807710362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:44.216288 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e739e-99d9-4d01-9297-ade807710362 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:44.229655 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1379/2779] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:48:44.233884 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59180366-6664-4cd4-9482-f79b69f334e4 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:44.243165 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59180366-6664-4cd4-9482-f79b69f334e4 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:44.247830 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacd107-4781-455e-998d-3931d2d6c39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:44.248518 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacd107-4781-455e-998d-3931d2d6c39f admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:44.248793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacd107-4781-455e-998d-3931d2d6c39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:44.249061 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacd107-4781-455e-998d-3931d2d6c39f admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:44.249695 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacd107-4781-455e-998d-3931d2d6c39f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:44.251610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacd107-4781-455e-998d-3931d2d6c39f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:44.279372 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1401/2780] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:48:44 2022] POST /identity/v3/projects => generated 397 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:48:44.283645 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e739e-99d9-4d01-9297-ade807710362 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:44.293617 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e739e-99d9-4d01-9297-ade807710362 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:44.349787 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c457d60-9576-41b2-8def-0318100525c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:44.350380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c457d60-9576-41b2-8def-0318100525c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:44.350657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c457d60-9576-41b2-8def-0318100525c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:44.350959 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c457d60-9576-41b2-8def-0318100525c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:44.351591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c457d60-9576-41b2-8def-0318100525c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:44.353486 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c457d60-9576-41b2-8def-0318100525c7 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:44.361461 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:48:44.376591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1380/2781] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:48:44 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:48:44.380746 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacd107-4781-455e-998d-3931d2d6c39f admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:44.391065 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacd107-4781-455e-998d-3931d2d6c39f admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:44.397546 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664981b8-6425-4225-ad9a-8cbb03cc7b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:44.398154 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664981b8-6425-4225-ad9a-8cbb03cc7b14 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:44.398430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664981b8-6425-4225-ad9a-8cbb03cc7b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:44.398698 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664981b8-6425-4225-ad9a-8cbb03cc7b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:44.399364 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664981b8-6425-4225-ad9a-8cbb03cc7b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:44.400924 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664981b8-6425-4225-ad9a-8cbb03cc7b14 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:44.411987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1402/2782] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:48:44.415893 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c457d60-9576-41b2-8def-0318100525c7 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:44.426020 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c457d60-9576-41b2-8def-0318100525c7 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:44.430639 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2c06c-1e78-4dea-b8ef-882a113a7763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:44.431249 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2c06c-1e78-4dea-b8ef-882a113a7763 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:44.431526 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2c06c-1e78-4dea-b8ef-882a113a7763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:44.431800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2c06c-1e78-4dea-b8ef-882a113a7763 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:44.432434 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2c06c-1e78-4dea-b8ef-882a113a7763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:44.433998 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2c06c-1e78-4dea-b8ef-882a113a7763 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:44.444524 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1381/2783] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:48:44.448272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664981b8-6425-4225-ad9a-8cbb03cc7b14 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:44.459307 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664981b8-6425-4225-ad9a-8cbb03cc7b14 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:44.463909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c545084-549a-4da3-a77c-02add82fd2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:44.464541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c545084-549a-4da3-a77c-02add82fd2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:44.464816 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c545084-549a-4da3-a77c-02add82fd2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:44.465084 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c545084-549a-4da3-a77c-02add82fd2b2 admin admin] PATH_INFO: `/v3/projects/09e0fcfd828341018cec8f89ac604892/users/b80f87c3bd674f9c8ae405d43894d546/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:44.480223 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c545084-549a-4da3-a77c-02add82fd2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e0fcfd828341018cec8f89ac604892, user_id=b80f87c3bd674f9c8ae405d43894d546, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:44.482847 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c545084-549a-4da3-a77c-02add82fd2b2 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:44.495123 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1403/2784] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:48:44 2022] PUT /identity/v3/projects/09e0fcfd828341018cec8f89ac604892/users/b80f87c3bd674f9c8ae405d43894d546/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:48:44.506716 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638cd55-290d-489a-a2a9-2b8a3b5eb135 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:44.507028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638cd55-290d-489a-a2a9-2b8a3b5eb135 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:44.507302 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638cd55-290d-489a-a2a9-2b8a3b5eb135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:44.534766 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-3638cd55-290d-489a-a2a9-2b8a3b5eb135 None None] MFA Rules not processed for user `b80f87c3bd674f9c8ae405d43894d546`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:48:44.535982 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3638cd55-290d-489a-a2a9-2b8a3b5eb135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:44.600092 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1382/2785] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:48:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:48:44.611246 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c545084-549a-4da3-a77c-02add82fd2b2 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:44.613052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-7c545084-549a-4da3-a77c-02add82fd2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:44.628073 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:48:44.672326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c545084-549a-4da3-a77c-02add82fd2b2 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:44.676856 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0e98b-c37c-4a99-b5f6-c8b9fd0103f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:44.677455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0e98b-c37c-4a99-b5f6-c8b9fd0103f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:44.677737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0e98b-c37c-4a99-b5f6-c8b9fd0103f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:44.678012 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0e98b-c37c-4a99-b5f6-c8b9fd0103f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:44.686276 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0e98b-c37c-4a99-b5f6-c8b9fd0103f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:44.687727 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0e98b-c37c-4a99-b5f6-c8b9fd0103f4 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:44.696859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1404/2786] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:48:44 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:48:49.675859 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638cd55-290d-489a-a2a9-2b8a3b5eb135 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:49.736475 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638cd55-290d-489a-a2a9-2b8a3b5eb135 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:49.741869 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df888b-1b11-4965-b85d-2dca32166d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:49.742497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df888b-1b11-4965-b85d-2dca32166d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:49.742779 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df888b-1b11-4965-b85d-2dca32166d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:49.743084 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df888b-1b11-4965-b85d-2dca32166d20 admin admin] PATH_INFO: `/v3/users/b80f87c3bd674f9c8ae405d43894d546` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:49.744245 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df888b-1b11-4965-b85d-2dca32166d20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b80f87c3bd674f9c8ae405d43894d546)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:49.746151 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df888b-1b11-4965-b85d-2dca32166d20 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:49.792479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f1df888b-1b11-4965-b85d-2dca32166d20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b80f87c3bd674f9c8ae405d43894d546'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:49.793130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f1df888b-1b11-4965-b85d-2dca32166d20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b80f87c3bd674f9c8ae405d43894d546'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:49.793754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f1df888b-1b11-4965-b85d-2dca32166d20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b80f87c3bd674f9c8ae405d43894d546'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:49.806116 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f1df888b-1b11-4965-b85d-2dca32166d20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b80f87c3bd674f9c8ae405d43894d546'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:49.810746 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:48:49.813829 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f1df888b-1b11-4965-b85d-2dca32166d20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b80f87c3bd674f9c8ae405d43894d546'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:49.827379 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1383/2787] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:48:49 2022] DELETE /identity/v3/users/b80f87c3bd674f9c8ae405d43894d546 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:48:49.832008 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ce923-ba9f-49e3-a4e8-922825e6867e None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:49.832483 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ce923-ba9f-49e3-a4e8-922825e6867e None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:49.832584 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ce923-ba9f-49e3-a4e8-922825e6867e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:49.853765 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-256ce923-ba9f-49e3-a4e8-922825e6867e None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:48:49.854992 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-256ce923-ba9f-49e3-a4e8-922825e6867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:49.913819 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1405/2788] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:48:49.923522 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df888b-1b11-4965-b85d-2dca32166d20 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:49.925648 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f1df888b-1b11-4965-b85d-2dca32166d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:49.982142 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df888b-1b11-4965-b85d-2dca32166d20 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:49.985751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d293a-e70f-4787-960a-855317e561a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:49.986341 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d293a-e70f-4787-960a-855317e561a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:49.987382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d293a-e70f-4787-960a-855317e561a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:49.987737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d293a-e70f-4787-960a-855317e561a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:49.996587 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d293a-e70f-4787-960a-855317e561a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:49.998004 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d293a-e70f-4787-960a-855317e561a8 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:50.007521 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1384/2789] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:48:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:48:50.270992 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ce923-ba9f-49e3-a4e8-922825e6867e None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:50.272848 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-256ce923-ba9f-49e3-a4e8-922825e6867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:50.285724 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ce923-ba9f-49e3-a4e8-922825e6867e None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:50.290420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7729cf-dec7-46a7-a531-efeb6244dd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:50.291088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7729cf-dec7-46a7-a531-efeb6244dd5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:50.291367 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7729cf-dec7-46a7-a531-efeb6244dd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:50.291638 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7729cf-dec7-46a7-a531-efeb6244dd5b admin admin] PATH_INFO: `/v3/projects/09e0fcfd828341018cec8f89ac604892` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:50.293274 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7729cf-dec7-46a7-a531-efeb6244dd5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=09e0fcfd828341018cec8f89ac604892)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:50.294627 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7729cf-dec7-46a7-a531-efeb6244dd5b admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:50.342412 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-fd7729cf-dec7-46a7-a531-efeb6244dd5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09e0fcfd828341018cec8f89ac604892', 'request_id': 'req-fd7729cf-dec7-46a7-a531-efeb6244dd5b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:50.348941 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-fd7729cf-dec7-46a7-a531-efeb6244dd5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09e0fcfd828341018cec8f89ac604892', 'request_id': 'req-fd7729cf-dec7-46a7-a531-efeb6244dd5b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:50.354589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-fd7729cf-dec7-46a7-a531-efeb6244dd5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09e0fcfd828341018cec8f89ac604892', 'request_id': 'req-fd7729cf-dec7-46a7-a531-efeb6244dd5b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:50.366736 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-fd7729cf-dec7-46a7-a531-efeb6244dd5b admin admin] The token cache is being invalidate because project 09e0fcfd828341018cec8f89ac604892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:48:50.367076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-fd7729cf-dec7-46a7-a531-efeb6244dd5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:50.367766 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-fd7729cf-dec7-46a7-a531-efeb6244dd5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:48:50.369292 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1406/2790] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:48:50 2022] DELETE /identity/v3/projects/09e0fcfd828341018cec8f89ac604892 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:48:50.374510 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253bddb-c343-4623-92fb-e37659834c44 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:50.374793 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253bddb-c343-4623-92fb-e37659834c44 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:50.375100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253bddb-c343-4623-92fb-e37659834c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:50.395301 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-8253bddb-c343-4623-92fb-e37659834c44 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:48:50.396490 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8253bddb-c343-4623-92fb-e37659834c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:50.455930 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1385/2791] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:48:50.463571 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd48cbd-45a4-4609-9ed7-4b9641d3517a None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:50.463861 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd48cbd-45a4-4609-9ed7-4b9641d3517a None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:50.464136 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd48cbd-45a4-4609-9ed7-4b9641d3517a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:50.484476 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-9dd48cbd-45a4-4609-9ed7-4b9641d3517a None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:48:50.485690 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-9dd48cbd-45a4-4609-9ed7-4b9641d3517a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:50.493747 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1407/2792] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:48:50.497978 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253bddb-c343-4623-92fb-e37659834c44 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:50.508451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253bddb-c343-4623-92fb-e37659834c44 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:50.512988 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d01cfc-ddbf-425d-b2de-ed194ccfc413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:50.513582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d01cfc-ddbf-425d-b2de-ed194ccfc413 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:50.513860 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d01cfc-ddbf-425d-b2de-ed194ccfc413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:50.514131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d01cfc-ddbf-425d-b2de-ed194ccfc413 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:50.514800 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d01cfc-ddbf-425d-b2de-ed194ccfc413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:48:50.515130 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d01cfc-ddbf-425d-b2de-ed194ccfc413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:50.516708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d01cfc-ddbf-425d-b2de-ed194ccfc413 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:50.528566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1386/2793] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:48:50.532665 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd48cbd-45a4-4609-9ed7-4b9641d3517a None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:50.541840 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd48cbd-45a4-4609-9ed7-4b9641d3517a None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:50.546540 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee3857-1530-4c3c-bc5c-53cd6de550eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:50.547171 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee3857-1530-4c3c-bc5c-53cd6de550eb admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:50.547443 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee3857-1530-4c3c-bc5c-53cd6de550eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:50.547714 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee3857-1530-4c3c-bc5c-53cd6de550eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:50.548347 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee3857-1530-4c3c-bc5c-53cd6de550eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:50.550241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee3857-1530-4c3c-bc5c-53cd6de550eb admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:50.578361 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1408/2794] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:48:50 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:48:50.583146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d01cfc-ddbf-425d-b2de-ed194ccfc413 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:50.592886 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d01cfc-ddbf-425d-b2de-ed194ccfc413 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:50.648010 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178de01-e240-4fa3-8dc9-8b0508bef7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:50.648608 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178de01-e240-4fa3-8dc9-8b0508bef7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:50.648887 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178de01-e240-4fa3-8dc9-8b0508bef7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:50.649158 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178de01-e240-4fa3-8dc9-8b0508bef7a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:50.649765 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178de01-e240-4fa3-8dc9-8b0508bef7a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:50.651669 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178de01-e240-4fa3-8dc9-8b0508bef7a7 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:50.672970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1387/2795] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:48:50 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:48:50.677026 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee3857-1530-4c3c-bc5c-53cd6de550eb admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:50.687340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee3857-1530-4c3c-bc5c-53cd6de550eb admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:50.692566 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425e7c3-fcce-4ca4-bfbb-409e952cab24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:50.693155 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425e7c3-fcce-4ca4-bfbb-409e952cab24 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:50.693441 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425e7c3-fcce-4ca4-bfbb-409e952cab24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:50.693715 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425e7c3-fcce-4ca4-bfbb-409e952cab24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:50.694358 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425e7c3-fcce-4ca4-bfbb-409e952cab24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:50.695984 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425e7c3-fcce-4ca4-bfbb-409e952cab24 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:50.701542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:48:50.708248 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1409/2796] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:48:50.711477 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178de01-e240-4fa3-8dc9-8b0508bef7a7 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:50.721242 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178de01-e240-4fa3-8dc9-8b0508bef7a7 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:50.726002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39db8b7-bbc9-4e18-9082-0a85aa19855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:50.726591 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39db8b7-bbc9-4e18-9082-0a85aa19855d admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:50.726907 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39db8b7-bbc9-4e18-9082-0a85aa19855d admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:50.727184 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39db8b7-bbc9-4e18-9082-0a85aa19855d admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:50.727818 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39db8b7-bbc9-4e18-9082-0a85aa19855d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:50.729390 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39db8b7-bbc9-4e18-9082-0a85aa19855d admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:50.730609 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:48:50.741371 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1388/2797] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:48:50.745135 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425e7c3-fcce-4ca4-bfbb-409e952cab24 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:50.755758 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425e7c3-fcce-4ca4-bfbb-409e952cab24 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:50.760357 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d8155-732d-49e0-9fe3-f1b87dfea74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:50.760990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d8155-732d-49e0-9fe3-f1b87dfea74a admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:50.761272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d8155-732d-49e0-9fe3-f1b87dfea74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:50.761547 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d8155-732d-49e0-9fe3-f1b87dfea74a admin admin] PATH_INFO: `/v3/projects/c42b158825a74506b2de0bc3336e96e4/users/a2d8dd684de84972979037c60ef54a77/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:50.776354 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d8155-732d-49e0-9fe3-f1b87dfea74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42b158825a74506b2de0bc3336e96e4, user_id=a2d8dd684de84972979037c60ef54a77, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:50.779011 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d8155-732d-49e0-9fe3-f1b87dfea74a admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:50.791238 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1410/2798] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:48:50 2022] PUT /identity/v3/projects/c42b158825a74506b2de0bc3336e96e4/users/a2d8dd684de84972979037c60ef54a77/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:48:50.796351 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f1f58-2df8-4244-b701-7d654853f78c None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:50.796641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f1f58-2df8-4244-b701-7d654853f78c None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:50.796921 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f1f58-2df8-4244-b701-7d654853f78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:50.816265 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-4e9f1f58-2df8-4244-b701-7d654853f78c None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:48:50.817466 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4e9f1f58-2df8-4244-b701-7d654853f78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:50.875763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1389/2799] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:48:50.887785 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d8155-732d-49e0-9fe3-f1b87dfea74a admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:50.889571 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-ad7d8155-732d-49e0-9fe3-f1b87dfea74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:50.950597 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d8155-732d-49e0-9fe3-f1b87dfea74a admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:50.954252 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390f9b9-fb67-4aea-934e-9bb71f8a0512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:50.954869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390f9b9-fb67-4aea-934e-9bb71f8a0512 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:50.955156 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390f9b9-fb67-4aea-934e-9bb71f8a0512 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:50.955493 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390f9b9-fb67-4aea-934e-9bb71f8a0512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:50.964673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390f9b9-fb67-4aea-934e-9bb71f8a0512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:50.966087 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390f9b9-fb67-4aea-934e-9bb71f8a0512 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:50.975878 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1411/2800] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:48:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:48:54.886336 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87ba16-d799-4149-9f38-ef79b91d7b49 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:54.886901 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87ba16-d799-4149-9f38-ef79b91d7b49 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:54.886901 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87ba16-d799-4149-9f38-ef79b91d7b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:54.923324 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-ba87ba16-d799-4149-9f38-ef79b91d7b49 None None] MFA Rules not processed for user `a2d8dd684de84972979037c60ef54a77`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:48:54.925261 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ba87ba16-d799-4149-9f38-ef79b91d7b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:55.003777 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1390/2801] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:48:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:48:55.005406 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390f9b9-fb67-4aea-934e-9bb71f8a0512 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:55.016859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390f9b9-fb67-4aea-934e-9bb71f8a0512 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:55.022732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43819b-e57d-4907-a584-7992319ce208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:55.023370 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43819b-e57d-4907-a584-7992319ce208 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:55.023647 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43819b-e57d-4907-a584-7992319ce208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:55.023916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43819b-e57d-4907-a584-7992319ce208 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:55.024562 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43819b-e57d-4907-a584-7992319ce208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:55.026461 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43819b-e57d-4907-a584-7992319ce208 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:55.060824 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1412/2802] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:48:55 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:48:55.061875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87ba16-d799-4149-9f38-ef79b91d7b49 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:55.092053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87ba16-d799-4149-9f38-ef79b91d7b49 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:55.166392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a202975-5e4a-4f5f-8f68-2c09500027ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:55.167475 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a202975-5e4a-4f5f-8f68-2c09500027ae admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:55.167945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a202975-5e4a-4f5f-8f68-2c09500027ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:55.168221 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a202975-5e4a-4f5f-8f68-2c09500027ae admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:55.169121 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a202975-5e4a-4f5f-8f68-2c09500027ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:55.171427 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a202975-5e4a-4f5f-8f68-2c09500027ae admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:55.203263 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1391/2803] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:48:55 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:48:55.208383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43819b-e57d-4907-a584-7992319ce208 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:55.219776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43819b-e57d-4907-a584-7992319ce208 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:55.224771 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cc51b-8bc0-48aa-925a-0970d3ed6a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:55.225385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cc51b-8bc0-48aa-925a-0970d3ed6a99 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:55.225671 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cc51b-8bc0-48aa-925a-0970d3ed6a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:55.225944 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cc51b-8bc0-48aa-925a-0970d3ed6a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:55.226763 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cc51b-8bc0-48aa-925a-0970d3ed6a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:55.228577 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cc51b-8bc0-48aa-925a-0970d3ed6a99 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:55.243395 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1413/2804] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:48:55.244572 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a202975-5e4a-4f5f-8f68-2c09500027ae admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:55.255611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a202975-5e4a-4f5f-8f68-2c09500027ae admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:55.260301 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022c94f-341d-408b-ac55-eae6ea01cfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:55.260972 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022c94f-341d-408b-ac55-eae6ea01cfba admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:55.261382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022c94f-341d-408b-ac55-eae6ea01cfba admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:55.261660 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022c94f-341d-408b-ac55-eae6ea01cfba admin admin] PATH_INFO: `/v3/projects/dc5658917eb647178af3c4b18eabd8ce/users/042a80f671a34833bc43e09ff33f3f16/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:55.275948 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:48:55.279808 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022c94f-341d-408b-ac55-eae6ea01cfba admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5658917eb647178af3c4b18eabd8ce, user_id=042a80f671a34833bc43e09ff33f3f16, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:55.283517 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022c94f-341d-408b-ac55-eae6ea01cfba admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:55.297704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1392/2805] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:48:55 2022] PUT /identity/v3/projects/dc5658917eb647178af3c4b18eabd8ce/users/042a80f671a34833bc43e09ff33f3f16/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:48:55.301990 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cc51b-8bc0-48aa-925a-0970d3ed6a99 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:55.312260 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cc51b-8bc0-48aa-925a-0970d3ed6a99 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:55.373052 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c2dbf-a0ae-4a74-9eb1-2be8427cbb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:55.373668 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c2dbf-a0ae-4a74-9eb1-2be8427cbb96 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:55.373950 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c2dbf-a0ae-4a74-9eb1-2be8427cbb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:55.374224 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c2dbf-a0ae-4a74-9eb1-2be8427cbb96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:55.374902 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c2dbf-a0ae-4a74-9eb1-2be8427cbb96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:55.376514 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c2dbf-a0ae-4a74-9eb1-2be8427cbb96 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:55.387464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1414/2806] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:48:55.391611 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022c94f-341d-408b-ac55-eae6ea01cfba admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:55.403027 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022c94f-341d-408b-ac55-eae6ea01cfba admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:55.407682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061237ca-1869-4454-9e86-4ea38ce39357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:55.409289 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061237ca-1869-4454-9e86-4ea38ce39357 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:55.409567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061237ca-1869-4454-9e86-4ea38ce39357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:55.409841 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061237ca-1869-4454-9e86-4ea38ce39357 admin admin] PATH_INFO: `/v3/projects/dc5658917eb647178af3c4b18eabd8ce/users/042a80f671a34833bc43e09ff33f3f16/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:55.411875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061237ca-1869-4454-9e86-4ea38ce39357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5658917eb647178af3c4b18eabd8ce, user_id=042a80f671a34833bc43e09ff33f3f16, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:48:55.414488 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061237ca-1869-4454-9e86-4ea38ce39357 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:48:55.426549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1393/2807] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:48:55 2022] PUT /identity/v3/projects/dc5658917eb647178af3c4b18eabd8ce/users/042a80f671a34833bc43e09ff33f3f16/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:48:59.722320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe179c-70ef-46b8-870d-0019f2a64257 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:59.722854 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe179c-70ef-46b8-870d-0019f2a64257 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:59.722960 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe179c-70ef-46b8-870d-0019f2a64257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:59.752939 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-9dbe179c-70ef-46b8-870d-0019f2a64257 None None] MFA Rules not processed for user `042a80f671a34833bc43e09ff33f3f16`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:48:59.754157 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-9dbe179c-70ef-46b8-870d-0019f2a64257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:59.786371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:48:59.827550 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1415/2808] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:48:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:48:59.839825 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061237ca-1869-4454-9e86-4ea38ce39357 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:48:59.841540 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-061237ca-1869-4454-9e86-4ea38ce39357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:48:59.926153 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061237ca-1869-4454-9e86-4ea38ce39357 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:48:59.930014 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d368f33-917f-46ae-82d5-b56b6859c462 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15538b95acef435798ff7651fc1710cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:48:59.930621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d368f33-917f-46ae-82d5-b56b6859c462 service glance] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:48:59.930934 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d368f33-917f-46ae-82d5-b56b6859c462 service glance] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:48:59.931208 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d368f33-917f-46ae-82d5-b56b6859c462 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:48:59.999474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d368f33-917f-46ae-82d5-b56b6859c462 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:49:00.001149 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d368f33-917f-46ae-82d5-b56b6859c462 service glance] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:49:00.011344 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1394/2809] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:48:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:49:00.147820 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b0cb7-e2e0-48c7-9715-27987e6fda10 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:49:00.148165 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b0cb7-e2e0-48c7-9715-27987e6fda10 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:49:00.148451 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b0cb7-e2e0-48c7-9715-27987e6fda10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:49:00.202600 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-c94b0cb7-e2e0-48c7-9715-27987e6fda10 None None] MFA Rules not processed for user `6f4696c410f343709be200dee463bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:49:00.203862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c94b0cb7-e2e0-48c7-9715-27987e6fda10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:49:00.279691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1416/2810] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 26 01:49:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:49:00.328220 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d368f33-917f-46ae-82d5-b56b6859c462 service glance] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:49:00.329660 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8d368f33-917f-46ae-82d5-b56b6859c462 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:49:00.426515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:49:00.442031 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d368f33-917f-46ae-82d5-b56b6859c462 service glance] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:49:00.447116 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900372e-d33d-4d66-a8bf-0e465ce0b0a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c924da83d1a94c49814d2e7b5969c8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:49:00.447719 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900372e-d33d-4d66-a8bf-0e465ce0b0a8 service swift] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:49:00.447996 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900372e-d33d-4d66-a8bf-0e465ce0b0a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:49:00.448267 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900372e-d33d-4d66-a8bf-0e465ce0b0a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:49:00.456813 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900372e-d33d-4d66-a8bf-0e465ce0b0a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:49:00.458448 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900372e-d33d-4d66-a8bf-0e465ce0b0a8 service swift] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:49:00.466577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1395/2811] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 26 01:49:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 01:49:09.341287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6c5fc-aeaf-43e3-b5d7-d90e2018e9fe None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:49:09.341816 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6c5fc-aeaf-43e3-b5d7-d90e2018e9fe None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:49:09.341816 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6c5fc-aeaf-43e3-b5d7-d90e2018e9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:49:09.362223 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-e8a6c5fc-aeaf-43e3-b5d7-d90e2018e9fe None None] MFA Rules not processed for user `a2d8dd684de84972979037c60ef54a77`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:49:09.363499 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e8a6c5fc-aeaf-43e3-b5d7-d90e2018e9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:49:09.370288 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1417/2812] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:49:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:49:10.463270 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=8 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:49:11.199946 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c7ee2-d217-43b8-969d-7760879dd00b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:49:11.200167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c7ee2-d217-43b8-969d-7760879dd00b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:49:11.200439 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c7ee2-d217-43b8-969d-7760879dd00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:49:11.222081 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-544c7ee2-d217-43b8-969d-7760879dd00b None None] MFA Rules not processed for user `6f4696c410f343709be200dee463bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:49:11.223340 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-544c7ee2-d217-43b8-969d-7760879dd00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:49:11.230880 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1396/2813] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 26 01:49:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:49:11.243883 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6c5fc-aeaf-43e3-b5d7-d90e2018e9fe None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:49:11.255784 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6c5fc-aeaf-43e3-b5d7-d90e2018e9fe None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:49:11.260850 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6979ad9-a046-48b3-a11e-a778c70e28c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c924da83d1a94c49814d2e7b5969c8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:49:11.261478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6979ad9-a046-48b3-a11e-a778c70e28c7 service swift] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:49:11.261761 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6979ad9-a046-48b3-a11e-a778c70e28c7 service swift] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:49:11.262037 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6979ad9-a046-48b3-a11e-a778c70e28c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:49:11.271314 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6979ad9-a046-48b3-a11e-a778c70e28c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:49:11.272885 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6979ad9-a046-48b3-a11e-a778c70e28c7 service swift] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:49:11.281111 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1418/2814] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 26 01:49:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 01:49:21.216058 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:49:21.277995 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=64 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:49:29.055053 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c7ee2-d217-43b8-969d-7760879dd00b None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:49:29.056540 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-544c7ee2-d217-43b8-969d-7760879dd00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:49:29.132969 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c7ee2-d217-43b8-969d-7760879dd00b None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:49:29.138179 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6af11-4809-4cb6-9810-e91dfaa3c32a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7a1b839a6f4bdb9870217fa4d2527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:49:29.138854 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6af11-4809-4cb6-9810-e91dfaa3c32a service placement] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:49:29.139149 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6af11-4809-4cb6-9810-e91dfaa3c32a service placement] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:49:29.139421 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6af11-4809-4cb6-9810-e91dfaa3c32a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:49:29.141255 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-19d6af11-4809-4cb6-9810-e91dfaa3c32a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:49:29.153831 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6af11-4809-4cb6-9810-e91dfaa3c32a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:49:29.155994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6af11-4809-4cb6-9810-e91dfaa3c32a service placement] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:49:29.166651 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1397/2815] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:49:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:49:38.846565 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6979ad9-a046-48b3-a11e-a778c70e28c7 service swift] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:49:38.848086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a6979ad9-a046-48b3-a11e-a778c70e28c7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:49:38.902915 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6979ad9-a046-48b3-a11e-a778c70e28c7 service swift] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:49:38.906478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc31e5f-ce77-459a-b38d-a8be8524af37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:49:38.907701 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc31e5f-ce77-459a-b38d-a8be8524af37 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:49:38.908028 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc31e5f-ce77-459a-b38d-a8be8524af37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:49:38.908260 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc31e5f-ce77-459a-b38d-a8be8524af37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:49:38.917152 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc31e5f-ce77-459a-b38d-a8be8524af37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:49:38.918609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc31e5f-ce77-459a-b38d-a8be8524af37 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:49:38.928586 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1419/2816] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:49:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:49:39.162920 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=32 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:49:48.924408 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=26 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:49:55.401275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6af11-4809-4cb6-9810-e91dfaa3c32a service placement] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:49:55.402914 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-19d6af11-4809-4cb6-9810-e91dfaa3c32a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:49:55.474965 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6af11-4809-4cb6-9810-e91dfaa3c32a service placement] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:49:55.480434 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ceccb4-155c-46c5-9ee9-bf7538f192e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:49:55.481026 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceccb4-155c-46c5-9ee9-bf7538f192e3 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:49:55.481301 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceccb4-155c-46c5-9ee9-bf7538f192e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:49:55.481567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceccb4-155c-46c5-9ee9-bf7538f192e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:49:55.483315 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b5ceccb4-155c-46c5-9ee9-bf7538f192e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:49:55.540036 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ceccb4-155c-46c5-9ee9-bf7538f192e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:49:55.541622 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ceccb4-155c-46c5-9ee9-bf7538f192e3 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:49:55.551170 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1398/2817] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:49:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:50:05.546309 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=56 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:50:06.373303 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffca7d-3196-4a6b-912b-9b53f96d98ac None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:50:06.373838 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffca7d-3196-4a6b-912b-9b53f96d98ac None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:50:06.373838 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffca7d-3196-4a6b-912b-9b53f96d98ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:50:06.392897 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-efffca7d-3196-4a6b-912b-9b53f96d98ac None None] MFA Rules not processed for user `3fdaa4ff741f4417a35931341e70446a`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:50:06.394144 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-efffca7d-3196-4a6b-912b-9b53f96d98ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:50:06.401053 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1420/2818] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:50:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:50:06.703249 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ceccb4-155c-46c5-9ee9-bf7538f192e3 service nova] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:50:06.712961 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ceccb4-155c-46c5-9ee9-bf7538f192e3 service nova] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:50:06.716519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56a14e-2735-45e3-b49f-9463598d4754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:50:06.717105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56a14e-2735-45e3-b49f-9463598d4754 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:50:06.717380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56a14e-2735-45e3-b49f-9463598d4754 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:50:06.717649 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56a14e-2735-45e3-b49f-9463598d4754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:50:06.719355 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ff56a14e-2735-45e3-b49f-9463598d4754 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:50:06.729100 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56a14e-2735-45e3-b49f-9463598d4754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:50:06.730489 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56a14e-2735-45e3-b49f-9463598d4754 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:50:06.738248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1399/2819] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:50:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:50:16.388139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:50:16.734718 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=6 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:51:35.204548 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffca7d-3196-4a6b-912b-9b53f96d98ac None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:35.206488 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-efffca7d-3196-4a6b-912b-9b53f96d98ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:51:35.262018 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffca7d-3196-4a6b-912b-9b53f96d98ac None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:35.265597 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff0793-4a83-4932-8547-c90654d96234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:35.266169 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff0793-4a83-4932-8547-c90654d96234 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:35.266446 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff0793-4a83-4932-8547-c90654d96234 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:35.266718 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff0793-4a83-4932-8547-c90654d96234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:35.269189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f4ff0793-4a83-4932-8547-c90654d96234 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:51:35.282223 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff0793-4a83-4932-8547-c90654d96234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:35.283866 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff0793-4a83-4932-8547-c90654d96234 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:35.294580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1421/2820] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:51:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 01:51:37.895784 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56a14e-2735-45e3-b49f-9463598d4754 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:37.904885 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56a14e-2735-45e3-b49f-9463598d4754 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:37.909096 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad49612-f3c5-4d05-83c6-1639049c32a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:37.909676 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad49612-f3c5-4d05-83c6-1639049c32a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:37.909953 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad49612-f3c5-4d05-83c6-1639049c32a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:37.910222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad49612-f3c5-4d05-83c6-1639049c32a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:37.911940 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1ad49612-f3c5-4d05-83c6-1639049c32a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:51:37.925412 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad49612-f3c5-4d05-83c6-1639049c32a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:37.926909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad49612-f3c5-4d05-83c6-1639049c32a0 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:37.937647 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1400/2821] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:51:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:51:45.289882 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=26 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:51:47.292635 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff0793-4a83-4932-8547-c90654d96234 service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:47.302450 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff0793-4a83-4932-8547-c90654d96234 service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:47.305984 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa0779-1d0a-46a5-b8fc-02549d037bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:47.306560 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa0779-1d0a-46a5-b8fc-02549d037bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:47.306879 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa0779-1d0a-46a5-b8fc-02549d037bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:47.307131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa0779-1d0a-46a5-b8fc-02549d037bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:47.308852 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a2aa0779-1d0a-46a5-b8fc-02549d037bc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:51:47.370678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa0779-1d0a-46a5-b8fc-02549d037bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:47.372124 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa0779-1d0a-46a5-b8fc-02549d037bc2 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:47.382144 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1422/2822] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:51:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:51:47.932857 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=6 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:51:50.449209 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad49612-f3c5-4d05-83c6-1639049c32a0 service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:50.450706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1ad49612-f3c5-4d05-83c6-1639049c32a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:51:50.464754 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad49612-f3c5-4d05-83c6-1639049c32a0 service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:50.476482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339aea12-1a59-4943-8179-09bb1e59dede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:50.477124 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aea12-1a59-4943-8179-09bb1e59dede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:50.477739 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aea12-1a59-4943-8179-09bb1e59dede admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:50.478019 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aea12-1a59-4943-8179-09bb1e59dede admin admin] PATH_INFO: `/v3/users/3fdaa4ff741f4417a35931341e70446a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:50.479226 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339aea12-1a59-4943-8179-09bb1e59dede admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fdaa4ff741f4417a35931341e70446a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:50.481138 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339aea12-1a59-4943-8179-09bb1e59dede admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:50.528850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-339aea12-1a59-4943-8179-09bb1e59dede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fdaa4ff741f4417a35931341e70446a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:50.529502 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-339aea12-1a59-4943-8179-09bb1e59dede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fdaa4ff741f4417a35931341e70446a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:50.530101 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-339aea12-1a59-4943-8179-09bb1e59dede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fdaa4ff741f4417a35931341e70446a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:50.541837 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-339aea12-1a59-4943-8179-09bb1e59dede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fdaa4ff741f4417a35931341e70446a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:50.549128 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-339aea12-1a59-4943-8179-09bb1e59dede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fdaa4ff741f4417a35931341e70446a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:50.561878 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1401/2823] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:51:50 2022] DELETE /identity/v3/users/3fdaa4ff741f4417a35931341e70446a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:51:50.734417 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa0779-1d0a-46a5-b8fc-02549d037bc2 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:50.746630 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa0779-1d0a-46a5-b8fc-02549d037bc2 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:50.803692 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f236d06-4fb4-47b0-9a9e-2da1607d6d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:50.804334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f236d06-4fb4-47b0-9a9e-2da1607d6d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:50.804594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f236d06-4fb4-47b0-9a9e-2da1607d6d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:50.804868 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f236d06-4fb4-47b0-9a9e-2da1607d6d80 admin admin] PATH_INFO: `/v3/projects/f07b274501ce4c02a9ee39f621109822` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:50.805978 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f236d06-4fb4-47b0-9a9e-2da1607d6d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f07b274501ce4c02a9ee39f621109822)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:50.807926 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f236d06-4fb4-47b0-9a9e-2da1607d6d80 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:50.857914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9f236d06-4fb4-47b0-9a9e-2da1607d6d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f07b274501ce4c02a9ee39f621109822', 'request_id': 'req-9f236d06-4fb4-47b0-9a9e-2da1607d6d80'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:50.864609 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9f236d06-4fb4-47b0-9a9e-2da1607d6d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f07b274501ce4c02a9ee39f621109822', 'request_id': 'req-9f236d06-4fb4-47b0-9a9e-2da1607d6d80'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:50.870136 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9f236d06-4fb4-47b0-9a9e-2da1607d6d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f07b274501ce4c02a9ee39f621109822', 'request_id': 'req-9f236d06-4fb4-47b0-9a9e-2da1607d6d80'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:50.883016 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9f236d06-4fb4-47b0-9a9e-2da1607d6d80 admin admin] The token cache is being invalidate because project f07b274501ce4c02a9ee39f621109822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:51:50.883303 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9f236d06-4fb4-47b0-9a9e-2da1607d6d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:50.883919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9f236d06-4fb4-47b0-9a9e-2da1607d6d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:50.885553 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1423/2824] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:51:50 2022] DELETE /identity/v3/projects/f07b274501ce4c02a9ee39f621109822 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:51:50.890530 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc847b-54c6-4807-b808-1f9064e85293 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:50.890855 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc847b-54c6-4807-b808-1f9064e85293 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:50.891147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc847b-54c6-4807-b808-1f9064e85293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:50.911316 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2ddc847b-54c6-4807-b808-1f9064e85293 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:51:50.912507 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2ddc847b-54c6-4807-b808-1f9064e85293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:51:50.972731 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1402/2825] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:51:50.980550 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3ce68-b52f-42d9-a35d-59d0ed889649 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:50.980859 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3ce68-b52f-42d9-a35d-59d0ed889649 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:50.981130 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3ce68-b52f-42d9-a35d-59d0ed889649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:51.000612 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-bbb3ce68-b52f-42d9-a35d-59d0ed889649 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:51:51.002734 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-bbb3ce68-b52f-42d9-a35d-59d0ed889649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:51:51.010470 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1424/2826] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:51:51.014942 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc847b-54c6-4807-b808-1f9064e85293 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:51.025004 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc847b-54c6-4807-b808-1f9064e85293 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:51.029573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6878a3-49e7-4160-a1ed-68c8051345c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:51.030173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6878a3-49e7-4160-a1ed-68c8051345c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:51.030453 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6878a3-49e7-4160-a1ed-68c8051345c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:51.030728 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6878a3-49e7-4160-a1ed-68c8051345c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:51.031411 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6878a3-49e7-4160-a1ed-68c8051345c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:51:51.031720 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6878a3-49e7-4160-a1ed-68c8051345c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:51.034097 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6878a3-49e7-4160-a1ed-68c8051345c0 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:51.046549 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1403/2827] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:51:51.051888 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3ce68-b52f-42d9-a35d-59d0ed889649 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:51.061435 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3ce68-b52f-42d9-a35d-59d0ed889649 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:51.066452 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8deff5-0a94-426d-b2b5-3a2208c3e88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:51.067086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8deff5-0a94-426d-b2b5-3a2208c3e88c admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:51.067371 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8deff5-0a94-426d-b2b5-3a2208c3e88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:51.067647 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8deff5-0a94-426d-b2b5-3a2208c3e88c admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:51.068320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8deff5-0a94-426d-b2b5-3a2208c3e88c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:51.070457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8deff5-0a94-426d-b2b5-3a2208c3e88c admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:51.086902 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:51:51.101489 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1425/2828] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:51:51 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:51:51.105742 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6878a3-49e7-4160-a1ed-68c8051345c0 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:51.119919 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6878a3-49e7-4160-a1ed-68c8051345c0 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:51.177547 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cab3f5-02bb-4efc-bbe1-654f49a5056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:51.178159 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cab3f5-02bb-4efc-bbe1-654f49a5056c admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:51.178451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cab3f5-02bb-4efc-bbe1-654f49a5056c admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:51.178704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cab3f5-02bb-4efc-bbe1-654f49a5056c admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:51.179353 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cab3f5-02bb-4efc-bbe1-654f49a5056c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:51.181233 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cab3f5-02bb-4efc-bbe1-654f49a5056c admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:51.189978 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:51:51.203750 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1404/2829] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:51:51 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:51:51.208064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8deff5-0a94-426d-b2b5-3a2208c3e88c admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:51.218382 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8deff5-0a94-426d-b2b5-3a2208c3e88c admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:51.223534 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5d396-a887-4fef-b00d-897f7debcae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:51.224131 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5d396-a887-4fef-b00d-897f7debcae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:51.224415 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5d396-a887-4fef-b00d-897f7debcae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:51.224692 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5d396-a887-4fef-b00d-897f7debcae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:51.225360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5d396-a887-4fef-b00d-897f7debcae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:51.226973 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5d396-a887-4fef-b00d-897f7debcae8 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:51.237769 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1426/2830] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:51:51.241873 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cab3f5-02bb-4efc-bbe1-654f49a5056c admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:51.253731 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cab3f5-02bb-4efc-bbe1-654f49a5056c admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:51.258394 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384381bc-0bbb-4882-bcfa-30c0d6a3e826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:51.259021 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384381bc-0bbb-4882-bcfa-30c0d6a3e826 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:51.259306 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384381bc-0bbb-4882-bcfa-30c0d6a3e826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:51.259577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384381bc-0bbb-4882-bcfa-30c0d6a3e826 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:51.260215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384381bc-0bbb-4882-bcfa-30c0d6a3e826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:51.261804 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384381bc-0bbb-4882-bcfa-30c0d6a3e826 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:51.272542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1405/2831] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:51:51.276823 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5d396-a887-4fef-b00d-897f7debcae8 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:51.286922 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5d396-a887-4fef-b00d-897f7debcae8 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:51.291526 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948a5ab-82d5-48e0-9321-380d972a4fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:51.292163 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948a5ab-82d5-48e0-9321-380d972a4fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:51.292445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948a5ab-82d5-48e0-9321-380d972a4fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:51.292723 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948a5ab-82d5-48e0-9321-380d972a4fe8 admin admin] PATH_INFO: `/v3/projects/352550dc60ce4abfaa8d8736f7df1e9b/users/7420668fc8ff49bc8ee04963c9ec1350/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:51.308255 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948a5ab-82d5-48e0-9321-380d972a4fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=352550dc60ce4abfaa8d8736f7df1e9b, user_id=7420668fc8ff49bc8ee04963c9ec1350, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:51.310946 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948a5ab-82d5-48e0-9321-380d972a4fe8 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:51.324708 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1427/2832] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:51:51 2022] PUT /identity/v3/projects/352550dc60ce4abfaa8d8736f7df1e9b/users/7420668fc8ff49bc8ee04963c9ec1350/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:51:51.335598 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994f79f-f4d3-4b0d-8098-5c66e8638ad5 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:51.335885 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994f79f-f4d3-4b0d-8098-5c66e8638ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:51.336160 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994f79f-f4d3-4b0d-8098-5c66e8638ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:51.365755 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-3994f79f-f4d3-4b0d-8098-5c66e8638ad5 None None] MFA Rules not processed for user `7420668fc8ff49bc8ee04963c9ec1350`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:51:51.366987 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3994f79f-f4d3-4b0d-8098-5c66e8638ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:51:51.430860 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1406/2833] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:51:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:51:51.442739 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948a5ab-82d5-48e0-9321-380d972a4fe8 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:51.444760 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d948a5ab-82d5-48e0-9321-380d972a4fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:51:51.521815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948a5ab-82d5-48e0-9321-380d972a4fe8 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:51.527363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f6aac-3e01-406d-95f6-c3224119eb65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:51.527958 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f6aac-3e01-406d-95f6-c3224119eb65 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:51.528240 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f6aac-3e01-406d-95f6-c3224119eb65 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:51.528516 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f6aac-3e01-406d-95f6-c3224119eb65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:51.536997 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f6aac-3e01-406d-95f6-c3224119eb65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:51.538610 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f6aac-3e01-406d-95f6-c3224119eb65 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:51.547273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1428/2834] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:51:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:51:56.735538 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994f79f-f4d3-4b0d-8098-5c66e8638ad5 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:56.797850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994f79f-f4d3-4b0d-8098-5c66e8638ad5 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:56.803060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6d9a3-cbb3-4c5b-ad30-9b751b949eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:56.803678 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6d9a3-cbb3-4c5b-ad30-9b751b949eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:56.803950 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6d9a3-cbb3-4c5b-ad30-9b751b949eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:56.804215 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6d9a3-cbb3-4c5b-ad30-9b751b949eaa admin admin] PATH_INFO: `/v3/users/7420668fc8ff49bc8ee04963c9ec1350` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:56.805311 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6d9a3-cbb3-4c5b-ad30-9b751b949eaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7420668fc8ff49bc8ee04963c9ec1350)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:56.807229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6d9a3-cbb3-4c5b-ad30-9b751b949eaa admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:56.852240 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bca6d9a3-cbb3-4c5b-ad30-9b751b949eaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7420668fc8ff49bc8ee04963c9ec1350'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:56.852889 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bca6d9a3-cbb3-4c5b-ad30-9b751b949eaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7420668fc8ff49bc8ee04963c9ec1350'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:56.853485 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bca6d9a3-cbb3-4c5b-ad30-9b751b949eaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7420668fc8ff49bc8ee04963c9ec1350'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:56.866110 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bca6d9a3-cbb3-4c5b-ad30-9b751b949eaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7420668fc8ff49bc8ee04963c9ec1350'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:56.873296 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:51:56.877482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bca6d9a3-cbb3-4c5b-ad30-9b751b949eaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7420668fc8ff49bc8ee04963c9ec1350'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:56.891323 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1407/2835] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:51:56 2022] DELETE /identity/v3/users/7420668fc8ff49bc8ee04963c9ec1350 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:51:56.896167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f64fb-c10d-4449-8162-4c5e15c90dc1 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:56.896655 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f64fb-c10d-4449-8162-4c5e15c90dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:56.896882 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f64fb-c10d-4449-8162-4c5e15c90dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:56.917088 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-1d8f64fb-c10d-4449-8162-4c5e15c90dc1 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:51:56.918227 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-1d8f64fb-c10d-4449-8162-4c5e15c90dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:51:56.976691 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1429/2836] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:51:56.987144 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6d9a3-cbb3-4c5b-ad30-9b751b949eaa admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:56.988579 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-bca6d9a3-cbb3-4c5b-ad30-9b751b949eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:51:57.044750 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6d9a3-cbb3-4c5b-ad30-9b751b949eaa admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:57.048868 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483ff81-dd98-4f4e-9088-3adb34948cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:57.049488 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483ff81-dd98-4f4e-9088-3adb34948cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:57.049761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483ff81-dd98-4f4e-9088-3adb34948cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:57.050027 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483ff81-dd98-4f4e-9088-3adb34948cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:57.059247 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483ff81-dd98-4f4e-9088-3adb34948cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:57.060680 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483ff81-dd98-4f4e-9088-3adb34948cf0 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:57.070713 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1408/2837] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:51:57.336151 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f64fb-c10d-4449-8162-4c5e15c90dc1 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:57.337677 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-1d8f64fb-c10d-4449-8162-4c5e15c90dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:51:57.351397 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f64fb-c10d-4449-8162-4c5e15c90dc1 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:57.356002 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf76253-becc-4764-a99b-e8e7948d9961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:57.356614 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf76253-becc-4764-a99b-e8e7948d9961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:57.356895 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf76253-becc-4764-a99b-e8e7948d9961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:57.357160 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf76253-becc-4764-a99b-e8e7948d9961 admin admin] PATH_INFO: `/v3/projects/352550dc60ce4abfaa8d8736f7df1e9b` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:57.358266 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf76253-becc-4764-a99b-e8e7948d9961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=352550dc60ce4abfaa8d8736f7df1e9b)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:57.360175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf76253-becc-4764-a99b-e8e7948d9961 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:57.401253 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:51:57.409403 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6cf76253-becc-4764-a99b-e8e7948d9961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352550dc60ce4abfaa8d8736f7df1e9b', 'request_id': 'req-6cf76253-becc-4764-a99b-e8e7948d9961'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:57.415933 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6cf76253-becc-4764-a99b-e8e7948d9961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352550dc60ce4abfaa8d8736f7df1e9b', 'request_id': 'req-6cf76253-becc-4764-a99b-e8e7948d9961'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:57.421457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6cf76253-becc-4764-a99b-e8e7948d9961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352550dc60ce4abfaa8d8736f7df1e9b', 'request_id': 'req-6cf76253-becc-4764-a99b-e8e7948d9961'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:57.434619 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6cf76253-becc-4764-a99b-e8e7948d9961 admin admin] The token cache is being invalidate because project 352550dc60ce4abfaa8d8736f7df1e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:51:57.434943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6cf76253-becc-4764-a99b-e8e7948d9961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:57.435555 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-6cf76253-becc-4764-a99b-e8e7948d9961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:51:57.437069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1430/2838] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:51:57 2022] DELETE /identity/v3/projects/352550dc60ce4abfaa8d8736f7df1e9b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:51:57.442618 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf03f5-5da7-4c5c-bb1f-1b7b89f44be4 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:57.443064 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf03f5-5da7-4c5c-bb1f-1b7b89f44be4 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:57.443408 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf03f5-5da7-4c5c-bb1f-1b7b89f44be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:57.463374 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-aadf03f5-5da7-4c5c-bb1f-1b7b89f44be4 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:51:57.464500 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-aadf03f5-5da7-4c5c-bb1f-1b7b89f44be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:51:57.521705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1409/2839] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:51:57.529492 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf64d90-2422-445b-906b-adcc9f6e79fc None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:57.529773 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf64d90-2422-445b-906b-adcc9f6e79fc None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:57.530043 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf64d90-2422-445b-906b-adcc9f6e79fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:57.550871 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-adf64d90-2422-445b-906b-adcc9f6e79fc None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:51:57.552055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-adf64d90-2422-445b-906b-adcc9f6e79fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:51:57.559815 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1431/2840] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:51:57.563832 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf03f5-5da7-4c5c-bb1f-1b7b89f44be4 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:57.573700 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf03f5-5da7-4c5c-bb1f-1b7b89f44be4 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:57.578285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7943b-c2bf-4939-a2b8-d70c9cafc292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:57.578903 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7943b-c2bf-4939-a2b8-d70c9cafc292 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:57.579181 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7943b-c2bf-4939-a2b8-d70c9cafc292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:57.579512 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7943b-c2bf-4939-a2b8-d70c9cafc292 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:57.580146 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7943b-c2bf-4939-a2b8-d70c9cafc292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:51:57.580446 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7943b-c2bf-4939-a2b8-d70c9cafc292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:57.582013 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7943b-c2bf-4939-a2b8-d70c9cafc292 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:57.593251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1410/2841] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:51:57.598074 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf64d90-2422-445b-906b-adcc9f6e79fc None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:57.607102 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf64d90-2422-445b-906b-adcc9f6e79fc None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:57.612393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb0658-b1c9-493e-93fe-12861b32b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:57.612978 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb0658-b1c9-493e-93fe-12861b32b27f admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:57.613250 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb0658-b1c9-493e-93fe-12861b32b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:57.613519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb0658-b1c9-493e-93fe-12861b32b27f admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:57.614137 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb0658-b1c9-493e-93fe-12861b32b27f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:57.616032 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb0658-b1c9-493e-93fe-12861b32b27f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:57.642568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1432/2842] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:51:57 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:51:57.646798 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7943b-c2bf-4939-a2b8-d70c9cafc292 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:57.656859 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7943b-c2bf-4939-a2b8-d70c9cafc292 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:57.713848 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7a82f-8638-46ba-b802-50eedfd7ad08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:57.714381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7a82f-8638-46ba-b802-50eedfd7ad08 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:57.714661 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7a82f-8638-46ba-b802-50eedfd7ad08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:57.714970 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7a82f-8638-46ba-b802-50eedfd7ad08 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:57.715604 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7a82f-8638-46ba-b802-50eedfd7ad08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:57.717495 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7a82f-8638-46ba-b802-50eedfd7ad08 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:57.738656 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1411/2843] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:51:57 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:51:57.743021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb0658-b1c9-493e-93fe-12861b32b27f admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:57.753337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb0658-b1c9-493e-93fe-12861b32b27f admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:57.757932 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae42161-0900-4796-b9af-40fe1cbaf2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:57.758515 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae42161-0900-4796-b9af-40fe1cbaf2af admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:57.758792 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae42161-0900-4796-b9af-40fe1cbaf2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:57.759091 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae42161-0900-4796-b9af-40fe1cbaf2af admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:57.759724 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae42161-0900-4796-b9af-40fe1cbaf2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:57.761308 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae42161-0900-4796-b9af-40fe1cbaf2af admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:57.771298 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1433/2844] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:51:57.775268 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7a82f-8638-46ba-b802-50eedfd7ad08 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:57.786009 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7a82f-8638-46ba-b802-50eedfd7ad08 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:57.790670 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ad71e-33dd-4540-bda0-839cadb2670d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:57.791299 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ad71e-33dd-4540-bda0-839cadb2670d admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:57.791582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ad71e-33dd-4540-bda0-839cadb2670d admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:57.791856 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ad71e-33dd-4540-bda0-839cadb2670d admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:57.792484 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ad71e-33dd-4540-bda0-839cadb2670d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:57.794062 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ad71e-33dd-4540-bda0-839cadb2670d admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:57.795314 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:51:57.807338 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1412/2845] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:51:57.811309 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae42161-0900-4796-b9af-40fe1cbaf2af admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:57.821675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae42161-0900-4796-b9af-40fe1cbaf2af admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:57.826310 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83873a16-dbc1-4aec-bbcf-d4d2fc517377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:57.826987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83873a16-dbc1-4aec-bbcf-d4d2fc517377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:57.827273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83873a16-dbc1-4aec-bbcf-d4d2fc517377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:57.827551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83873a16-dbc1-4aec-bbcf-d4d2fc517377 admin admin] PATH_INFO: `/v3/projects/f06c89e1f776468f91fb502a2fb17af8/users/0b9284dfa72b4d34a5a6069338730fb7/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:57.842297 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83873a16-dbc1-4aec-bbcf-d4d2fc517377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06c89e1f776468f91fb502a2fb17af8, user_id=0b9284dfa72b4d34a5a6069338730fb7, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:57.845038 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83873a16-dbc1-4aec-bbcf-d4d2fc517377 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:57.858068 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1434/2846] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:51:57 2022] PUT /identity/v3/projects/f06c89e1f776468f91fb502a2fb17af8/users/0b9284dfa72b4d34a5a6069338730fb7/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:51:57.868411 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5991c87-d1ef-4efe-9c52-2c820718f1f5 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:57.868693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5991c87-d1ef-4efe-9c52-2c820718f1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:57.868965 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5991c87-d1ef-4efe-9c52-2c820718f1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:57.896566 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-f5991c87-d1ef-4efe-9c52-2c820718f1f5 None None] MFA Rules not processed for user `0b9284dfa72b4d34a5a6069338730fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:51:57.897760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f5991c87-d1ef-4efe-9c52-2c820718f1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:51:57.960826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1413/2847] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:51:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:51:57.965288 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83873a16-dbc1-4aec-bbcf-d4d2fc517377 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:58.029285 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83873a16-dbc1-4aec-bbcf-d4d2fc517377 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:58.034869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48080e-1e23-473d-b49a-97ca4797fe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:58.035471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48080e-1e23-473d-b49a-97ca4797fe66 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:58.035756 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48080e-1e23-473d-b49a-97ca4797fe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:58.036033 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48080e-1e23-473d-b49a-97ca4797fe66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:58.036660 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48080e-1e23-473d-b49a-97ca4797fe66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:58.038549 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48080e-1e23-473d-b49a-97ca4797fe66 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:58.064393 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1435/2848] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:51:57 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:51:58.068828 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5991c87-d1ef-4efe-9c52-2c820718f1f5 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:58.080310 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5991c87-d1ef-4efe-9c52-2c820718f1f5 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:58.134803 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aadfdc-4e89-4ab8-aa40-a158c69a611a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:58.135420 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aadfdc-4e89-4ab8-aa40-a158c69a611a admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:58.135700 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aadfdc-4e89-4ab8-aa40-a158c69a611a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:58.135973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aadfdc-4e89-4ab8-aa40-a158c69a611a admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:58.136592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aadfdc-4e89-4ab8-aa40-a158c69a611a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:58.138487 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aadfdc-4e89-4ab8-aa40-a158c69a611a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:58.160014 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1414/2849] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:51:58 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:51:58.163984 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48080e-1e23-473d-b49a-97ca4797fe66 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:58.174388 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48080e-1e23-473d-b49a-97ca4797fe66 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:58.179128 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0d91f-8436-4dc3-97d2-75082da7bda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:58.179738 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0d91f-8436-4dc3-97d2-75082da7bda9 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:58.180015 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0d91f-8436-4dc3-97d2-75082da7bda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:58.180285 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0d91f-8436-4dc3-97d2-75082da7bda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:58.180914 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0d91f-8436-4dc3-97d2-75082da7bda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:58.182478 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0d91f-8436-4dc3-97d2-75082da7bda9 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:58.194633 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1436/2850] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:51:58.198895 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aadfdc-4e89-4ab8-aa40-a158c69a611a admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:58.209313 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aadfdc-4e89-4ab8-aa40-a158c69a611a admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:58.213927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e9276-5748-4414-b8ff-38c8d90b4f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:58.214558 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e9276-5748-4414-b8ff-38c8d90b4f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:58.214850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e9276-5748-4414-b8ff-38c8d90b4f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:58.215139 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e9276-5748-4414-b8ff-38c8d90b4f42 admin admin] PATH_INFO: `/v3/projects/0aff525de37f4e7988c51f6b20a5eba4/users/1f7d17943f9642ce9ad426e8eec7d30b/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:58.230489 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e9276-5748-4414-b8ff-38c8d90b4f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aff525de37f4e7988c51f6b20a5eba4, user_id=1f7d17943f9642ce9ad426e8eec7d30b, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:58.233059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e9276-5748-4414-b8ff-38c8d90b4f42 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:58.245983 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1415/2851] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:51:58 2022] PUT /identity/v3/projects/0aff525de37f4e7988c51f6b20a5eba4/users/1f7d17943f9642ce9ad426e8eec7d30b/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:51:58.250065 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0d91f-8436-4dc3-97d2-75082da7bda9 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:58.260770 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0d91f-8436-4dc3-97d2-75082da7bda9 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:58.298062 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:51:58.317789 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10733005-40a8-44d6-b73d-ecb0c317c723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:58.318390 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10733005-40a8-44d6-b73d-ecb0c317c723 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:58.318668 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10733005-40a8-44d6-b73d-ecb0c317c723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:58.318973 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10733005-40a8-44d6-b73d-ecb0c317c723 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:58.319875 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10733005-40a8-44d6-b73d-ecb0c317c723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:58.321458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10733005-40a8-44d6-b73d-ecb0c317c723 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:58.331707 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1437/2852] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:51:58.335850 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e9276-5748-4414-b8ff-38c8d90b4f42 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:58.345924 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e9276-5748-4414-b8ff-38c8d90b4f42 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:58.350463 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d30e5d-d43d-47ef-8909-768deedba3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:58.351137 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d30e5d-d43d-47ef-8909-768deedba3c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:58.351412 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d30e5d-d43d-47ef-8909-768deedba3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:58.351682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d30e5d-d43d-47ef-8909-768deedba3c9 admin admin] PATH_INFO: `/v3/projects/0aff525de37f4e7988c51f6b20a5eba4/users/1f7d17943f9642ce9ad426e8eec7d30b/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:58.353573 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d30e5d-d43d-47ef-8909-768deedba3c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aff525de37f4e7988c51f6b20a5eba4, user_id=1f7d17943f9642ce9ad426e8eec7d30b, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:58.356208 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d30e5d-d43d-47ef-8909-768deedba3c9 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:58.366143 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1416/2853] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:51:58 2022] PUT /identity/v3/projects/0aff525de37f4e7988c51f6b20a5eba4/users/1f7d17943f9642ce9ad426e8eec7d30b/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:51:58.378222 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072cebc-ebb1-4b90-a4f1-106339b1b0e7 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:58.378502 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072cebc-ebb1-4b90-a4f1-106339b1b0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:58.378769 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072cebc-ebb1-4b90-a4f1-106339b1b0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:58.412239 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-d072cebc-ebb1-4b90-a4f1-106339b1b0e7 None None] MFA Rules not processed for user `1f7d17943f9642ce9ad426e8eec7d30b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:51:58.414375 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-d072cebc-ebb1-4b90-a4f1-106339b1b0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:51:58.483882 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1438/2854] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:51:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:51:58.495280 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d30e5d-d43d-47ef-8909-768deedba3c9 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:58.496994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a9d30e5d-d43d-47ef-8909-768deedba3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:51:58.540442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:51:58.557403 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d30e5d-d43d-47ef-8909-768deedba3c9 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:58.561007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c471f-9d7c-4ab3-8fb6-dd20f4d0e4f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:58.561599 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c471f-9d7c-4ab3-8fb6-dd20f4d0e4f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:58.561876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c471f-9d7c-4ab3-8fb6-dd20f4d0e4f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:58.562148 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c471f-9d7c-4ab3-8fb6-dd20f4d0e4f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:58.571967 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c471f-9d7c-4ab3-8fb6-dd20f4d0e4f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:58.573386 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c471f-9d7c-4ab3-8fb6-dd20f4d0e4f5 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:58.582955 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1417/2855] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:51:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:51:58.656851 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072cebc-ebb1-4b90-a4f1-106339b1b0e7 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:51:58.667487 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072cebc-ebb1-4b90-a4f1-106339b1b0e7 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:51:58.671175 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaca646-8601-469a-81be-72cd7a902979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:51:58.671769 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaca646-8601-469a-81be-72cd7a902979 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:51:58.672051 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaca646-8601-469a-81be-72cd7a902979 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:51:58.672325 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaca646-8601-469a-81be-72cd7a902979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:51:58.730439 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaca646-8601-469a-81be-72cd7a902979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:51:58.731895 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaca646-8601-469a-81be-72cd7a902979 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:51:58.740836 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1439/2856] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:51:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:52:05.137145 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c471f-9d7c-4ab3-8fb6-dd20f4d0e4f5 service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:05.138580 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2e0c471f-9d7c-4ab3-8fb6-dd20f4d0e4f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:05.203792 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c471f-9d7c-4ab3-8fb6-dd20f4d0e4f5 service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:05.210205 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c8d99-ca20-44cf-86d6-aaa6755b1136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:05.210205 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c8d99-ca20-44cf-86d6-aaa6755b1136 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:05.210205 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c8d99-ca20-44cf-86d6-aaa6755b1136 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:05.210205 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c8d99-ca20-44cf-86d6-aaa6755b1136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:05.214173 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-af2c8d99-ca20-44cf-86d6-aaa6755b1136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:05.226486 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c8d99-ca20-44cf-86d6-aaa6755b1136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:05.228016 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c8d99-ca20-44cf-86d6-aaa6755b1136 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:05.237438 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1418/2857] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:52:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:52:06.328875 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaca646-8601-469a-81be-72cd7a902979 service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:06.330430 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-baaca646-8601-469a-81be-72cd7a902979 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:06.399909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=100 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:06.418332 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaca646-8601-469a-81be-72cd7a902979 service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:06.425087 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691efa0-3a1a-4426-868c-9d4ebd05a948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:06.425723 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691efa0-3a1a-4426-868c-9d4ebd05a948 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:06.426069 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691efa0-3a1a-4426-868c-9d4ebd05a948 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:06.426411 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691efa0-3a1a-4426-868c-9d4ebd05a948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:06.428287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4691efa0-3a1a-4426-868c-9d4ebd05a948 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:06.442869 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691efa0-3a1a-4426-868c-9d4ebd05a948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:06.444466 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691efa0-3a1a-4426-868c-9d4ebd05a948 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:06.462222 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1440/2858] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:52:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:52:12.540356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b8cea-77f3-419a-ac66-7d779d2ea53f None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:12.540815 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b8cea-77f3-419a-ac66-7d779d2ea53f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:12.540911 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b8cea-77f3-419a-ac66-7d779d2ea53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:12.559682 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-198b8cea-77f3-419a-ac66-7d779d2ea53f None None] MFA Rules not processed for user `6f4696c410f343709be200dee463bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:12.560861 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-198b8cea-77f3-419a-ac66-7d779d2ea53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:12.615706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1419/2859] 10.222.0.26 () {58 vars in 967 bytes} [Mon Sep 26 01:52:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:52:12.656104 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691efa0-3a1a-4426-868c-9d4ebd05a948 service nova] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:12.657818 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-4691efa0-3a1a-4426-868c-9d4ebd05a948 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:12.726266 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691efa0-3a1a-4426-868c-9d4ebd05a948 service nova] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:12.731112 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f7839-54bf-4408-848c-98f73eafb9e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c924da83d1a94c49814d2e7b5969c8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:12.731699 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f7839-54bf-4408-848c-98f73eafb9e7 service swift] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:12.731976 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f7839-54bf-4408-848c-98f73eafb9e7 service swift] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:12.732247 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f7839-54bf-4408-848c-98f73eafb9e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:12.740332 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f7839-54bf-4408-848c-98f73eafb9e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:12.741898 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f7839-54bf-4408-848c-98f73eafb9e7 service swift] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:12.749798 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1441/2860] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 26 01:52:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 01:52:19.176344 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b8cea-77f3-419a-ac66-7d779d2ea53f None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:19.177876 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-198b8cea-77f3-419a-ac66-7d779d2ea53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:19.249484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f7839-54bf-4408-848c-98f73eafb9e7 service swift] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:19.253983 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a82f7839-54bf-4408-848c-98f73eafb9e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:19.283481 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b8cea-77f3-419a-ac66-7d779d2ea53f None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:19.290218 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eae899-bfb1-4698-aba2-a594136ff8c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7a1b839a6f4bdb9870217fa4d2527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:19.291145 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eae899-bfb1-4698-aba2-a594136ff8c7 service placement] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:19.291705 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eae899-bfb1-4698-aba2-a594136ff8c7 service placement] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:19.292202 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eae899-bfb1-4698-aba2-a594136ff8c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:19.295313 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-58eae899-bfb1-4698-aba2-a594136ff8c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:19.312469 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eae899-bfb1-4698-aba2-a594136ff8c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:19.316460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eae899-bfb1-4698-aba2-a594136ff8c7 service placement] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:19.331122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1420/2861] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:52:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:52:19.379106 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f7839-54bf-4408-848c-98f73eafb9e7 service swift] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:19.383855 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155b909-659b-4f8d-a4c3-e83cf79d2339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:19.384481 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155b909-659b-4f8d-a4c3-e83cf79d2339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:19.384801 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155b909-659b-4f8d-a4c3-e83cf79d2339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:19.385076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155b909-659b-4f8d-a4c3-e83cf79d2339 admin admin] PATH_INFO: `/v3/users/a2d8dd684de84972979037c60ef54a77` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:19.386194 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155b909-659b-4f8d-a4c3-e83cf79d2339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d8dd684de84972979037c60ef54a77)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:19.388216 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155b909-659b-4f8d-a4c3-e83cf79d2339 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:19.438055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b155b909-659b-4f8d-a4c3-e83cf79d2339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d8dd684de84972979037c60ef54a77'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:19.439764 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b155b909-659b-4f8d-a4c3-e83cf79d2339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d8dd684de84972979037c60ef54a77'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:19.440760 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b155b909-659b-4f8d-a4c3-e83cf79d2339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d8dd684de84972979037c60ef54a77'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:19.455775 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b155b909-659b-4f8d-a4c3-e83cf79d2339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d8dd684de84972979037c60ef54a77'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:19.462716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b155b909-659b-4f8d-a4c3-e83cf79d2339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d8dd684de84972979037c60ef54a77'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:19.465222 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:19.477799 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1442/2862] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:52:19 2022] DELETE /identity/v3/users/a2d8dd684de84972979037c60ef54a77 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:19.651371 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eae899-bfb1-4698-aba2-a594136ff8c7 service placement] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:19.663167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eae899-bfb1-4698-aba2-a594136ff8c7 service placement] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:19.677219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:19.722713 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eec67f-2c99-41ff-a60d-94c9161be831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:19.723360 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eec67f-2c99-41ff-a60d-94c9161be831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:19.723634 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eec67f-2c99-41ff-a60d-94c9161be831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:19.723902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eec67f-2c99-41ff-a60d-94c9161be831 admin admin] PATH_INFO: `/v3/projects/c42b158825a74506b2de0bc3336e96e4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:19.725019 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eec67f-2c99-41ff-a60d-94c9161be831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42b158825a74506b2de0bc3336e96e4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:19.726919 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eec67f-2c99-41ff-a60d-94c9161be831 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:19.776432 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-98eec67f-2c99-41ff-a60d-94c9161be831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42b158825a74506b2de0bc3336e96e4', 'request_id': 'req-98eec67f-2c99-41ff-a60d-94c9161be831'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:19.782070 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-98eec67f-2c99-41ff-a60d-94c9161be831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42b158825a74506b2de0bc3336e96e4', 'request_id': 'req-98eec67f-2c99-41ff-a60d-94c9161be831'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:19.788994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-98eec67f-2c99-41ff-a60d-94c9161be831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42b158825a74506b2de0bc3336e96e4', 'request_id': 'req-98eec67f-2c99-41ff-a60d-94c9161be831'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:19.802729 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-98eec67f-2c99-41ff-a60d-94c9161be831 admin admin] The token cache is being invalidate because project c42b158825a74506b2de0bc3336e96e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:52:19.803064 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-98eec67f-2c99-41ff-a60d-94c9161be831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:19.803706 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-98eec67f-2c99-41ff-a60d-94c9161be831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:19.805172 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1421/2863] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:52:19 2022] DELETE /identity/v3/projects/c42b158825a74506b2de0bc3336e96e4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:19.808968 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155b909-659b-4f8d-a4c3-e83cf79d2339 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:19.810516 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b155b909-659b-4f8d-a4c3-e83cf79d2339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:19.825176 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155b909-659b-4f8d-a4c3-e83cf79d2339 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:19.881484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996625ac-e34a-4031-bd7e-3b49eb5413c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:19.882233 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996625ac-e34a-4031-bd7e-3b49eb5413c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:19.882365 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996625ac-e34a-4031-bd7e-3b49eb5413c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:19.882630 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996625ac-e34a-4031-bd7e-3b49eb5413c7 admin admin] PATH_INFO: `/v3/users/042a80f671a34833bc43e09ff33f3f16` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:19.883794 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996625ac-e34a-4031-bd7e-3b49eb5413c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=042a80f671a34833bc43e09ff33f3f16)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:19.885688 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996625ac-e34a-4031-bd7e-3b49eb5413c7 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:19.936287 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-996625ac-e34a-4031-bd7e-3b49eb5413c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042a80f671a34833bc43e09ff33f3f16'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:19.936945 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-996625ac-e34a-4031-bd7e-3b49eb5413c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042a80f671a34833bc43e09ff33f3f16'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:19.937550 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-996625ac-e34a-4031-bd7e-3b49eb5413c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042a80f671a34833bc43e09ff33f3f16'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:19.950520 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-996625ac-e34a-4031-bd7e-3b49eb5413c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042a80f671a34833bc43e09ff33f3f16'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:19.957749 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-996625ac-e34a-4031-bd7e-3b49eb5413c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042a80f671a34833bc43e09ff33f3f16'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:19.972730 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1443/2864] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:52:19 2022] DELETE /identity/v3/users/042a80f671a34833bc43e09ff33f3f16 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:20.149577 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eec67f-2c99-41ff-a60d-94c9161be831 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:20.150951 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-98eec67f-2c99-41ff-a60d-94c9161be831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:20.163519 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eec67f-2c99-41ff-a60d-94c9161be831 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:20.223977 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f53c7-6590-4784-8c9f-8f14a6bf9f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:20.224627 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f53c7-6590-4784-8c9f-8f14a6bf9f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:20.224870 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f53c7-6590-4784-8c9f-8f14a6bf9f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:20.225144 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f53c7-6590-4784-8c9f-8f14a6bf9f94 admin admin] PATH_INFO: `/v3/projects/dc5658917eb647178af3c4b18eabd8ce` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:20.226300 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f53c7-6590-4784-8c9f-8f14a6bf9f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5658917eb647178af3c4b18eabd8ce)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:20.228236 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f53c7-6590-4784-8c9f-8f14a6bf9f94 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:20.276889 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-fe9f53c7-6590-4784-8c9f-8f14a6bf9f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5658917eb647178af3c4b18eabd8ce', 'request_id': 'req-fe9f53c7-6590-4784-8c9f-8f14a6bf9f94'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:20.278421 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:20.285516 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-fe9f53c7-6590-4784-8c9f-8f14a6bf9f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5658917eb647178af3c4b18eabd8ce', 'request_id': 'req-fe9f53c7-6590-4784-8c9f-8f14a6bf9f94'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:20.293362 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-fe9f53c7-6590-4784-8c9f-8f14a6bf9f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5658917eb647178af3c4b18eabd8ce', 'request_id': 'req-fe9f53c7-6590-4784-8c9f-8f14a6bf9f94'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:20.306262 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-fe9f53c7-6590-4784-8c9f-8f14a6bf9f94 admin admin] The token cache is being invalidate because project dc5658917eb647178af3c4b18eabd8ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:52:20.306529 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-fe9f53c7-6590-4784-8c9f-8f14a6bf9f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:20.307157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-fe9f53c7-6590-4784-8c9f-8f14a6bf9f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:20.308665 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1422/2865] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:52:20 2022] DELETE /identity/v3/projects/dc5658917eb647178af3c4b18eabd8ce => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:28.113475 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996625ac-e34a-4031-bd7e-3b49eb5413c7 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:28.114927 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-996625ac-e34a-4031-bd7e-3b49eb5413c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:28.127851 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996625ac-e34a-4031-bd7e-3b49eb5413c7 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:28.183141 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb85d8-9051-4ccb-97c0-ff94498641b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:28.183757 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb85d8-9051-4ccb-97c0-ff94498641b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:28.184037 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb85d8-9051-4ccb-97c0-ff94498641b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:28.184311 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb85d8-9051-4ccb-97c0-ff94498641b6 admin admin] PATH_INFO: `/v3/users/0b9284dfa72b4d34a5a6069338730fb7` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:28.185421 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb85d8-9051-4ccb-97c0-ff94498641b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b9284dfa72b4d34a5a6069338730fb7)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:28.187344 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb85d8-9051-4ccb-97c0-ff94498641b6 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:28.201987 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:28.233958 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-e0fb85d8-9051-4ccb-97c0-ff94498641b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b9284dfa72b4d34a5a6069338730fb7'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:28.234594 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-e0fb85d8-9051-4ccb-97c0-ff94498641b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b9284dfa72b4d34a5a6069338730fb7'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:28.235217 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-e0fb85d8-9051-4ccb-97c0-ff94498641b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b9284dfa72b4d34a5a6069338730fb7'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:28.248604 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-e0fb85d8-9051-4ccb-97c0-ff94498641b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b9284dfa72b4d34a5a6069338730fb7'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:28.255943 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-e0fb85d8-9051-4ccb-97c0-ff94498641b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b9284dfa72b4d34a5a6069338730fb7'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:28.268554 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1444/2866] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:52:28 2022] DELETE /identity/v3/users/0b9284dfa72b4d34a5a6069338730fb7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:28.273047 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fb06f-8a30-4960-86cc-02cb83909c43 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:28.273547 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fb06f-8a30-4960-86cc-02cb83909c43 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:28.273658 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fb06f-8a30-4960-86cc-02cb83909c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:28.293779 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-db8fb06f-8a30-4960-86cc-02cb83909c43 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:28.295013 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-db8fb06f-8a30-4960-86cc-02cb83909c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:28.353727 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1423/2867] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:52:28.364183 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb85d8-9051-4ccb-97c0-ff94498641b6 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:28.365560 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-e0fb85d8-9051-4ccb-97c0-ff94498641b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:28.425047 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb85d8-9051-4ccb-97c0-ff94498641b6 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:28.428673 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca3b36-9c2b-433d-a3b7-bf33f1f41c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:28.429267 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca3b36-9c2b-433d-a3b7-bf33f1f41c25 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:28.429541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca3b36-9c2b-433d-a3b7-bf33f1f41c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:28.429807 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca3b36-9c2b-433d-a3b7-bf33f1f41c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:28.438557 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca3b36-9c2b-433d-a3b7-bf33f1f41c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:28.440024 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca3b36-9c2b-433d-a3b7-bf33f1f41c25 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:28.449366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1445/2868] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:52:28.712650 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fb06f-8a30-4960-86cc-02cb83909c43 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:28.714225 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-db8fb06f-8a30-4960-86cc-02cb83909c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:28.729544 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fb06f-8a30-4960-86cc-02cb83909c43 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:28.734271 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc426c95-2c8e-4143-ae80-383f99dc0ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:28.734920 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc426c95-2c8e-4143-ae80-383f99dc0ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:28.735195 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc426c95-2c8e-4143-ae80-383f99dc0ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:28.735460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc426c95-2c8e-4143-ae80-383f99dc0ce7 admin admin] PATH_INFO: `/v3/projects/f06c89e1f776468f91fb502a2fb17af8` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:28.738106 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc426c95-2c8e-4143-ae80-383f99dc0ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f06c89e1f776468f91fb502a2fb17af8)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:28.740068 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc426c95-2c8e-4143-ae80-383f99dc0ce7 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:28.786368 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bc426c95-2c8e-4143-ae80-383f99dc0ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06c89e1f776468f91fb502a2fb17af8', 'request_id': 'req-bc426c95-2c8e-4143-ae80-383f99dc0ce7'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:28.791761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bc426c95-2c8e-4143-ae80-383f99dc0ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06c89e1f776468f91fb502a2fb17af8', 'request_id': 'req-bc426c95-2c8e-4143-ae80-383f99dc0ce7'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:28.799060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bc426c95-2c8e-4143-ae80-383f99dc0ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06c89e1f776468f91fb502a2fb17af8', 'request_id': 'req-bc426c95-2c8e-4143-ae80-383f99dc0ce7'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:28.812086 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bc426c95-2c8e-4143-ae80-383f99dc0ce7 admin admin] The token cache is being invalidate because project f06c89e1f776468f91fb502a2fb17af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:52:28.812370 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bc426c95-2c8e-4143-ae80-383f99dc0ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:28.813052 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bc426c95-2c8e-4143-ae80-383f99dc0ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:28.815131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1424/2869] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:52:28 2022] DELETE /identity/v3/projects/f06c89e1f776468f91fb502a2fb17af8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:28.819465 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca3b36-9c2b-433d-a3b7-bf33f1f41c25 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:28.829203 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca3b36-9c2b-433d-a3b7-bf33f1f41c25 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:28.885317 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499823b-054b-47af-9492-64a09962fe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:28.885936 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499823b-054b-47af-9492-64a09962fe73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:28.886213 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499823b-054b-47af-9492-64a09962fe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:28.886484 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499823b-054b-47af-9492-64a09962fe73 admin admin] PATH_INFO: `/v3/users/1f7d17943f9642ce9ad426e8eec7d30b` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:28.887656 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499823b-054b-47af-9492-64a09962fe73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f7d17943f9642ce9ad426e8eec7d30b)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:28.889547 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499823b-054b-47af-9492-64a09962fe73 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:28.928334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:28.938118 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9499823b-054b-47af-9492-64a09962fe73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f7d17943f9642ce9ad426e8eec7d30b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:28.938758 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9499823b-054b-47af-9492-64a09962fe73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f7d17943f9642ce9ad426e8eec7d30b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:28.939563 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9499823b-054b-47af-9492-64a09962fe73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f7d17943f9642ce9ad426e8eec7d30b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:28.951551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9499823b-054b-47af-9492-64a09962fe73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f7d17943f9642ce9ad426e8eec7d30b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:28.958359 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-9499823b-054b-47af-9492-64a09962fe73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f7d17943f9642ce9ad426e8eec7d30b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:28.971299 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1446/2870] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:52:28 2022] DELETE /identity/v3/users/1f7d17943f9642ce9ad426e8eec7d30b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:52:29.250790 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc426c95-2c8e-4143-ae80-383f99dc0ce7 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:29.253199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-bc426c95-2c8e-4143-ae80-383f99dc0ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:29.266153 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc426c95-2c8e-4143-ae80-383f99dc0ce7 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:29.331789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8bf4f-483d-4b00-8d31-fcb01bba4439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:29.332438 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8bf4f-483d-4b00-8d31-fcb01bba4439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:29.332625 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8bf4f-483d-4b00-8d31-fcb01bba4439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:29.332890 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8bf4f-483d-4b00-8d31-fcb01bba4439 admin admin] PATH_INFO: `/v3/projects/0aff525de37f4e7988c51f6b20a5eba4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:29.334043 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8bf4f-483d-4b00-8d31-fcb01bba4439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aff525de37f4e7988c51f6b20a5eba4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:29.335958 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8bf4f-483d-4b00-8d31-fcb01bba4439 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:29.338167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:29.384806 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c6a8bf4f-483d-4b00-8d31-fcb01bba4439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aff525de37f4e7988c51f6b20a5eba4', 'request_id': 'req-c6a8bf4f-483d-4b00-8d31-fcb01bba4439'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:29.390140 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c6a8bf4f-483d-4b00-8d31-fcb01bba4439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aff525de37f4e7988c51f6b20a5eba4', 'request_id': 'req-c6a8bf4f-483d-4b00-8d31-fcb01bba4439'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:29.400790 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c6a8bf4f-483d-4b00-8d31-fcb01bba4439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aff525de37f4e7988c51f6b20a5eba4', 'request_id': 'req-c6a8bf4f-483d-4b00-8d31-fcb01bba4439'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:29.414710 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c6a8bf4f-483d-4b00-8d31-fcb01bba4439 admin admin] The token cache is being invalidate because project 0aff525de37f4e7988c51f6b20a5eba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:52:29.415025 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c6a8bf4f-483d-4b00-8d31-fcb01bba4439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:29.415667 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-c6a8bf4f-483d-4b00-8d31-fcb01bba4439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:29.417131 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1425/2871] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:52:29 2022] DELETE /identity/v3/projects/0aff525de37f4e7988c51f6b20a5eba4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:29.421951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec317136-0559-4ab1-a79c-9bdffa33ac98 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:29.422419 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec317136-0559-4ab1-a79c-9bdffa33ac98 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:29.422542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec317136-0559-4ab1-a79c-9bdffa33ac98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:29.443206 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-ec317136-0559-4ab1-a79c-9bdffa33ac98 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:29.444653 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-ec317136-0559-4ab1-a79c-9bdffa33ac98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:29.507573 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1447/2872] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:52:29.516383 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b09cb-972d-43d9-8f87-893628e0ef45 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:29.516672 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b09cb-972d-43d9-8f87-893628e0ef45 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:29.516972 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b09cb-972d-43d9-8f87-893628e0ef45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:29.536863 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-870b09cb-972d-43d9-8f87-893628e0ef45 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:29.538067 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-870b09cb-972d-43d9-8f87-893628e0ef45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:29.545894 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1426/2873] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:52:29.550727 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec317136-0559-4ab1-a79c-9bdffa33ac98 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:29.560437 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec317136-0559-4ab1-a79c-9bdffa33ac98 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:29.565650 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7091b2c-173b-43b5-b0b5-9effe1d8ab81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:29.566232 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7091b2c-173b-43b5-b0b5-9effe1d8ab81 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:29.566515 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7091b2c-173b-43b5-b0b5-9effe1d8ab81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:29.566786 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7091b2c-173b-43b5-b0b5-9effe1d8ab81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:29.567459 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7091b2c-173b-43b5-b0b5-9effe1d8ab81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:52:29.567762 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7091b2c-173b-43b5-b0b5-9effe1d8ab81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:29.569587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7091b2c-173b-43b5-b0b5-9effe1d8ab81 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:29.581331 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1448/2874] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:52:29.585582 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b09cb-972d-43d9-8f87-893628e0ef45 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:29.594788 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b09cb-972d-43d9-8f87-893628e0ef45 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:29.599497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b6f8f-b3a3-4aa8-9302-cb292ddaf843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:29.600089 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b6f8f-b3a3-4aa8-9302-cb292ddaf843 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:29.600363 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b6f8f-b3a3-4aa8-9302-cb292ddaf843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:29.600629 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b6f8f-b3a3-4aa8-9302-cb292ddaf843 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:29.601257 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b6f8f-b3a3-4aa8-9302-cb292ddaf843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:29.603163 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b6f8f-b3a3-4aa8-9302-cb292ddaf843 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:29.630807 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1427/2875] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:52:29 2022] POST /identity/v3/projects => generated 407 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:52:29.634974 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7091b2c-173b-43b5-b0b5-9effe1d8ab81 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:29.645188 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7091b2c-173b-43b5-b0b5-9effe1d8ab81 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:29.707185 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377f997-8d22-4515-833a-2b062c036344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:29.707780 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377f997-8d22-4515-833a-2b062c036344 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:29.708056 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377f997-8d22-4515-833a-2b062c036344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:29.708326 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377f997-8d22-4515-833a-2b062c036344 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:29.708996 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377f997-8d22-4515-833a-2b062c036344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:29.710898 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377f997-8d22-4515-833a-2b062c036344 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:29.732055 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1449/2876] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:52:29 2022] POST /identity/v3/users => generated 304 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:52:29.737217 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b6f8f-b3a3-4aa8-9302-cb292ddaf843 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:29.747341 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b6f8f-b3a3-4aa8-9302-cb292ddaf843 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:29.752376 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcbffe-83ee-48c9-be56-2b19682f6d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:29.752951 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcbffe-83ee-48c9-be56-2b19682f6d10 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:29.753226 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcbffe-83ee-48c9-be56-2b19682f6d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:29.753490 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcbffe-83ee-48c9-be56-2b19682f6d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:29.754120 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffcbffe-83ee-48c9-be56-2b19682f6d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:29.755725 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffcbffe-83ee-48c9-be56-2b19682f6d10 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:29.765281 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1428/2877] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:52:29.769899 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377f997-8d22-4515-833a-2b062c036344 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:29.779716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377f997-8d22-4515-833a-2b062c036344 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:29.784661 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0576d57-9838-4a94-ae18-a4c7257902c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:29.785243 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0576d57-9838-4a94-ae18-a4c7257902c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:29.785519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0576d57-9838-4a94-ae18-a4c7257902c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:29.785788 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0576d57-9838-4a94-ae18-a4c7257902c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:29.786421 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0576d57-9838-4a94-ae18-a4c7257902c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:29.788004 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0576d57-9838-4a94-ae18-a4c7257902c5 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:29.798428 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1450/2878] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:52:29.802517 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcbffe-83ee-48c9-be56-2b19682f6d10 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:29.812434 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcbffe-83ee-48c9-be56-2b19682f6d10 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:29.817920 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bb5cd-1f3a-40a2-9883-13cd19fe9e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:29.819105 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bb5cd-1f3a-40a2-9883-13cd19fe9e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:29.819398 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bb5cd-1f3a-40a2-9883-13cd19fe9e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:29.819678 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bb5cd-1f3a-40a2-9883-13cd19fe9e36 admin admin] PATH_INFO: `/v3/projects/45ee575c83aa4db69ef137fef838e3fc/users/e5b705071d594fc0a2a9a3785ef59914/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:29.834945 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bb5cd-1f3a-40a2-9883-13cd19fe9e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45ee575c83aa4db69ef137fef838e3fc, user_id=e5b705071d594fc0a2a9a3785ef59914, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:29.837641 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bb5cd-1f3a-40a2-9883-13cd19fe9e36 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:29.850657 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1429/2879] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:52:29 2022] PUT /identity/v3/projects/45ee575c83aa4db69ef137fef838e3fc/users/e5b705071d594fc0a2a9a3785ef59914/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:29.860891 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac12e13-b1cf-4da6-a656-70308f95331e None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:29.861179 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac12e13-b1cf-4da6-a656-70308f95331e None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:29.861458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac12e13-b1cf-4da6-a656-70308f95331e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:29.889008 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-0ac12e13-b1cf-4da6-a656-70308f95331e None None] MFA Rules not processed for user `e5b705071d594fc0a2a9a3785ef59914`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:29.890241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-0ac12e13-b1cf-4da6-a656-70308f95331e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:29.899056 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:29.956342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1451/2880] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:52:29 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:52:29.960789 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bb5cd-1f3a-40a2-9883-13cd19fe9e36 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:30.020973 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bb5cd-1f3a-40a2-9883-13cd19fe9e36 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:30.025896 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5406c6-77d6-4b4b-b6a1-4661cea8b47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:30.026514 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5406c6-77d6-4b4b-b6a1-4661cea8b47a admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:30.026790 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5406c6-77d6-4b4b-b6a1-4661cea8b47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:30.027091 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5406c6-77d6-4b4b-b6a1-4661cea8b47a admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:30.027711 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5406c6-77d6-4b4b-b6a1-4661cea8b47a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:30.029621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5406c6-77d6-4b4b-b6a1-4661cea8b47a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:30.057539 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1430/2881] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:52:29 2022] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:52:30.061551 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac12e13-b1cf-4da6-a656-70308f95331e None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:30.073039 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac12e13-b1cf-4da6-a656-70308f95331e None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:30.129888 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d6fba-2595-4cf6-b96c-5fa95a24afaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:30.130413 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d6fba-2595-4cf6-b96c-5fa95a24afaa admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:30.130694 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d6fba-2595-4cf6-b96c-5fa95a24afaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:30.130997 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d6fba-2595-4cf6-b96c-5fa95a24afaa admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:30.131629 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d6fba-2595-4cf6-b96c-5fa95a24afaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:30.133510 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d6fba-2595-4cf6-b96c-5fa95a24afaa admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:30.154766 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1452/2882] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:52:30 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:52:30.159028 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5406c6-77d6-4b4b-b6a1-4661cea8b47a admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:30.169154 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5406c6-77d6-4b4b-b6a1-4661cea8b47a admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:30.174237 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf5164-687e-42e4-87d3-e4dcf52768c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:30.174951 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf5164-687e-42e4-87d3-e4dcf52768c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:30.175229 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf5164-687e-42e4-87d3-e4dcf52768c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:30.175497 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf5164-687e-42e4-87d3-e4dcf52768c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:30.176122 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf5164-687e-42e4-87d3-e4dcf52768c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:30.177725 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf5164-687e-42e4-87d3-e4dcf52768c8 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:30.188035 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1431/2883] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:52:30.192938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d6fba-2595-4cf6-b96c-5fa95a24afaa admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:30.203136 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d6fba-2595-4cf6-b96c-5fa95a24afaa admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:30.208024 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf0757-79be-4ee1-9ef6-69f98e02292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:30.208666 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf0757-79be-4ee1-9ef6-69f98e02292a admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:30.209058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf0757-79be-4ee1-9ef6-69f98e02292a admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:30.209822 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf0757-79be-4ee1-9ef6-69f98e02292a admin admin] PATH_INFO: `/v3/projects/ea108f7fdfaf4af6aaf8786de67f230b/users/78e37ff51a3b4ef488691915de69da97/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:30.224938 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf0757-79be-4ee1-9ef6-69f98e02292a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea108f7fdfaf4af6aaf8786de67f230b, user_id=78e37ff51a3b4ef488691915de69da97, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:30.227626 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf0757-79be-4ee1-9ef6-69f98e02292a admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:30.240737 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1453/2884] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:52:30 2022] PUT /identity/v3/projects/ea108f7fdfaf4af6aaf8786de67f230b/users/78e37ff51a3b4ef488691915de69da97/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:30.244652 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf5164-687e-42e4-87d3-e4dcf52768c8 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:30.249875 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:30.257016 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf5164-687e-42e4-87d3-e4dcf52768c8 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:30.312555 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cf0ea-bd3f-466b-a683-d78e891d9ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:30.313148 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cf0ea-bd3f-466b-a683-d78e891d9ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:30.313423 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cf0ea-bd3f-466b-a683-d78e891d9ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:30.313689 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cf0ea-bd3f-466b-a683-d78e891d9ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:30.314910 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cf0ea-bd3f-466b-a683-d78e891d9ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:30.316474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cf0ea-bd3f-466b-a683-d78e891d9ae4 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:30.326169 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1432/2885] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 01:52:30.330784 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf0757-79be-4ee1-9ef6-69f98e02292a admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:30.340906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf0757-79be-4ee1-9ef6-69f98e02292a admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:30.345488 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ad96d-f827-4d52-a22b-abd75e263c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:30.346120 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ad96d-f827-4d52-a22b-abd75e263c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:30.346397 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ad96d-f827-4d52-a22b-abd75e263c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:30.346690 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ad96d-f827-4d52-a22b-abd75e263c5e admin admin] PATH_INFO: `/v3/projects/ea108f7fdfaf4af6aaf8786de67f230b/users/78e37ff51a3b4ef488691915de69da97/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:30.348611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ad96d-f827-4d52-a22b-abd75e263c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea108f7fdfaf4af6aaf8786de67f230b, user_id=78e37ff51a3b4ef488691915de69da97, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:30.351261 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ad96d-f827-4d52-a22b-abd75e263c5e admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:30.361919 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1454/2886] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:52:30 2022] PUT /identity/v3/projects/ea108f7fdfaf4af6aaf8786de67f230b/users/78e37ff51a3b4ef488691915de69da97/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:52:30.372298 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91e857-e115-4b0b-8c3a-f1e8fc9ebee0 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:30.372865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91e857-e115-4b0b-8c3a-f1e8fc9ebee0 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:30.372865 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91e857-e115-4b0b-8c3a-f1e8fc9ebee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:30.401421 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-4d91e857-e115-4b0b-8c3a-f1e8fc9ebee0 None None] MFA Rules not processed for user `78e37ff51a3b4ef488691915de69da97`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:30.402546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4d91e857-e115-4b0b-8c3a-f1e8fc9ebee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:30.471498 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1433/2887] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:52:30 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:52:30.482059 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ad96d-f827-4d52-a22b-abd75e263c5e admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:30.483778 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c38ad96d-f827-4d52-a22b-abd75e263c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:30.541970 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ad96d-f827-4d52-a22b-abd75e263c5e admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:30.545591 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e0bfc-0775-4142-9125-ef6cda6418cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:30.546177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e0bfc-0775-4142-9125-ef6cda6418cc service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:30.546455 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e0bfc-0775-4142-9125-ef6cda6418cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:30.546725 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e0bfc-0775-4142-9125-ef6cda6418cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:30.556145 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e0bfc-0775-4142-9125-ef6cda6418cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:30.557528 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e0bfc-0775-4142-9125-ef6cda6418cc service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:30.566722 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1455/2888] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:52:30 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:52:30.718219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91e857-e115-4b0b-8c3a-f1e8fc9ebee0 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:30.728504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91e857-e115-4b0b-8c3a-f1e8fc9ebee0 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:30.732037 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a112086-1f0c-4e8e-91f8-1a2cd1d14ad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:30.732625 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a112086-1f0c-4e8e-91f8-1a2cd1d14ad6 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:30.732902 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a112086-1f0c-4e8e-91f8-1a2cd1d14ad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:30.733177 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a112086-1f0c-4e8e-91f8-1a2cd1d14ad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:30.793082 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a112086-1f0c-4e8e-91f8-1a2cd1d14ad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:30.795359 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a112086-1f0c-4e8e-91f8-1a2cd1d14ad6 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:30.806567 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1434/2889] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:52:30 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:52:36.117543 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e0bfc-0775-4142-9125-ef6cda6418cc service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:36.123457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:36.180067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e0bfc-0775-4142-9125-ef6cda6418cc service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:36.184541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879470c-4113-4a1d-912c-975746e34b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:36.185148 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879470c-4113-4a1d-912c-975746e34b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:36.185424 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879470c-4113-4a1d-912c-975746e34b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:36.185690 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879470c-4113-4a1d-912c-975746e34b3e admin admin] PATH_INFO: `/v3/users/e5b705071d594fc0a2a9a3785ef59914` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:36.186777 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879470c-4113-4a1d-912c-975746e34b3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5b705071d594fc0a2a9a3785ef59914)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:36.188739 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879470c-4113-4a1d-912c-975746e34b3e admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:36.234197 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b879470c-4113-4a1d-912c-975746e34b3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5b705071d594fc0a2a9a3785ef59914'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:36.235002 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b879470c-4113-4a1d-912c-975746e34b3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5b705071d594fc0a2a9a3785ef59914'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:36.235776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b879470c-4113-4a1d-912c-975746e34b3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5b705071d594fc0a2a9a3785ef59914'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:36.248580 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b879470c-4113-4a1d-912c-975746e34b3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5b705071d594fc0a2a9a3785ef59914'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:36.255657 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-b879470c-4113-4a1d-912c-975746e34b3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5b705071d594fc0a2a9a3785ef59914'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:36.268526 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1456/2890] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:52:36 2022] DELETE /identity/v3/users/e5b705071d594fc0a2a9a3785ef59914 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:36.273024 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15a562-abd0-4d26-8cb1-4611575971cc None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:36.273500 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15a562-abd0-4d26-8cb1-4611575971cc None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:36.273616 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15a562-abd0-4d26-8cb1-4611575971cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:36.293319 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-7d15a562-abd0-4d26-8cb1-4611575971cc None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:36.294515 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7d15a562-abd0-4d26-8cb1-4611575971cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:36.310900 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:36.354493 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1435/2891] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:52:36.364446 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879470c-4113-4a1d-912c-975746e34b3e admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:36.365855 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-b879470c-4113-4a1d-912c-975746e34b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:36.423087 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879470c-4113-4a1d-912c-975746e34b3e admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:36.427366 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2384f95-212d-4ba6-bce9-631a877eab6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:36.427961 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2384f95-212d-4ba6-bce9-631a877eab6a service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:36.428236 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2384f95-212d-4ba6-bce9-631a877eab6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:36.428504 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2384f95-212d-4ba6-bce9-631a877eab6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:36.437296 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2384f95-212d-4ba6-bce9-631a877eab6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:36.438706 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2384f95-212d-4ba6-bce9-631a877eab6a service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:36.448294 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1457/2892] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:52:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:52:36.708480 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15a562-abd0-4d26-8cb1-4611575971cc None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:36.709901 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7d15a562-abd0-4d26-8cb1-4611575971cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:36.723214 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15a562-abd0-4d26-8cb1-4611575971cc None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:36.727936 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9daf61-bf61-4e76-bf2a-b6ee20ed7d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:36.728560 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9daf61-bf61-4e76-bf2a-b6ee20ed7d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:36.728835 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9daf61-bf61-4e76-bf2a-b6ee20ed7d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:36.729106 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9daf61-bf61-4e76-bf2a-b6ee20ed7d86 admin admin] PATH_INFO: `/v3/projects/45ee575c83aa4db69ef137fef838e3fc` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:36.730205 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9daf61-bf61-4e76-bf2a-b6ee20ed7d86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45ee575c83aa4db69ef137fef838e3fc)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:36.732162 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9daf61-bf61-4e76-bf2a-b6ee20ed7d86 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:36.778972 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-ad9daf61-bf61-4e76-bf2a-b6ee20ed7d86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45ee575c83aa4db69ef137fef838e3fc', 'request_id': 'req-ad9daf61-bf61-4e76-bf2a-b6ee20ed7d86'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:36.784717 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-ad9daf61-bf61-4e76-bf2a-b6ee20ed7d86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45ee575c83aa4db69ef137fef838e3fc', 'request_id': 'req-ad9daf61-bf61-4e76-bf2a-b6ee20ed7d86'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:36.791014 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-ad9daf61-bf61-4e76-bf2a-b6ee20ed7d86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45ee575c83aa4db69ef137fef838e3fc', 'request_id': 'req-ad9daf61-bf61-4e76-bf2a-b6ee20ed7d86'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:36.803636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-ad9daf61-bf61-4e76-bf2a-b6ee20ed7d86 admin admin] The token cache is being invalidate because project 45ee575c83aa4db69ef137fef838e3fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:52:36.803918 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-ad9daf61-bf61-4e76-bf2a-b6ee20ed7d86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:36.804530 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-ad9daf61-bf61-4e76-bf2a-b6ee20ed7d86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:36.806014 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1436/2893] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:52:36 2022] DELETE /identity/v3/projects/45ee575c83aa4db69ef137fef838e3fc => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:36.809930 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2384f95-212d-4ba6-bce9-631a877eab6a service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:36.820486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2384f95-212d-4ba6-bce9-631a877eab6a service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:36.843272 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:36.877253 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01588f45-eece-48a9-b2a6-ef1700fe1ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:36.877864 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01588f45-eece-48a9-b2a6-ef1700fe1ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:36.878139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01588f45-eece-48a9-b2a6-ef1700fe1ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:36.878404 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01588f45-eece-48a9-b2a6-ef1700fe1ae4 admin admin] PATH_INFO: `/v3/users/78e37ff51a3b4ef488691915de69da97` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:36.879557 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01588f45-eece-48a9-b2a6-ef1700fe1ae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78e37ff51a3b4ef488691915de69da97)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:36.881451 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01588f45-eece-48a9-b2a6-ef1700fe1ae4 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:36.927167 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-01588f45-eece-48a9-b2a6-ef1700fe1ae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78e37ff51a3b4ef488691915de69da97'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:36.927824 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-01588f45-eece-48a9-b2a6-ef1700fe1ae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78e37ff51a3b4ef488691915de69da97'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:36.928442 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-01588f45-eece-48a9-b2a6-ef1700fe1ae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78e37ff51a3b4ef488691915de69da97'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:36.940241 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-01588f45-eece-48a9-b2a6-ef1700fe1ae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78e37ff51a3b4ef488691915de69da97'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:36.947222 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-01588f45-eece-48a9-b2a6-ef1700fe1ae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78e37ff51a3b4ef488691915de69da97'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:36.959936 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1458/2894] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:52:36 2022] DELETE /identity/v3/users/78e37ff51a3b4ef488691915de69da97 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:37.232008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9daf61-bf61-4e76-bf2a-b6ee20ed7d86 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:37.233448 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ad9daf61-bf61-4e76-bf2a-b6ee20ed7d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:37.254041 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9daf61-bf61-4e76-bf2a-b6ee20ed7d86 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:37.310504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c60db7-5011-4e98-94e6-3bee48207a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:37.311164 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c60db7-5011-4e98-94e6-3bee48207a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:37.311390 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c60db7-5011-4e98-94e6-3bee48207a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:37.311708 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c60db7-5011-4e98-94e6-3bee48207a9c admin admin] PATH_INFO: `/v3/projects/ea108f7fdfaf4af6aaf8786de67f230b` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:37.312872 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c60db7-5011-4e98-94e6-3bee48207a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea108f7fdfaf4af6aaf8786de67f230b)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:37.315008 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c60db7-5011-4e98-94e6-3bee48207a9c admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:37.362669 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:37.364248 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-06c60db7-5011-4e98-94e6-3bee48207a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea108f7fdfaf4af6aaf8786de67f230b', 'request_id': 'req-06c60db7-5011-4e98-94e6-3bee48207a9c'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:37.371292 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-06c60db7-5011-4e98-94e6-3bee48207a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea108f7fdfaf4af6aaf8786de67f230b', 'request_id': 'req-06c60db7-5011-4e98-94e6-3bee48207a9c'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:37.378362 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-06c60db7-5011-4e98-94e6-3bee48207a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea108f7fdfaf4af6aaf8786de67f230b', 'request_id': 'req-06c60db7-5011-4e98-94e6-3bee48207a9c'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:37.394910 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-06c60db7-5011-4e98-94e6-3bee48207a9c admin admin] The token cache is being invalidate because project ea108f7fdfaf4af6aaf8786de67f230b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:52:37.395346 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-06c60db7-5011-4e98-94e6-3bee48207a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:37.396264 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-06c60db7-5011-4e98-94e6-3bee48207a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:37.398442 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1437/2895] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:52:37 2022] DELETE /identity/v3/projects/ea108f7fdfaf4af6aaf8786de67f230b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:52:37.403262 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc28e4-a079-4dbd-a81d-d60fd3299b7f None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:37.403732 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc28e4-a079-4dbd-a81d-d60fd3299b7f None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:37.403862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc28e4-a079-4dbd-a81d-d60fd3299b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:37.424575 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-f6cc28e4-a079-4dbd-a81d-d60fd3299b7f None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:37.425793 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-f6cc28e4-a079-4dbd-a81d-d60fd3299b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:37.483714 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1459/2896] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:52:37.546373 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037518d-78a7-4d01-9141-4cb428279d1f None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:37.546660 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037518d-78a7-4d01-9141-4cb428279d1f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:37.546958 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037518d-78a7-4d01-9141-4cb428279d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:37.566868 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-a037518d-78a7-4d01-9141-4cb428279d1f None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:37.567992 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a037518d-78a7-4d01-9141-4cb428279d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:37.576000 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1438/2897] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:52:37.580690 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc28e4-a079-4dbd-a81d-d60fd3299b7f None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:37.590252 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc28e4-a079-4dbd-a81d-d60fd3299b7f None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:37.594779 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa58f09-4748-4654-9200-b5380154e014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:37.595977 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa58f09-4748-4654-9200-b5380154e014 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:37.596254 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa58f09-4748-4654-9200-b5380154e014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:37.596527 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa58f09-4748-4654-9200-b5380154e014 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:37.597170 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa58f09-4748-4654-9200-b5380154e014 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:52:37.597471 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa58f09-4748-4654-9200-b5380154e014 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:37.599071 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa58f09-4748-4654-9200-b5380154e014 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:37.610386 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1460/2898] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:52:37.614500 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037518d-78a7-4d01-9141-4cb428279d1f None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:37.623554 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037518d-78a7-4d01-9141-4cb428279d1f None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:37.628234 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9032406-c782-48e6-bc8a-ccd611ad2655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:37.628822 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9032406-c782-48e6-bc8a-ccd611ad2655 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:37.629099 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9032406-c782-48e6-bc8a-ccd611ad2655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:37.629369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9032406-c782-48e6-bc8a-ccd611ad2655 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:37.630002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9032406-c782-48e6-bc8a-ccd611ad2655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:37.631927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9032406-c782-48e6-bc8a-ccd611ad2655 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:37.659064 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1439/2899] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:52:37 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:52:37.663057 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa58f09-4748-4654-9200-b5380154e014 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:37.673021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa58f09-4748-4654-9200-b5380154e014 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:37.701981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:37.730377 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c780100-ebfc-4632-83f8-c54ea6310ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:37.731000 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c780100-ebfc-4632-83f8-c54ea6310ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:37.731276 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c780100-ebfc-4632-83f8-c54ea6310ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:37.731544 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c780100-ebfc-4632-83f8-c54ea6310ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:37.732172 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c780100-ebfc-4632-83f8-c54ea6310ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:37.734086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c780100-ebfc-4632-83f8-c54ea6310ce1 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:37.753879 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1461/2900] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:52:37 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:52:37.757894 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9032406-c782-48e6-bc8a-ccd611ad2655 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:37.769180 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9032406-c782-48e6-bc8a-ccd611ad2655 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:37.773786 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a942fec-0c94-4f08-9b3f-630bd3614268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:37.774391 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a942fec-0c94-4f08-9b3f-630bd3614268 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:37.774675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a942fec-0c94-4f08-9b3f-630bd3614268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:37.774992 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a942fec-0c94-4f08-9b3f-630bd3614268 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:37.775628 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a942fec-0c94-4f08-9b3f-630bd3614268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:37.777255 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a942fec-0c94-4f08-9b3f-630bd3614268 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:37.788306 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1440/2901] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:52:37.792276 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c780100-ebfc-4632-83f8-c54ea6310ce1 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:37.802517 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c780100-ebfc-4632-83f8-c54ea6310ce1 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:37.807142 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82346c-1279-46fa-bcd4-fa67fc77e336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:37.807753 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82346c-1279-46fa-bcd4-fa67fc77e336 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:37.808014 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82346c-1279-46fa-bcd4-fa67fc77e336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:37.808288 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82346c-1279-46fa-bcd4-fa67fc77e336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:37.808959 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82346c-1279-46fa-bcd4-fa67fc77e336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:37.810542 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82346c-1279-46fa-bcd4-fa67fc77e336 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:37.821468 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1462/2902] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:52:37.825662 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a942fec-0c94-4f08-9b3f-630bd3614268 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:37.836060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a942fec-0c94-4f08-9b3f-630bd3614268 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:37.840586 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5623fd3-a5eb-4e96-9f0b-3dd44fe626f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:37.841216 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5623fd3-a5eb-4e96-9f0b-3dd44fe626f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:37.841491 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5623fd3-a5eb-4e96-9f0b-3dd44fe626f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:37.841760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5623fd3-a5eb-4e96-9f0b-3dd44fe626f4 admin admin] PATH_INFO: `/v3/projects/b4994e637993400a8521865df1be7895/users/503740b6c2a941689796a43fbf0ea1aa/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:37.856722 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5623fd3-a5eb-4e96-9f0b-3dd44fe626f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4994e637993400a8521865df1be7895, user_id=503740b6c2a941689796a43fbf0ea1aa, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:37.859433 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5623fd3-a5eb-4e96-9f0b-3dd44fe626f4 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:37.872486 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1441/2903] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:52:37 2022] PUT /identity/v3/projects/b4994e637993400a8521865df1be7895/users/503740b6c2a941689796a43fbf0ea1aa/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:37.883014 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd6205-24a4-4d64-98b5-7b25e8979fce None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:37.883302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd6205-24a4-4d64-98b5-7b25e8979fce None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:37.883578 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd6205-24a4-4d64-98b5-7b25e8979fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:37.911279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-87fd6205-24a4-4d64-98b5-7b25e8979fce None None] MFA Rules not processed for user `503740b6c2a941689796a43fbf0ea1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:37.912486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-87fd6205-24a4-4d64-98b5-7b25e8979fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:37.977018 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1463/2904] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:52:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:52:37.981465 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5623fd3-a5eb-4e96-9f0b-3dd44fe626f4 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:38.042694 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5623fd3-a5eb-4e96-9f0b-3dd44fe626f4 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:38.047288 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33569e-edab-4356-ba6b-467ab1c19b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:38.047885 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33569e-edab-4356-ba6b-467ab1c19b54 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:38.048285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33569e-edab-4356-ba6b-467ab1c19b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:38.048640 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33569e-edab-4356-ba6b-467ab1c19b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:38.049206 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33569e-edab-4356-ba6b-467ab1c19b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:38.051182 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33569e-edab-4356-ba6b-467ab1c19b54 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:38.077583 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1442/2905] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:52:37 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:52:38.082327 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd6205-24a4-4d64-98b5-7b25e8979fce None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:38.093139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd6205-24a4-4d64-98b5-7b25e8979fce None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:38.148628 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0bb21-0271-45ed-b184-459e17da834f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:38.149221 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0bb21-0271-45ed-b184-459e17da834f admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:38.149501 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0bb21-0271-45ed-b184-459e17da834f admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:38.149774 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0bb21-0271-45ed-b184-459e17da834f admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:38.150390 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0bb21-0271-45ed-b184-459e17da834f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:38.152305 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0bb21-0271-45ed-b184-459e17da834f admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:38.172733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1464/2906] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:52:38 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:52:38.176802 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33569e-edab-4356-ba6b-467ab1c19b54 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:38.187007 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33569e-edab-4356-ba6b-467ab1c19b54 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:38.192413 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21290355-f679-4cca-ad81-2f012227b85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:38.193003 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21290355-f679-4cca-ad81-2f012227b85e admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:38.193283 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21290355-f679-4cca-ad81-2f012227b85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:38.193822 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21290355-f679-4cca-ad81-2f012227b85e admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:38.194460 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21290355-f679-4cca-ad81-2f012227b85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:38.196074 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21290355-f679-4cca-ad81-2f012227b85e admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:38.207018 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1443/2907] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:52:38.210875 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0bb21-0271-45ed-b184-459e17da834f admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:38.221472 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0bb21-0271-45ed-b184-459e17da834f admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:38.226075 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b76141-84f5-490c-a900-1825565a57e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:38.226710 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b76141-84f5-490c-a900-1825565a57e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:38.227005 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b76141-84f5-490c-a900-1825565a57e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:38.227279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b76141-84f5-490c-a900-1825565a57e4 admin admin] PATH_INFO: `/v3/projects/561081107d324ffa9304d1389e9ccf17/users/9438459662664de39ee04c0e11ee940b/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:38.242021 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b76141-84f5-490c-a900-1825565a57e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=561081107d324ffa9304d1389e9ccf17, user_id=9438459662664de39ee04c0e11ee940b, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:38.244791 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b76141-84f5-490c-a900-1825565a57e4 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:38.258023 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1465/2908] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:52:38 2022] PUT /identity/v3/projects/561081107d324ffa9304d1389e9ccf17/users/9438459662664de39ee04c0e11ee940b/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:38.262060 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21290355-f679-4cca-ad81-2f012227b85e admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:38.272402 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21290355-f679-4cca-ad81-2f012227b85e admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:38.316006 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:38.331634 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391e4a9-32db-49f5-b2bb-1819411578c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:38.332189 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391e4a9-32db-49f5-b2bb-1819411578c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:38.332475 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391e4a9-32db-49f5-b2bb-1819411578c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:38.332747 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391e4a9-32db-49f5-b2bb-1819411578c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:38.333385 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391e4a9-32db-49f5-b2bb-1819411578c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:38.335004 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391e4a9-32db-49f5-b2bb-1819411578c3 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:38.347134 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1444/2909] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:52:38.351486 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b76141-84f5-490c-a900-1825565a57e4 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:38.361890 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b76141-84f5-490c-a900-1825565a57e4 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:38.366457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f5422-f3aa-4377-9ead-729e02a99e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:38.367147 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f5422-f3aa-4377-9ead-729e02a99e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:38.367428 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f5422-f3aa-4377-9ead-729e02a99e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:38.367704 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f5422-f3aa-4377-9ead-729e02a99e28 admin admin] PATH_INFO: `/v3/projects/561081107d324ffa9304d1389e9ccf17/users/9438459662664de39ee04c0e11ee940b/roles/50adf18edc1a47b2bae0876828a88dbf` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:38.369626 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f5422-f3aa-4377-9ead-729e02a99e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=561081107d324ffa9304d1389e9ccf17, user_id=9438459662664de39ee04c0e11ee940b, role_id=50adf18edc1a47b2bae0876828a88dbf)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:38.372358 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f5422-f3aa-4377-9ead-729e02a99e28 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:38.374581 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:38.384244 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1466/2910] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:52:38 2022] PUT /identity/v3/projects/561081107d324ffa9304d1389e9ccf17/users/9438459662664de39ee04c0e11ee940b/roles/50adf18edc1a47b2bae0876828a88dbf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:38.396035 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22463f33-94c9-448c-ab17-c9be19f4eaaa None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:38.396451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22463f33-94c9-448c-ab17-c9be19f4eaaa None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:38.396826 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22463f33-94c9-448c-ab17-c9be19f4eaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:38.427349 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-22463f33-94c9-448c-ab17-c9be19f4eaaa None None] MFA Rules not processed for user `9438459662664de39ee04c0e11ee940b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:38.428574 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-22463f33-94c9-448c-ab17-c9be19f4eaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:38.495664 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1445/2911] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:52:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:52:38.506590 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f5422-f3aa-4377-9ead-729e02a99e28 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:38.508302 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-295f5422-f3aa-4377-9ead-729e02a99e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:38.566819 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f5422-f3aa-4377-9ead-729e02a99e28 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:38.570744 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24585beb-1544-4839-9773-0994daeb1870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:38.571363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24585beb-1544-4839-9773-0994daeb1870 service cinder] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:38.571640 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24585beb-1544-4839-9773-0994daeb1870 service cinder] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:38.571913 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24585beb-1544-4839-9773-0994daeb1870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:38.580916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24585beb-1544-4839-9773-0994daeb1870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:38.582399 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24585beb-1544-4839-9773-0994daeb1870 service cinder] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:38.591656 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1467/2912] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:52:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:52:38.677487 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22463f33-94c9-448c-ab17-c9be19f4eaaa None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:38.687286 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22463f33-94c9-448c-ab17-c9be19f4eaaa None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:38.691405 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc297e-215a-46cb-a0b1-b5ead140f5f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:38.692026 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc297e-215a-46cb-a0b1-b5ead140f5f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:38.692301 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc297e-215a-46cb-a0b1-b5ead140f5f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:38.692570 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc297e-215a-46cb-a0b1-b5ead140f5f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:38.750092 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc297e-215a-46cb-a0b1-b5ead140f5f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:38.751649 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc297e-215a-46cb-a0b1-b5ead140f5f1 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:38.760499 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1446/2913] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:52:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:52:43.433293 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24585beb-1544-4839-9773-0994daeb1870 service cinder] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:43.493714 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24585beb-1544-4839-9773-0994daeb1870 service cinder] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:43.498360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f40296-6904-45ad-9033-a0253f6ab765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:43.499044 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f40296-6904-45ad-9033-a0253f6ab765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:43.499324 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f40296-6904-45ad-9033-a0253f6ab765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:43.499595 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f40296-6904-45ad-9033-a0253f6ab765 admin admin] PATH_INFO: `/v3/users/503740b6c2a941689796a43fbf0ea1aa` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:43.500717 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f40296-6904-45ad-9033-a0253f6ab765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=503740b6c2a941689796a43fbf0ea1aa)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:43.503301 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f40296-6904-45ad-9033-a0253f6ab765 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:43.549420 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c4f40296-6904-45ad-9033-a0253f6ab765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '503740b6c2a941689796a43fbf0ea1aa'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:43.550067 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c4f40296-6904-45ad-9033-a0253f6ab765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '503740b6c2a941689796a43fbf0ea1aa'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:43.550689 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c4f40296-6904-45ad-9033-a0253f6ab765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '503740b6c2a941689796a43fbf0ea1aa'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:43.562285 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c4f40296-6904-45ad-9033-a0253f6ab765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '503740b6c2a941689796a43fbf0ea1aa'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:43.569968 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c4f40296-6904-45ad-9033-a0253f6ab765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '503740b6c2a941689796a43fbf0ea1aa'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:43.582098 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1468/2914] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:52:43 2022] DELETE /identity/v3/users/503740b6c2a941689796a43fbf0ea1aa => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:52:43.587012 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c41d6-ecf9-407f-a594-0eb7dfbf05ea None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:43.587504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c41d6-ecf9-407f-a594-0eb7dfbf05ea None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:43.587504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c41d6-ecf9-407f-a594-0eb7dfbf05ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:43.606601 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-538c41d6-ecf9-407f-a594-0eb7dfbf05ea None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:43.607851 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-538c41d6-ecf9-407f-a594-0eb7dfbf05ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:43.666517 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1447/2915] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:52:43.677066 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f40296-6904-45ad-9033-a0253f6ab765 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:43.678443 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c4f40296-6904-45ad-9033-a0253f6ab765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:43.697810 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:43.738947 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f40296-6904-45ad-9033-a0253f6ab765 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:43.742555 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd3eb6-70bc-4e8a-b422-a001b9428626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:43.743177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd3eb6-70bc-4e8a-b422-a001b9428626 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:43.743808 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd3eb6-70bc-4e8a-b422-a001b9428626 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:43.744089 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd3eb6-70bc-4e8a-b422-a001b9428626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:43.753541 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd3eb6-70bc-4e8a-b422-a001b9428626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:43.754979 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd3eb6-70bc-4e8a-b422-a001b9428626 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:43.764568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1469/2916] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:52:44.025671 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c41d6-ecf9-407f-a594-0eb7dfbf05ea None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:44.027161 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-538c41d6-ecf9-407f-a594-0eb7dfbf05ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:44.039328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c41d6-ecf9-407f-a594-0eb7dfbf05ea None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:44.044016 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3306c-af08-42e2-a783-1b4e7a259014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:44.045272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3306c-af08-42e2-a783-1b4e7a259014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:44.045718 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3306c-af08-42e2-a783-1b4e7a259014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:44.046000 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3306c-af08-42e2-a783-1b4e7a259014 admin admin] PATH_INFO: `/v3/projects/b4994e637993400a8521865df1be7895` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:44.047245 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3306c-af08-42e2-a783-1b4e7a259014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4994e637993400a8521865df1be7895)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:44.050204 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3306c-af08-42e2-a783-1b4e7a259014 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:44.052039 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:44.097451 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b0b3306c-af08-42e2-a783-1b4e7a259014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4994e637993400a8521865df1be7895', 'request_id': 'req-b0b3306c-af08-42e2-a783-1b4e7a259014'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:44.102853 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b0b3306c-af08-42e2-a783-1b4e7a259014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4994e637993400a8521865df1be7895', 'request_id': 'req-b0b3306c-af08-42e2-a783-1b4e7a259014'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:44.108942 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b0b3306c-af08-42e2-a783-1b4e7a259014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4994e637993400a8521865df1be7895', 'request_id': 'req-b0b3306c-af08-42e2-a783-1b4e7a259014'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:44.123251 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b0b3306c-af08-42e2-a783-1b4e7a259014 admin admin] The token cache is being invalidate because project b4994e637993400a8521865df1be7895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:52:44.123545 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b0b3306c-af08-42e2-a783-1b4e7a259014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:44.124194 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b0b3306c-af08-42e2-a783-1b4e7a259014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:44.125675 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1448/2917] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:52:44 2022] DELETE /identity/v3/projects/b4994e637993400a8521865df1be7895 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:44.130568 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd3eb6-70bc-4e8a-b422-a001b9428626 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:44.140177 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd3eb6-70bc-4e8a-b422-a001b9428626 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:44.196189 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7dafc-2a51-4a70-8cb3-89e9963f9908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:44.196800 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7dafc-2a51-4a70-8cb3-89e9963f9908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:44.197084 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7dafc-2a51-4a70-8cb3-89e9963f9908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:44.197367 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7dafc-2a51-4a70-8cb3-89e9963f9908 admin admin] PATH_INFO: `/v3/users/9438459662664de39ee04c0e11ee940b` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:44.198488 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7dafc-2a51-4a70-8cb3-89e9963f9908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9438459662664de39ee04c0e11ee940b)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:44.200441 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7dafc-2a51-4a70-8cb3-89e9963f9908 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:44.247808 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-94a7dafc-2a51-4a70-8cb3-89e9963f9908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9438459662664de39ee04c0e11ee940b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:44.248733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-94a7dafc-2a51-4a70-8cb3-89e9963f9908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9438459662664de39ee04c0e11ee940b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:44.249730 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-94a7dafc-2a51-4a70-8cb3-89e9963f9908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9438459662664de39ee04c0e11ee940b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:44.262637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-94a7dafc-2a51-4a70-8cb3-89e9963f9908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9438459662664de39ee04c0e11ee940b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:44.270132 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-94a7dafc-2a51-4a70-8cb3-89e9963f9908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9438459662664de39ee04c0e11ee940b'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:44.284584 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1470/2918] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:52:44 2022] DELETE /identity/v3/users/9438459662664de39ee04c0e11ee940b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:44.561194 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3306c-af08-42e2-a783-1b4e7a259014 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:44.562745 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b0b3306c-af08-42e2-a783-1b4e7a259014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:44.578323 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3306c-af08-42e2-a783-1b4e7a259014 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:44.635869 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef4dd8-de46-4f9a-a703-b630b2a97116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:44.636578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef4dd8-de46-4f9a-a703-b630b2a97116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:44.636757 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef4dd8-de46-4f9a-a703-b630b2a97116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:44.637029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef4dd8-de46-4f9a-a703-b630b2a97116 admin admin] PATH_INFO: `/v3/projects/561081107d324ffa9304d1389e9ccf17` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:44.638209 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef4dd8-de46-4f9a-a703-b630b2a97116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=561081107d324ffa9304d1389e9ccf17)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:44.640214 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef4dd8-de46-4f9a-a703-b630b2a97116 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:44.686328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f0ef4dd8-de46-4f9a-a703-b630b2a97116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561081107d324ffa9304d1389e9ccf17', 'request_id': 'req-f0ef4dd8-de46-4f9a-a703-b630b2a97116'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:44.692061 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f0ef4dd8-de46-4f9a-a703-b630b2a97116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561081107d324ffa9304d1389e9ccf17', 'request_id': 'req-f0ef4dd8-de46-4f9a-a703-b630b2a97116'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:44.698250 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f0ef4dd8-de46-4f9a-a703-b630b2a97116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561081107d324ffa9304d1389e9ccf17', 'request_id': 'req-f0ef4dd8-de46-4f9a-a703-b630b2a97116'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:44.710196 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f0ef4dd8-de46-4f9a-a703-b630b2a97116 admin admin] The token cache is being invalidate because project 561081107d324ffa9304d1389e9ccf17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:52:44.710483 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f0ef4dd8-de46-4f9a-a703-b630b2a97116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:44.711136 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-f0ef4dd8-de46-4f9a-a703-b630b2a97116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:44.712653 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1449/2919] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:52:44 2022] DELETE /identity/v3/projects/561081107d324ffa9304d1389e9ccf17 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:44.718365 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae0aca-23b7-4d44-a56e-1bd9c9dbc856 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:44.718872 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae0aca-23b7-4d44-a56e-1bd9c9dbc856 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:44.718971 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae0aca-23b7-4d44-a56e-1bd9c9dbc856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:44.739458 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-feae0aca-23b7-4d44-a56e-1bd9c9dbc856 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:44.740651 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-feae0aca-23b7-4d44-a56e-1bd9c9dbc856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:44.772460 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:44.802618 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1471/2920] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:52:44.810348 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333436a-358c-42c5-82d3-d0a4ad669eec None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:44.810636 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333436a-358c-42c5-82d3-d0a4ad669eec None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:44.810943 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333436a-358c-42c5-82d3-d0a4ad669eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:44.830548 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-a333436a-358c-42c5-82d3-d0a4ad669eec None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:44.831790 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a333436a-358c-42c5-82d3-d0a4ad669eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:44.839729 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1450/2921] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:52:44.843841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae0aca-23b7-4d44-a56e-1bd9c9dbc856 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:44.854319 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae0aca-23b7-4d44-a56e-1bd9c9dbc856 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:44.858844 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb67a73-def2-4377-ad70-786fc159adc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:44.859440 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb67a73-def2-4377-ad70-786fc159adc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:44.859712 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb67a73-def2-4377-ad70-786fc159adc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:44.859981 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb67a73-def2-4377-ad70-786fc159adc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:44.861561 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb67a73-def2-4377-ad70-786fc159adc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:52:44.861860 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb67a73-def2-4377-ad70-786fc159adc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:44.863457 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb67a73-def2-4377-ad70-786fc159adc3 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:44.874713 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1472/2922] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 01:52:44.879190 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333436a-358c-42c5-82d3-d0a4ad669eec None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:44.888382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333436a-358c-42c5-82d3-d0a4ad669eec None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:44.892952 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633ca9e-bc89-4400-84a7-5c1670ac3d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:44.893542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633ca9e-bc89-4400-84a7-5c1670ac3d65 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:44.893821 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633ca9e-bc89-4400-84a7-5c1670ac3d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:44.894098 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633ca9e-bc89-4400-84a7-5c1670ac3d65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:44.894715 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633ca9e-bc89-4400-84a7-5c1670ac3d65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:44.896633 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633ca9e-bc89-4400-84a7-5c1670ac3d65 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:44.908249 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:44.925578 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1451/2923] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:52:44 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:52:44.929749 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb67a73-def2-4377-ad70-786fc159adc3 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:44.939858 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb67a73-def2-4377-ad70-786fc159adc3 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:44.996058 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e70b5-50b1-4d8a-adab-8efc4e5e5efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:44.997488 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e70b5-50b1-4d8a-adab-8efc4e5e5efa admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:44.997781 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e70b5-50b1-4d8a-adab-8efc4e5e5efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:44.998519 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e70b5-50b1-4d8a-adab-8efc4e5e5efa admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:44.999199 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e70b5-50b1-4d8a-adab-8efc4e5e5efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:45.001151 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e70b5-50b1-4d8a-adab-8efc4e5e5efa admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:45.027077 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1473/2924] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:52:44 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 01:52:45.035546 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633ca9e-bc89-4400-84a7-5c1670ac3d65 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:45.046606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633ca9e-bc89-4400-84a7-5c1670ac3d65 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:45.051370 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a0392-7de8-4226-b2b1-341482f62556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:45.051966 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a0392-7de8-4226-b2b1-341482f62556 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:45.052240 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a0392-7de8-4226-b2b1-341482f62556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:45.052506 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a0392-7de8-4226-b2b1-341482f62556 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:45.053133 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a0392-7de8-4226-b2b1-341482f62556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:45.054707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a0392-7de8-4226-b2b1-341482f62556 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:45.064751 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1452/2925] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:52:45.069168 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e70b5-50b1-4d8a-adab-8efc4e5e5efa admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:45.079643 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e70b5-50b1-4d8a-adab-8efc4e5e5efa admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:45.084581 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b85ba4-ef2e-454a-a317-2053fab739cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:45.085171 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b85ba4-ef2e-454a-a317-2053fab739cd admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:45.085453 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b85ba4-ef2e-454a-a317-2053fab739cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:45.085729 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b85ba4-ef2e-454a-a317-2053fab739cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:45.086368 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b85ba4-ef2e-454a-a317-2053fab739cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:45.087975 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b85ba4-ef2e-454a-a317-2053fab739cd admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:45.099385 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1474/2926] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:52:45.103371 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a0392-7de8-4226-b2b1-341482f62556 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:45.113147 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a0392-7de8-4226-b2b1-341482f62556 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:45.117677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e9aad-c825-4b3f-aa5c-65b38ed80472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:45.118311 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e9aad-c825-4b3f-aa5c-65b38ed80472 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:45.118586 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e9aad-c825-4b3f-aa5c-65b38ed80472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:45.118877 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e9aad-c825-4b3f-aa5c-65b38ed80472 admin admin] PATH_INFO: `/v3/projects/bc43a9031a46481ea78d458911eea11e/users/4a2bc713277242e49a6f98f68a58fe82/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:45.133217 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e9aad-c825-4b3f-aa5c-65b38ed80472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc43a9031a46481ea78d458911eea11e, user_id=4a2bc713277242e49a6f98f68a58fe82, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:45.135892 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e9aad-c825-4b3f-aa5c-65b38ed80472 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:45.148376 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1453/2927] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:52:45 2022] PUT /identity/v3/projects/bc43a9031a46481ea78d458911eea11e/users/4a2bc713277242e49a6f98f68a58fe82/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:45.159019 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f56f6-1509-4027-a49e-9d26c5143710 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:45.159311 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f56f6-1509-4027-a49e-9d26c5143710 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:45.159589 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f56f6-1509-4027-a49e-9d26c5143710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:45.187352 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-330f56f6-1509-4027-a49e-9d26c5143710 None None] MFA Rules not processed for user `4a2bc713277242e49a6f98f68a58fe82`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:45.188678 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-330f56f6-1509-4027-a49e-9d26c5143710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:45.253824 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1475/2928] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:52:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:52:45.264924 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e9aad-c825-4b3f-aa5c-65b38ed80472 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:45.267126 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f55e9aad-c825-4b3f-aa5c-65b38ed80472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:45.322544 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e9aad-c825-4b3f-aa5c-65b38ed80472 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:45.326161 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20cf6d-6761-464b-bc3f-bbea0af4f728 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:45.326747 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20cf6d-6761-464b-bc3f-bbea0af4f728 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:45.327062 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20cf6d-6761-464b-bc3f-bbea0af4f728 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:45.327333 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20cf6d-6761-464b-bc3f-bbea0af4f728 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:45.336058 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20cf6d-6761-464b-bc3f-bbea0af4f728 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:45.337462 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20cf6d-6761-464b-bc3f-bbea0af4f728 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:45.346869 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1454/2929] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:52:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:52:45.368527 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f56f6-1509-4027-a49e-9d26c5143710 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:45.403624 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:45.433101 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f56f6-1509-4027-a49e-9d26c5143710 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:45.437806 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d852086-3d36-474c-9ec6-d7b26d7becae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:45.439064 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d852086-3d36-474c-9ec6-d7b26d7becae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:45.439357 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d852086-3d36-474c-9ec6-d7b26d7becae admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:45.439637 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d852086-3d36-474c-9ec6-d7b26d7becae admin admin] PATH_INFO: `/v3/users/4a2bc713277242e49a6f98f68a58fe82` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:45.440800 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d852086-3d36-474c-9ec6-d7b26d7becae admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a2bc713277242e49a6f98f68a58fe82)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:45.442711 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d852086-3d36-474c-9ec6-d7b26d7becae admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:45.488073 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-3d852086-3d36-474c-9ec6-d7b26d7becae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a2bc713277242e49a6f98f68a58fe82'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:45.488735 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-3d852086-3d36-474c-9ec6-d7b26d7becae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a2bc713277242e49a6f98f68a58fe82'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:45.489357 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-3d852086-3d36-474c-9ec6-d7b26d7becae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a2bc713277242e49a6f98f68a58fe82'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:45.501630 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-3d852086-3d36-474c-9ec6-d7b26d7becae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a2bc713277242e49a6f98f68a58fe82'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:45.508383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-3d852086-3d36-474c-9ec6-d7b26d7becae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a2bc713277242e49a6f98f68a58fe82'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:45.521218 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1476/2930] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:52:45 2022] DELETE /identity/v3/users/4a2bc713277242e49a6f98f68a58fe82 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:45.525905 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6e235-f086-4799-8bad-cddcb061ee31 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:45.526190 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6e235-f086-4799-8bad-cddcb061ee31 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:45.526459 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6e235-f086-4799-8bad-cddcb061ee31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:45.546285 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-67b6e235-f086-4799-8bad-cddcb061ee31 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:45.547504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-67b6e235-f086-4799-8bad-cddcb061ee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:45.603986 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1455/2931] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 01:52:45.613841 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d852086-3d36-474c-9ec6-d7b26d7becae admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:45.615258 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-3d852086-3d36-474c-9ec6-d7b26d7becae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:45.672744 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d852086-3d36-474c-9ec6-d7b26d7becae admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:45.676464 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a01b52-2126-4a71-b1cb-d6d5eb4c2d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:45.677057 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a01b52-2126-4a71-b1cb-d6d5eb4c2d7c service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:45.677334 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a01b52-2126-4a71-b1cb-d6d5eb4c2d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:45.677605 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a01b52-2126-4a71-b1cb-d6d5eb4c2d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:45.686316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a01b52-2126-4a71-b1cb-d6d5eb4c2d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:45.687740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a01b52-2126-4a71-b1cb-d6d5eb4c2d7c service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:45.697819 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1477/2932] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:52:45.960082 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6e235-f086-4799-8bad-cddcb061ee31 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:45.961580 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-67b6e235-f086-4799-8bad-cddcb061ee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:45.974123 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6e235-f086-4799-8bad-cddcb061ee31 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:45.978707 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aac559-db59-47ad-bae8-1c2a92139240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:45.979356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aac559-db59-47ad-bae8-1c2a92139240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:45.979631 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aac559-db59-47ad-bae8-1c2a92139240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:45.979901 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aac559-db59-47ad-bae8-1c2a92139240 admin admin] PATH_INFO: `/v3/projects/bc43a9031a46481ea78d458911eea11e` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:45.981029 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aac559-db59-47ad-bae8-1c2a92139240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc43a9031a46481ea78d458911eea11e)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:45.982931 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aac559-db59-47ad-bae8-1c2a92139240 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:46.032473 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-87aac559-db59-47ad-bae8-1c2a92139240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc43a9031a46481ea78d458911eea11e', 'request_id': 'req-87aac559-db59-47ad-bae8-1c2a92139240'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:46.036357 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:46.038845 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-87aac559-db59-47ad-bae8-1c2a92139240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc43a9031a46481ea78d458911eea11e', 'request_id': 'req-87aac559-db59-47ad-bae8-1c2a92139240'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:46.046417 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-87aac559-db59-47ad-bae8-1c2a92139240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc43a9031a46481ea78d458911eea11e', 'request_id': 'req-87aac559-db59-47ad-bae8-1c2a92139240'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:46.059217 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-87aac559-db59-47ad-bae8-1c2a92139240 admin admin] The token cache is being invalidate because project bc43a9031a46481ea78d458911eea11e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:52:46.059501 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-87aac559-db59-47ad-bae8-1c2a92139240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:46.060109 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-87aac559-db59-47ad-bae8-1c2a92139240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:52:46.061664 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1456/2933] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:52:45 2022] DELETE /identity/v3/projects/bc43a9031a46481ea78d458911eea11e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 01:52:46.066647 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d544895-1d91-44df-8795-e1a364a07159 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:46.067224 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d544895-1d91-44df-8795-e1a364a07159 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:46.067342 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d544895-1d91-44df-8795-e1a364a07159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:46.088554 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-1d544895-1d91-44df-8795-e1a364a07159 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:46.089776 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-1d544895-1d91-44df-8795-e1a364a07159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:46.137648 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:46.150675 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1478/2934] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:52:46.159920 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dd376-49e1-4724-8ba0-44a87b1b9aff None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:46.160200 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dd376-49e1-4724-8ba0-44a87b1b9aff None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:46.160470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dd376-49e1-4724-8ba0-44a87b1b9aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:46.179967 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-714dd376-49e1-4724-8ba0-44a87b1b9aff None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:46.181158 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-714dd376-49e1-4724-8ba0-44a87b1b9aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:46.189504 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1457/2935] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:52:46.194004 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d544895-1d91-44df-8795-e1a364a07159 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:46.203680 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d544895-1d91-44df-8795-e1a364a07159 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:46.208724 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e654eb-aac8-44ed-bb61-640bb68a0048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:46.209309 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e654eb-aac8-44ed-bb61-640bb68a0048 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:46.209587 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e654eb-aac8-44ed-bb61-640bb68a0048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:46.209860 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e654eb-aac8-44ed-bb61-640bb68a0048 admin admin] PATH_INFO: `/v3/domains` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:46.210503 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e654eb-aac8-44ed-bb61-640bb68a0048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 01:52:46.210804 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e654eb-aac8-44ed-bb61-640bb68a0048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:46.212402 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e654eb-aac8-44ed-bb61-640bb68a0048 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:46.223651 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1479/2936] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 26 01:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 01:52:46.227763 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dd376-49e1-4724-8ba0-44a87b1b9aff None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:46.236768 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dd376-49e1-4724-8ba0-44a87b1b9aff None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:46.241369 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda8284-04da-424a-8c08-c90572d3f573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:46.241947 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda8284-04da-424a-8c08-c90572d3f573 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:46.242219 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda8284-04da-424a-8c08-c90572d3f573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:46.242482 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda8284-04da-424a-8c08-c90572d3f573 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:46.243136 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda8284-04da-424a-8c08-c90572d3f573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:46.245066 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda8284-04da-424a-8c08-c90572d3f573 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:46.273212 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1458/2937] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 26 01:52:46 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:52:46.277320 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e654eb-aac8-44ed-bb61-640bb68a0048 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:46.287273 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e654eb-aac8-44ed-bb61-640bb68a0048 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:46.342618 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aea879-a73c-4a65-b514-a58e6751edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:46.343234 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aea879-a73c-4a65-b514-a58e6751edb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:46.343515 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aea879-a73c-4a65-b514-a58e6751edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:46.343785 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aea879-a73c-4a65-b514-a58e6751edb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:46.344414 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aea879-a73c-4a65-b514-a58e6751edb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:46.346312 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aea879-a73c-4a65-b514-a58e6751edb0 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:46.366614 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1480/2938] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 26 01:52:46 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 01:52:46.370733 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda8284-04da-424a-8c08-c90572d3f573 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:46.381685 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda8284-04da-424a-8c08-c90572d3f573 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:46.386392 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c38e1-f303-4f8f-b63b-ac0caf05cfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:46.387050 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c38e1-f303-4f8f-b63b-ac0caf05cfbc admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:46.387328 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c38e1-f303-4f8f-b63b-ac0caf05cfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:46.387597 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c38e1-f303-4f8f-b63b-ac0caf05cfbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:46.388253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c38e1-f303-4f8f-b63b-ac0caf05cfbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:46.389821 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c38e1-f303-4f8f-b63b-ac0caf05cfbc admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:46.400244 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1459/2939] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:52:46.404182 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aea879-a73c-4a65-b514-a58e6751edb0 admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:46.414387 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aea879-a73c-4a65-b514-a58e6751edb0 admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:46.419010 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c56339-5b3b-4c41-87a0-fbc6dadfb4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:46.419602 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c56339-5b3b-4c41-87a0-fbc6dadfb4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:46.419878 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c56339-5b3b-4c41-87a0-fbc6dadfb4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:46.420149 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c56339-5b3b-4c41-87a0-fbc6dadfb4d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:46.420777 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c56339-5b3b-4c41-87a0-fbc6dadfb4d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:46.422344 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c56339-5b3b-4c41-87a0-fbc6dadfb4d4 admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:46.432950 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1481/2940] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 26 01:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 01:52:46.437068 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c38e1-f303-4f8f-b63b-ac0caf05cfbc admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:46.447791 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c38e1-f303-4f8f-b63b-ac0caf05cfbc admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:46.452338 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049fa7c-a78e-421d-bbed-a92e82dbe6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:46.452983 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049fa7c-a78e-421d-bbed-a92e82dbe6cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:46.453261 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049fa7c-a78e-421d-bbed-a92e82dbe6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:46.453550 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049fa7c-a78e-421d-bbed-a92e82dbe6cd admin admin] PATH_INFO: `/v3/projects/38498d12eef74ae2b668710b9aa80b62/users/fc044071fb304cce9e357ade97801765/roles/f4df3a7a4c0b4730abc0601e2b072ef4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:46.469030 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049fa7c-a78e-421d-bbed-a92e82dbe6cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=38498d12eef74ae2b668710b9aa80b62, user_id=fc044071fb304cce9e357ade97801765, role_id=f4df3a7a4c0b4730abc0601e2b072ef4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:46.471779 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049fa7c-a78e-421d-bbed-a92e82dbe6cd admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:46.484388 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1460/2941] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 26 01:52:46 2022] PUT /identity/v3/projects/38498d12eef74ae2b668710b9aa80b62/users/fc044071fb304cce9e357ade97801765/roles/f4df3a7a4c0b4730abc0601e2b072ef4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:52:46.494593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013b12a-61b8-46ac-a8a5-217efad315d8 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:46.494906 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013b12a-61b8-46ac-a8a5-217efad315d8 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:46.495188 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013b12a-61b8-46ac-a8a5-217efad315d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:46.522951 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-6013b12a-61b8-46ac-a8a5-217efad315d8 None None] MFA Rules not processed for user `fc044071fb304cce9e357ade97801765`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:46.524142 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-6013b12a-61b8-46ac-a8a5-217efad315d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:46.588316 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1482/2942] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:52:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:52:46.598993 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049fa7c-a78e-421d-bbed-a92e82dbe6cd admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:46.600778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4049fa7c-a78e-421d-bbed-a92e82dbe6cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:46.656621 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049fa7c-a78e-421d-bbed-a92e82dbe6cd admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:46.660405 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84371a48-5249-40e1-8c98-8e29dd9f02aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab8abb1394d41e3a30439699086da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:46.660994 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84371a48-5249-40e1-8c98-8e29dd9f02aa service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:46.661272 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84371a48-5249-40e1-8c98-8e29dd9f02aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:46.661542 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84371a48-5249-40e1-8c98-8e29dd9f02aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:46.669840 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84371a48-5249-40e1-8c98-8e29dd9f02aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:46.671329 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84371a48-5249-40e1-8c98-8e29dd9f02aa service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:46.680838 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1461/2943] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:52:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:52:48.051340 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f50444-e421-487c-83da-ee350f8cdf80 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:48.051879 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f50444-e421-487c-83da-ee350f8cdf80 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:48.051879 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f50444-e421-487c-83da-ee350f8cdf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:48.071377 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-34f50444-e421-487c-83da-ee350f8cdf80 None None] MFA Rules not processed for user `fc044071fb304cce9e357ade97801765`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:52:48.072572 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-34f50444-e421-487c-83da-ee350f8cdf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:48.079407 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1483/2944] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:52:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:52:49.546899 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84371a48-5249-40e1-8c98-8e29dd9f02aa service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:49.549044 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-84371a48-5249-40e1-8c98-8e29dd9f02aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:49.627027 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84371a48-5249-40e1-8c98-8e29dd9f02aa service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:49.632005 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9ec17-c0c2-44c9-bf75-6ddb5eb4b862 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7a1b839a6f4bdb9870217fa4d2527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:49.632607 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9ec17-c0c2-44c9-bf75-6ddb5eb4b862 service placement] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:49.632883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9ec17-c0c2-44c9-bf75-6ddb5eb4b862 service placement] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:49.633155 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9ec17-c0c2-44c9-bf75-6ddb5eb4b862 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:49.634895 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2ea9ec17-c0c2-44c9-bf75-6ddb5eb4b862 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:49.646157 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9ec17-c0c2-44c9-bf75-6ddb5eb4b862 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:49.647760 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9ec17-c0c2-44c9-bf75-6ddb5eb4b862 service placement] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:49.657530 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1462/2945] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:52:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:52:52.130716 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f50444-e421-487c-83da-ee350f8cdf80 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:52.132964 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-34f50444-e421-487c-83da-ee350f8cdf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:52.181086 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:52.210686 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f50444-e421-487c-83da-ee350f8cdf80 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:52.216139 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00adc95b-e031-4a00-a8b7-c6cf036bd0f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:52.216740 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adc95b-e031-4a00-a8b7-c6cf036bd0f9 service nova] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:52.217017 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adc95b-e031-4a00-a8b7-c6cf036bd0f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:52.217291 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adc95b-e031-4a00-a8b7-c6cf036bd0f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:52.219078 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-00adc95b-e031-4a00-a8b7-c6cf036bd0f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:52.232089 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adc95b-e031-4a00-a8b7-c6cf036bd0f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:52.233683 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adc95b-e031-4a00-a8b7-c6cf036bd0f9 service nova] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:52.245561 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1484/2946] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:52:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:52:58.204731 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9ec17-c0c2-44c9-bf75-6ddb5eb4b862 service placement] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:52:58.217993 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9ec17-c0c2-44c9-bf75-6ddb5eb4b862 service placement] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:52:58.224382 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c979bff-85d6-4eec-adfc-e1723402ca80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6eaeb6bced49afabc7bdaa5e7cecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:52:58.224977 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c979bff-85d6-4eec-adfc-e1723402ca80 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:52:58.225726 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c979bff-85d6-4eec-adfc-e1723402ca80 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:52:58.226002 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c979bff-85d6-4eec-adfc-e1723402ca80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:52:58.227761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8c979bff-85d6-4eec-adfc-e1723402ca80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:52:58.241082 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c979bff-85d6-4eec-adfc-e1723402ca80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:52:58.242677 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c979bff-85d6-4eec-adfc-e1723402ca80 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:52:58.247762 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:52:58.255478 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1463/2947] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:52:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:53:02.241269 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=14 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:53:02.878616 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6377456-337e-422c-b6a6-3b33b6b626df None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:53:02.878939 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6377456-337e-422c-b6a6-3b33b6b626df None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:53:02.879220 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6377456-337e-422c-b6a6-3b33b6b626df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:53:02.898383 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-a6377456-337e-422c-b6a6-3b33b6b626df None None] MFA Rules not processed for user `6f4696c410f343709be200dee463bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:53:02.899613 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-a6377456-337e-422c-b6a6-3b33b6b626df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:53:02.955357 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1485/2948] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 26 01:53:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:53:02.967101 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c979bff-85d6-4eec-adfc-e1723402ca80 service nova] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:53:02.968485 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8c979bff-85d6-4eec-adfc-e1723402ca80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:53:03.036592 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c979bff-85d6-4eec-adfc-e1723402ca80 service nova] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:53:03.041598 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36b196-e0eb-4ca1-8385-5bc74eb5b57a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c924da83d1a94c49814d2e7b5969c8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:53:03.042199 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36b196-e0eb-4ca1-8385-5bc74eb5b57a service swift] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:53:03.042470 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36b196-e0eb-4ca1-8385-5bc74eb5b57a service swift] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:53:03.042737 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36b196-e0eb-4ca1-8385-5bc74eb5b57a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:53:03.051415 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36b196-e0eb-4ca1-8385-5bc74eb5b57a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:53:03.052972 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36b196-e0eb-4ca1-8385-5bc74eb5b57a service swift] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:53:03.060735 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1464/2949] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 26 01:53:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 01:53:03.566877 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e1af8-f170-4fd4-9b6e-64c1bf8199b2 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:53:03.567382 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e1af8-f170-4fd4-9b6e-64c1bf8199b2 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:53:03.567503 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e1af8-f170-4fd4-9b6e-64c1bf8199b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:53:03.587862 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-946e1af8-f170-4fd4-9b6e-64c1bf8199b2 None None] MFA Rules not processed for user `6f4696c410f343709be200dee463bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:53:03.589066 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-946e1af8-f170-4fd4-9b6e-64c1bf8199b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:53:03.596216 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1486/2950] 10.222.0.26 () {58 vars in 967 bytes} [Mon Sep 26 01:53:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:53:03.608034 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36b196-e0eb-4ca1-8385-5bc74eb5b57a service swift] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:53:03.618778 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36b196-e0eb-4ca1-8385-5bc74eb5b57a service swift] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:53:03.623887 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a566d-2d48-43e2-913e-aa6afbe68555 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c924da83d1a94c49814d2e7b5969c8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:53:03.624479 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a566d-2d48-43e2-913e-aa6afbe68555 service swift] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:53:03.624761 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a566d-2d48-43e2-913e-aa6afbe68555 service swift] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:53:03.625606 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a566d-2d48-43e2-913e-aa6afbe68555 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:53:03.633556 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a566d-2d48-43e2-913e-aa6afbe68555 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:53:03.635167 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a566d-2d48-43e2-913e-aa6afbe68555 service swift] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:53:03.642971 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1465/2951] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 26 01:53:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 01:53:03.863076 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975e62-407e-4a37-8469-ceaffea088d3 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:53:03.863362 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975e62-407e-4a37-8469-ceaffea088d3 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:53:03.863634 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975e62-407e-4a37-8469-ceaffea088d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:53:03.883398 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-25975e62-407e-4a37-8469-ceaffea088d3 None None] MFA Rules not processed for user `6f4696c410f343709be200dee463bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:53:03.884593 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-25975e62-407e-4a37-8469-ceaffea088d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:53:03.891719 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1487/2952] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 26 01:53:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:53:03.903385 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a566d-2d48-43e2-913e-aa6afbe68555 service swift] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:53:03.913714 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a566d-2d48-43e2-913e-aa6afbe68555 service swift] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:53:03.918692 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedb1ec-8e55-4108-94ca-b8736633c29a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c924da83d1a94c49814d2e7b5969c8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:53:03.919306 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedb1ec-8e55-4108-94ca-b8736633c29a service swift] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:53:03.919586 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedb1ec-8e55-4108-94ca-b8736633c29a service swift] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:53:03.919859 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedb1ec-8e55-4108-94ca-b8736633c29a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:53:03.928356 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedb1ec-8e55-4108-94ca-b8736633c29a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:53:03.929909 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedb1ec-8e55-4108-94ca-b8736633c29a service swift] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:53:03.938380 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1466/2953] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 26 01:53:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 01:53:04.259363 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a40f9-7862-4d6b-9482-bc7a7c861c36 None None] REQUEST_METHOD: `POST` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:53:04.259652 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a40f9-7862-4d6b-9482-bc7a7c861c36 None None] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:53:04.259935 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a40f9-7862-4d6b-9482-bc7a7c861c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:53:04.279360 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.auth.core [None req-5a3a40f9-7862-4d6b-9482-bc7a7c861c36 None None] MFA Rules not processed for user `6f4696c410f343709be200dee463bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:53:04.280559 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-5a3a40f9-7862-4d6b-9482-bc7a7c861c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:53:04.288343 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1488/2954] 10.222.0.26 () {58 vars in 967 bytes} [Mon Sep 26 01:53:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:53:04.300892 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedb1ec-8e55-4108-94ca-b8736633c29a service swift] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:53:04.311387 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedb1ec-8e55-4108-94ca-b8736633c29a service swift] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:53:04.316474 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d1ff9-6b71-4f69-b0a2-034a1555e85d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c924da83d1a94c49814d2e7b5969c8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:53:04.317059 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d1ff9-6b71-4f69-b0a2-034a1555e85d service swift] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:53:04.317339 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d1ff9-6b71-4f69-b0a2-034a1555e85d service swift] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:53:04.317613 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d1ff9-6b71-4f69-b0a2-034a1555e85d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:53:04.325693 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d1ff9-6b71-4f69-b0a2-034a1555e85d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:53:04.327275 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d1ff9-6b71-4f69-b0a2-034a1555e85d service swift] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:53:04.335253 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1467/2955] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 26 01:53:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 01:53:06.419566 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a40f9-7862-4d6b-9482-bc7a7c861c36 None None] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:53:06.483844 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a40f9-7862-4d6b-9482-bc7a7c861c36 None None] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:53:06.488390 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152120a-1314-48ef-8455-2b68fb2f701d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:53:06.489006 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152120a-1314-48ef-8455-2b68fb2f701d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:53:06.489283 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152120a-1314-48ef-8455-2b68fb2f701d admin admin] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:53:06.489554 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152120a-1314-48ef-8455-2b68fb2f701d admin admin] PATH_INFO: `/v3/users/fc044071fb304cce9e357ade97801765` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:53:06.490671 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152120a-1314-48ef-8455-2b68fb2f701d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc044071fb304cce9e357ade97801765)` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:53:06.492592 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152120a-1314-48ef-8455-2b68fb2f701d admin admin] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:53:06.537724 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c152120a-1314-48ef-8455-2b68fb2f701d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc044071fb304cce9e357ade97801765'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:53:06.538370 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c152120a-1314-48ef-8455-2b68fb2f701d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc044071fb304cce9e357ade97801765'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:53:06.539001 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c152120a-1314-48ef-8455-2b68fb2f701d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc044071fb304cce9e357ade97801765'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:53:06.551117 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c152120a-1314-48ef-8455-2b68fb2f701d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc044071fb304cce9e357ade97801765'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:53:06.557909 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.notifications [None req-c152120a-1314-48ef-8455-2b68fb2f701d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc044071fb304cce9e357ade97801765'} {{(pid=81422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:53:06.571339 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1489/2956] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 26 01:53:06 2022] DELETE /identity/v3/users/fc044071fb304cce9e357ade97801765 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:53:06.575883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b3393-2980-41e9-892b-1c6fc58a06c1 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:53:06.576381 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b3393-2980-41e9-892b-1c6fc58a06c1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:53:06.576505 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b3393-2980-41e9-892b-1c6fc58a06c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:53:06.596222 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-e07b3393-2980-41e9-892b-1c6fc58a06c1 None None] MFA Rules not processed for user `025ba57ed41d495b9ce978e22dc2973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 01:53:06.597435 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e07b3393-2980-41e9-892b-1c6fc58a06c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:53:06.654927 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1468/2957] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 26 01:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 01:53:06.665362 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152120a-1314-48ef-8455-2b68fb2f701d admin admin] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:53:06.666885 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-c152120a-1314-48ef-8455-2b68fb2f701d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:53:06.673916 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:53:06.726253 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152120a-1314-48ef-8455-2b68fb2f701d admin admin] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:53:06.729856 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556e63e-40a9-4ebd-a725-01be763abad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c1005979d04c55b8746c25b0994086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:53:06.730445 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556e63e-40a9-4ebd-a725-01be763abad8 service neutron] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:53:06.730721 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556e63e-40a9-4ebd-a725-01be763abad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:53:06.731018 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556e63e-40a9-4ebd-a725-01be763abad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:53:06.740512 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556e63e-40a9-4ebd-a725-01be763abad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:53:06.741911 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556e63e-40a9-4ebd-a725-01be763abad8 service neutron] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:53:06.751337 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1490/2958] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:53:06.922397 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b3393-2980-41e9-892b-1c6fc58a06c1 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:53:06.923883 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e07b3393-2980-41e9-892b-1c6fc58a06c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:53:06.935733 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b3393-2980-41e9-892b-1c6fc58a06c1 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:53:06.941045 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61b705-28b5-4f58-b974-37e118a4a963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025ba57ed41d495b9ce978e22dc2973b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ba2dacdbbb943beb977f1070136e466', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:53:06.941741 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61b705-28b5-4f58-b974-37e118a4a963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:53:06.942051 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61b705-28b5-4f58-b974-37e118a4a963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:53:06.942326 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61b705-28b5-4f58-b974-37e118a4a963 admin admin] PATH_INFO: `/v3/projects/38498d12eef74ae2b668710b9aa80b62` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:53:06.943660 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61b705-28b5-4f58-b974-37e118a4a963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38498d12eef74ae2b668710b9aa80b62)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:53:06.945558 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61b705-28b5-4f58-b974-37e118a4a963 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:53:06.989783 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:53:06.993898 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bf61b705-28b5-4f58-b974-37e118a4a963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38498d12eef74ae2b668710b9aa80b62', 'request_id': 'req-bf61b705-28b5-4f58-b974-37e118a4a963'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:53:06.999822 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bf61b705-28b5-4f58-b974-37e118a4a963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38498d12eef74ae2b668710b9aa80b62', 'request_id': 'req-bf61b705-28b5-4f58-b974-37e118a4a963'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:53:07.006435 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bf61b705-28b5-4f58-b974-37e118a4a963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38498d12eef74ae2b668710b9aa80b62', 'request_id': 'req-bf61b705-28b5-4f58-b974-37e118a4a963'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:53:07.019414 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bf61b705-28b5-4f58-b974-37e118a4a963 admin admin] The token cache is being invalidate because project 38498d12eef74ae2b668710b9aa80b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 01:53:07.019704 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bf61b705-28b5-4f58-b974-37e118a4a963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:53:07.020344 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-bf61b705-28b5-4f58-b974-37e118a4a963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 01:53:07.021806 dv-cinder-859203-2-smb devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1469/2959] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 26 01:53:06 2022] DELETE /identity/v3/projects/38498d12eef74ae2b668710b9aa80b62 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 01:53:16.747027 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=24 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:53:17.015660 dv-cinder-859203-2-smb devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=8,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:54:35.056439 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556e63e-40a9-4ebd-a725-01be763abad8 service neutron] Authenticating user token {{(pid=81422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 01:54:35.057863 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-3556e63e-40a9-4ebd-a725-01be763abad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:54:35.197376 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556e63e-40a9-4ebd-a725-01be763abad8 service neutron] Validating token access rules against request {{(pid=81422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 01:54:35.256321 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54e9a7-5f03-452a-933e-c32058db9c3c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7a1b839a6f4bdb9870217fa4d2527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fda1727cc3d47b9a1fae73c74f32c27', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 01:54:35.256971 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54e9a7-5f03-452a-933e-c32058db9c3c service placement] REQUEST_METHOD: `GET` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 01:54:35.257279 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54e9a7-5f03-452a-933e-c32058db9c3c service placement] SCRIPT_NAME: `/identity` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 01:54:35.257787 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54e9a7-5f03-452a-933e-c32058db9c3c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 01:54:35.259733 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.fernet_utils [None req-8e54e9a7-5f03-452a-933e-c32058db9c3c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 01:54:35.272370 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54e9a7-5f03-452a-933e-c32058db9c3c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 01:54:35.273958 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54e9a7-5f03-452a-933e-c32058db9c3c service placement] RBAC: Authorization granted {{(pid=81422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 01:54:35.283842 dv-cinder-859203-2-smb devstack@keystone.service[81422]: [pid: 81422|app: 0|req: 1491/2960] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 26 01:54:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 01:54:45.279611 dv-cinder-859203-2-smb devstack@keystone.service[81422]: DEBUG dbcounter [-] [81422] Writing DB stats keystone:SELECT=89 {{(pid=81422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}